mmm assistant mk2

dvbit

Update: I reinstalled from scratch (again for a2d I had to do a npm rebuild, you may want to take note)

Still the same issue of assistant hanging after query:
I do the query, hotword recognized, query recognized, answer fetched, answer saved in temp and displayed on screen bottom but no audio feedback and gogle spin icon going.
After refreshing the screen goes again in “steady state”

Now I am sure I have a sound output issue.
Meaning that I can play sounds on the mirror via vlc but somehow the plugin cannot.
I guess that somehow the plugin does not receive a feedback of “play ended” from the output.
What I also noticed is that if I refresh the browser by vnc the mirror will go again in a waiting status.
Will continue checking

Chris

@Bugsounet

Hello,

First of all, thank you for not stopping your work on this module which is of high quality.

I tried to install the new assistant. I followed the wiki. However, I have a problem.
Indeed, when the mirror is launched, I find myself with the following message:

[2020-06-01 14:04:54.256] [LOG]    [ASSISTANT][ERROR] token.json file not found

However, I followed the WIKI well and applied the following command:

(env) pi@raspberrypi:~/MagicMirror/modules/MMM-GoogleAssistant $ ACCESSTOKEN=ya29.a0AfH6SMABBPj590X_itMQG616F8QpxddhPVuSXCE4qvZs6znHKbG2n5RggszFMdl0V5HP0lf956H9O7VHlbuGuMxSzkU3pMkdbpFxs485NwfXYl9T7hfLzB0EOPlRTwcifZW-8rIUlZlWXXXXXXXXXXXXXXXXXXX

Do you have any idea about this problem?

Thanking you in advance,

Regards,

A Former User

@dvbit try this:
launch it in root directly in RPI terminal (not ssh)

cd ~/MagicMirror
sudo ./node_modules/.bin/electron js/electron.js --no-sandbox

give me result

A Former User

@chris: token.json file must be located in ~/MagicMirror/modules/MMM-GoogleAssistant/token.json

sdetweil

@Bugsounet u can also run the fixsandbox script from my repo
https://github.com/sdetweil/MagicMirror_scripts

if they use my installer I fix it… otherwise they either need the --nosandbox or run my script

A Former User

sam, i suspect a bug in electron

chown root and chmod 4755 ?

sdetweil

@Bugsounet yes, what my script does…

not a bug, new feature

A Former User

yes but i don’t understand why … with pulseaudio there is no sound but with root it’s works …

There is a permission missing somewhere

sdetweil

@Bugsounet sorry, got no idea what the side effects are…

they wanted some additional security

are u launching a player as a background task, or playing direct to the device? if the latter then u get all the security crap

A Former User

sam:

in RPI4: it’s works

pi@Raspberry:~/MagicMirror/node_modules/electron/dist $ ls -la
total 107516
drwxr-xr-x 4 pi   pi     4096 mai   20 15:23 .
drwxr-xr-x 3 pi   pi     4096 juin   1 13:37 ..
-rw-r--r-- 1 pi   pi   145945 mai   20 15:23 chrome_100_percent.pak
-rw-r--r-- 1 pi   pi   209147 mai   20 15:23 chrome_200_percent.pak
-rwsr-xr-x 1 root pi  4204060 mai   20 15:23 chrome-sandbox

i have no idea if @dvbit it’s the same

Note: this Issue take me head since 6 month

sdetweil

@Bugsounet yes, added in V6 of electron (and chrome 45 I think?) we are running 6.1.7

A Former User

pi@Raspberry:~/MagicMirror/node_modules/electron/dist $ ./electron -v
v6.1.12

sdetweil

@Bugsounet weird we call for 6.1.7 or above

"electron": "^6.1.7"

Chris

@Bugsounet

Hello,
Indeed, I did not understand well in WIKI.

If it can be used for others, you must create a token.js file and insert the code:

ACCESSTOKEN=ya29.a0AfH6SMABBPj590X_itMQG616F8QpxddhPVuSXCE4qvZs6znHKbG2n5RggszFMdl0V5HP0lf956H9O7VHlbuGuMxSzkU3pMkdbpFxs485NwfXYl9T7hfLzB0EOPlRTwcifZW-8rIUlZlWXXXXXXXXXXXXXXXXXXX

Now it works perfectly,

Thank you so much,

Regards,

A Former User

but only in 6.x.x branch

actually electron is releasing with v9 ;)

dvbit

@dvbit said in mmm assistant mk2:

Update: I reinstalled from scratch (again for a2d I had to do a npm rebuild, you may want to take note)

Still the same issue of assistant hanging after query:
I do the query, hotword recognized, query recognized, answer fetched, answer saved in temp and displayed on screen bottom but no audio feedback and gogle spin icon going.
After refreshing the screen goes again in “steady state”

Now I am sure I have a sound output issue.
Meaning that I can play sounds on the mirror via vlc but somehow the plugin cannot.
I guess that somehow the plugin does not receive a feedback of “play ended” from the output.
What I also noticed is that if I refresh the browser by vnc the mirror will go again in a waiting status.
Will continue checking

could it be this: https://github.com/raspberrypi/firmware/issues/1243

Edit: Nope - vlc outputs sound

IMPORTANT:
The Install script for the audio output was succesfull just the first time.
on second install I skipped the output part as I could not get through indeed.
However the input was working just fine. recorded my voice and could hear it.

Posting here my asoundrc file

pcm.!default {
  type asym
  playback.pcm {
    type plug
    slave.pcm "output"
  }
  capture.pcm {
    type plug
    slave.pcm "input"
  }
}

pcm.output {
  type hw
  card 0
}

ctl.!default {
  type hw
  card 0

Input is : kinect microphones
Output : TV speakers (directly through TV speakers)

sdetweil

@Bugsounet it also has sandbox…

we just moved up to V6 from V3 on 2.10, some things newer don’t work on pi…

A Former User

@Bugsounet said in mmm assistant mk2:

pi@Raspberry:~/MagicMirror/node_modules/electron/dist $ ls -la
total 107516
drwxr-xr-x 4 pi   pi     4096 mai   20 15:23 .
drwxr-xr-x 3 pi   pi     4096 juin   1 13:37 ..
-rw-r--r-- 1 pi   pi   145945 mai   20 15:23 chrome_100_percent.pak
-rw-r--r-- 1 pi   pi   209147 mai   20 15:23 chrome_200_percent.pak
-rwsr-xr-x 1 root pi  4204060 mai   20 15:23 chrome-sandbox

@dvbit: can you give me your result please ?

dvbit

@Bugsounet said in mmm assistant mk2:

~/MagicMirror/node_modules/electron/dist $ ls -la

pi@MagicMirror:~/MagicMirror $ ~/MagicMirror/node_modules/electron/dist $ ls -la
bash: /home/pi/MagicMirror/node_modules/electron/dist: Is a directory
pi@MagicMirror:~/MagicMirror $ cd ~/MagicMirror/node_modules/electron/dist 
pi@MagicMirror:~/MagicMirror/node_modules/electron/dist $ ls -la
total 107496
drwxr-xr-x 4 pi pi     4096 May 30 12:38 .
drwxr-xr-x 4 pi pi     4096 May 30 12:38 ..
-rw-r--r-- 1 pi pi   145945 May 30 12:38 chrome_100_percent.pak
-rw-r--r-- 1 pi pi   209147 May 30 12:38 chrome_200_percent.pak
-rwxr-xr-x 1 pi pi  4202140 May 30 12:38 chrome-sandbox
-rwxr-xr-x 1 pi pi 74664904 May 30 12:38 electron
-rw-r--r-- 1 pi pi 10410272 May 30 12:38 icudtl.dat
-rwxr-xr-x 1 pi pi   157372 May 30 12:38 libEGL.so
-rwxr-xr-x 1 pi pi  1949660 May 30 12:38 libffmpeg.so
-rwxr-xr-x 1 pi pi  4883208 May 30 12:38 libGLESv2.so
-rw-r--r-- 1 pi pi     1060 May 30 12:38 LICENSE
-rw-r--r-- 1 pi pi  3961766 May 30 12:38 LICENSES.chromium.html
drwxr-xr-x 2 pi pi     4096 May 30 12:38 locales
-rw-r--r-- 1 pi pi    83237 May 30 12:38 natives_blob.bin
drwxr-xr-x 2 pi pi     4096 May 30 12:38 resources
-rw-r--r-- 1 pi pi  8471329 May 30 12:38 resources.pak
-rw-r--r-- 1 pi pi   275792 May 30 12:38 snapshot_blob.bin
-rw-r--r-- 1 pi pi   608820 May 30 12:38 v8_context_snapshot.bin
-rw-r--r-- 1 pi pi        5 May 30 12:38 version

Please look also post above: I realize my asoundrc file may be screwed since I did not complete on second install the sound output wizard successfully

sdetweil

@dvbit run

bash -c "$(curl -sL https://raw.githubusercontent.com/sdetweil/MagicMirror_scripts/master/fixsandbox)"