MMM-AssistantMk2

Sun

Start Create Project, what option to choose, is it for Home control ?
During the process of register a device model, What to choose in Device Type?

You can skip that part or select whatever you want.
That is also whatever you want. Usually, I set as “TV”. (because it definitely has screen to display something)

Sun

Finally, Got the microphone icon in my mirror. Didn’t detect the voice yet I still have to install mmm-hotword.
But I can ask one question by click the microphone icon and see the pop-up.

I use hdmi on my tv as well. Still no sound.

I will install mmm-hotword and test.

Also the mmm-gaction if it make the mirror better.

I will keep you update and might need your help if I got struck in some part.

Thank you very much Mr.Sean.

Sun

Install mmm-hotword everything went fine during installation and load magic mirror normally. But no hotword detected.

also show in command promt.

Refreshed access token because it has expired. Expired at: 18:57:26 now is: 18:57:29
Refreshed access token because it has expired. Expired at: 19:57:29 now is: 18:57:29
Refreshed access token because it has expired. Expired at: 19:57:29 now is: 18:57:29
Refreshed access token because it has expired. Expired at: 19:57:29 now is: 18:57:30

and when click the microphone icon. I can only click once after restart and ask question. Hotword didn’t detect smart mirror, snowboy.

in command promt shows
at Speaker._write (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/speaker/index.js:183:23)
at doWrite (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:428:64)
at writeOrBuffer (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:417:5)
at Speaker.Writable.write (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:334:11)
at Conversation.conversation.on (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:75:16)
at emitOne (events.js:116:13)
at Conversation.emit (events.js:211:7)
at ClientDuplexStream.Conversation.conversation.on (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/google-assistant/components/conversation.js:154:12)
at emitOne (events.js:116:13)
Conversation Completed
[HOTWORD] << snowboy >> is detected.
[HOTWORD] stops listening

@sun
have you removed or refreshed your credentials.json or default.json in MMM-AssistantMk2?

I suggest you remove or disable all other modules (including MMM-AssistantMk2) except MMM-Hotword in config.js and test it.

Definitely success with MMM-Hotword could make things simple and easy.

After removing all modules except MMM-Hotword in config.js, run MM.(npm start)
You can see;
[HOTWORD] begins listening
say smart mirror
You can see;

[HOTWORD] << smart mirror >> is detected.
[HOTWORD] stop listening

You should confirm this before going forward.

@sun
OK. have you installed “MMM-NotificationTrigger” ?
Or give me a chat in this forum, or telegram me (@eouia)

Sun

Not yet install mmm-notificationtrigger.
Do I have to install mmm-notificationtrigger as well?
I manage to get
[HOTWORD] << smart mirror >> is detected.
[HOTWORD] stop listening

but when I say something. it won’t detect what I said. Only detect the hotword.

Sun

Got it done. Very nice. However, the sound is so lag. Might be because I run on rp3 and quite many modules in magic mirror.

@sun
Maybe. I always use BT speaker for my RPI and ATB. I cannot bear the crumpled sounds from analog or USB.

jomwells

This is fantastic thank you, I have got everything set up, it hears and responds (on screen) to every request - but unfortunately I get no sound (no speaking feedback), when a youtube video plays, the sound works fine, do I need to change the output device somewhere? I’m struggling to find the config for it.