MMM-AssistantMk2



    1. Start Create Project, what option to choose, is it for Home control ?
    2. During the process of register a device model, What to choose in Device Type?

  • Module Developer

    @sun

    1. You can skip that part or select whatever you want.
    2. That is also whatever you want. Usually, I set as “TV”. (because it definitely has screen to display something)


  • Finally, Got the microphone icon in my mirror. Didn’t detect the voice yet I still have to install mmm-hotword.
    But I can ask one question by click the microphone icon and see the pop-up.

    I use hdmi on my tv as well. Still no sound.

    I will install mmm-hotword and test.

    Also the mmm-gaction if it make the mirror better.

    I will keep you update and might need your help if I got struck in some part.

    Thank you very much Mr.Sean.



  • Install mmm-hotword everything went fine during installation and load magic mirror normally. But no hotword detected.

    also show in command promt.

    Refreshed access token because it has expired. Expired at: 18:57:26 now is: 18:57:29
    Refreshed access token because it has expired. Expired at: 19:57:29 now is: 18:57:29
    Refreshed access token because it has expired. Expired at: 19:57:29 now is: 18:57:29
    Refreshed access token because it has expired. Expired at: 19:57:29 now is: 18:57:30

    and when click the microphone icon. I can only click once after restart and ask question. Hotword didn’t detect smart mirror, snowboy.

    in command promt shows
    at Speaker._write (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/speaker/index.js:183:23)
    at doWrite (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:428:64)
    at writeOrBuffer (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:417:5)
    at Speaker.Writable.write (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:334:11)
    at Conversation.conversation.on (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:75:16)
    at emitOne (events.js:116:13)
    at Conversation.emit (events.js:211:7)
    at ClientDuplexStream.Conversation.conversation.on (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/google-assistant/components/conversation.js:154:12)
    at emitOne (events.js:116:13)
    Conversation Completed
    [HOTWORD] << snowboy >> is detected.
    [HOTWORD] stops listening


  • Module Developer

    @sun
    have you removed or refreshed your credentials.json or default.json in MMM-AssistantMk2?

    I suggest you remove or disable all other modules (including MMM-AssistantMk2) except MMM-Hotword in config.js and test it.

    Definitely success with MMM-Hotword could make things simple and easy.

    After removing all modules except MMM-Hotword in config.js, run MM.(npm start)
    You can see;
    [HOTWORD] begins listening
    say smart mirror
    You can see;

    [HOTWORD] << smart mirror >> is detected.
    [HOTWORD] stop listening
    

    You should confirm this before going forward.


  • Module Developer

    @sun
    OK. have you installed “MMM-NotificationTrigger” ?
    Or give me a chat in this forum, or telegram me (@eouia)



  • Not yet install mmm-notificationtrigger.
    Do I have to install mmm-notificationtrigger as well?
    I manage to get
    [HOTWORD] << smart mirror >> is detected.
    [HOTWORD] stop listening

    but when I say something. it won’t detect what I said. Only detect the hotword.



  • Got it done. Very nice. However, the sound is so lag. Might be because I run on rp3 and quite many modules in magic mirror.


  • Module Developer

    @sun
    Maybe. I always use BT speaker for my RPI and ATB. I cannot bear the crumpled sounds from analog or USB.



  • This is fantastic thank you, I have got everything set up, it hears and responds (on screen) to every request - but unfortunately I get no sound (no speaking feedback), when a youtube video plays, the sound works fine, do I need to change the output device somewhere? I’m struggling to find the config for it.