MMM-AssistantMk2

ejay-ibm

@Sean @teitlebot
Might sound stupid and not feasible at first but this is how I would do the trick.
1st I would use a Notification from input ( camera , pir sensor)
for PIR sensor it would be PRESENCE_DETECTED .
Then I would trigger a command and in this command use the repeat after me function .
So you can get voice output directly from the assistant saying “hello” when presence is detected .
Then for facial recognition it’s just a matter of condition and what notification to send. for each notification a different repat after me.

Does it make sense?

Ejay

A Former User

@ejay-ibm @teitlebot
Maybe possible.
Converting PRESENCE_DETECTED to ASSISTANT_SAY with some payload(“Good morning sir”) could be. you can modify PIR module itself or use MMM-NotificationTrigger instead.

bryan_1

@Sean unfortunately it doesn’t help. I wonder, why only this SHOWMODULES doesn’t work but all other recipes do (include HIDEMODULES) :pensive_face:

teitlebot

@Sean @ejay-ibm
so if I can use assistant_say why would I need to install TTS?

A Former User

@teitlebot
Assistant_say is a kind of hack. It cannot be guaranteed to work properly at every case. And not for long text.

A Former User

@bryan_1
Log is needed to figure out what happens. Furthermore for tracing and checking suspicious points, source modifying is needed.
You can contact me on Telegram (ID : @eouia). If you don’t mind, I can help on the telegram when I’m not busy.

Cr4z33

@Sean please check Telegram as I sent you a message with the error I am getting after MM latest update. ;)

A Former User

@Cr4z33
You need electron-rebuild for module. MichMich change electron version in new update. so, new module binary for electron is needed.

Cr4z33

@Sean thank you.

The steps (suggested by @Sean) to fix the black screen issue after latest MagicMirror update are:

cd ~/MagicMirror/modules/MMM-AssistantMk2
npm install --save-dev electron-rebuild
./node_modules/.bin/electron-rebuild

and if you use MMM-Hotword too

cd ~/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm install --save-dev electron-rebuild
npm install nan
./node_modules/.bin/electron-rebuild

bryan_1

@Sean after MM latest update found youtube video is not played automatically. It is only shown. I ran npm start dev and get this error: Failed to execute ‘postMessage’ on ‘DOMWindow’: The target origin provided (‘https://www.youtube.com’) does not match the recipient window’s origin (‘http://0.0.0.0:8080’). Do you have any idea? Thanks in advance.

sdetweil

there is a limitation on the version of electron used… they have prevented autoplay of media (video , and audio)
if there is not a user interaction with the window content in advance… (and with a mirror, we don’t click etc)

anyhow… there is a work around in the shorterm

edit MagicMirror/js/electron.js

after line

function createWindow() {

add

    app.commandLine.appendSwitch('autoplay-policy', 'no-user-gesture-required');  //< -------- added

save and restart MM

bryan_1

@sdetweil I’ll try it tonight. Thank you.

bryan_1

@sdetweil it works, thank you.

DopeEthiop

Hey guys, I’m having a problem with my MMM-AssistantMk2 and possibly my MMM-Hotword. I have a Raspberry Pi3 and I’m using a usb mic for recording.

I have both of the modules up and running but when asking Jarvis a question it takes about 7 seconds before I get any response. Then when I do get a response, the transcription is quick and hurried, while the text on the bottom of the screen disappears quickly. I was wondering if there was a way to optimize this through the config file or if this was something different?

A Former User

@DopeEthiop
Your issue always and only happens when you say “jarvis”? or all the same with other hotwords?
Sometimes the time lag could happen, but your case seems something wrong. Leave your issue to git repository issue board to look inside more deeply. here is not so good place to track issue.

dxfan227

Hello

I have both mmm assistantmk2 and hot word up and running however when I saw jarvis the first time it works…but then when I try again…no hot word picked up. any ideas?

bibi

Hello all, was just wondering if and how difficult it would be possible to add a kinda face animation in Mk2? I have seen Hello-Lucy and i found the idea cool but the face is kind of creepy :grinning_face_with_smiling_eyes:

Mykle1

@bibi

Take a look at this module. It displays animated faces of sorts.

https://forum.magicmirror.builders/topic/9963/mmm-ai.

Or, if you have an animated gif that suits you, you can use just about any image module to display it.

Davido

@dxfan227

have you found a solution?

if not, please attach your config

dxfan227

@Davido

Thanks, i did find a solution. For some reason the HOTWORD RESUME notification was not working. I had to “hard code” it into the .js file itself for the module. It is now working.