MMM-AssistantMk2

Cr4z33

@Sean thank you.

The steps (suggested by @Sean) to fix the black screen issue after latest MagicMirror update are:

cd ~/MagicMirror/modules/MMM-AssistantMk2
npm install --save-dev electron-rebuild
./node_modules/.bin/electron-rebuild

and if you use MMM-Hotword too

cd ~/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm install --save-dev electron-rebuild
npm install nan
./node_modules/.bin/electron-rebuild

bryan_1

@Sean after MM latest update found youtube video is not played automatically. It is only shown. I ran npm start dev and get this error: Failed to execute ‘postMessage’ on ‘DOMWindow’: The target origin provided (‘https://www.youtube.com’) does not match the recipient window’s origin (‘http://0.0.0.0:8080’). Do you have any idea? Thanks in advance.

sdetweil

there is a limitation on the version of electron used… they have prevented autoplay of media (video , and audio)
if there is not a user interaction with the window content in advance… (and with a mirror, we don’t click etc)

anyhow… there is a work around in the shorterm

edit MagicMirror/js/electron.js

after line

function createWindow() {

add

    app.commandLine.appendSwitch('autoplay-policy', 'no-user-gesture-required');  //< -------- added

save and restart MM

bryan_1

@sdetweil I’ll try it tonight. Thank you.

bryan_1

@sdetweil it works, thank you.

DopeEthiop

Hey guys, I’m having a problem with my MMM-AssistantMk2 and possibly my MMM-Hotword. I have a Raspberry Pi3 and I’m using a usb mic for recording.

I have both of the modules up and running but when asking Jarvis a question it takes about 7 seconds before I get any response. Then when I do get a response, the transcription is quick and hurried, while the text on the bottom of the screen disappears quickly. I was wondering if there was a way to optimize this through the config file or if this was something different?

A Former User

@DopeEthiop
Your issue always and only happens when you say “jarvis”? or all the same with other hotwords?
Sometimes the time lag could happen, but your case seems something wrong. Leave your issue to git repository issue board to look inside more deeply. here is not so good place to track issue.

dxfan227

Hello

I have both mmm assistantmk2 and hot word up and running however when I saw jarvis the first time it works…but then when I try again…no hot word picked up. any ideas?

bibi

Hello all, was just wondering if and how difficult it would be possible to add a kinda face animation in Mk2? I have seen Hello-Lucy and i found the idea cool but the face is kind of creepy :grinning_face_with_smiling_eyes:

Mykle1

@bibi

Take a look at this module. It displays animated faces of sorts.

https://forum.magicmirror.builders/topic/9963/mmm-ai.

Or, if you have an animated gif that suits you, you can use just about any image module to display it.

Davido

@dxfan227

have you found a solution?

if not, please attach your config

dxfan227

@Davido

Thanks, i did find a solution. For some reason the HOTWORD RESUME notification was not working. I had to “hard code” it into the .js file itself for the module. It is now working.

dxfan227

Is there a way to unlink this from my personal google account info?

Ie when I ask to show me photos of dogs…it actually goes through MY google photos account and shows photos of my dog.

Cr4z33

@Sean can you tell us please anything about what’s coming with versione 3? :smiling_face_with_halo:

A Former User

@Cr4z33
Well, now it is on development and not ready to release so details could be changed.
But it might have these features;

No need to wait after hotword. You could say “mirror, blahblah” instead “mirror (pause and wait activation) blahblah.”
Some annoying dependency would be removed. HTML5 default audio output would be used, so you don’t be bothered by sound output configuration. If your web browser can play some audio, it would be enough
Installer will be provided.
Recorded wav file by user or other module could be used for your query. (So User can query via 3 ways - text, real-time vocal query, pre-recorded vocal query)
Annoying center region issue would be gone.
ScreenOutput would be more controllable (duration time, size, activation inner links, suggested commands, …)
- The core informations of screenOutput would be extracted for later using. (e.g: external link to open a broswer for getting additional information. it could be transferable to other module for later using.)
Creating and managing custom action would be easier.
- So I’m considering to remove transcriptionHook trick to use action instead.
- I served transcriptionHook for making simple voice command, but that is not a natural way to use Google Assistant. In many cases, Ppl tried to make commands which are not related with google assistant directly. Rather those kinds of commands could be achieved by just simple voice detection without AI. So I now add that feature to MMM-Hotword and being condering to drop out from MMM-AssistantMk2
YouTube features will be removed. (And Spotify also)
- Instead, YouTube, Spotify, Web Browsing, Map Direcions, Image search would be separated as independent module. those modules will use the info which is extracted from result of query. Of course, each module could be used standalone without AMK2. I’ll make it one-by-one. (Or whoever has interests could)

Cr4z33

@Sean wow that’s a BIG change in the module! 😲

Can’t wait to start trying it out mate to use all the good stuff you are adding in it.

Thanks for letting us know and have a nice Sunday. 😁

saljoke

Wonderful. I want to try these changes!!!

smarthome

Hello
How can I stop Assistant’s response and make request again like Google Home Speaker can ?

smarthome

This is my config, still don’t work yet

{
    module: "MMM-AssistantMk2",
    .....

      notifications: {
    ...
        ASSISTANT_UNDERSTOOD: "HOTWORD_RESUME",
      },
    }
  },
  {
  module: "MMM-Hotword",
  ...
    models: [
     ...
      {
        hotwords    : "stop",
        file        : "stop.pmdl",
        sensitivity : "0.5",
      },
    ],
    command: {
     ...
      "stop":{
      notificationExec: {
        notification: "ASSISTANT_CLEAR",
        payload: (detected, afterRecord) => {
          return {profile:"default"}
        }
      },
      afterRecordLimit:0,
      restart:false,
    },
  },
},

A Former User

@smarthome Sorry, at this moment, there is no way to interrupt response. Just wait ends.