MMM-Assistantmk2 and MMM-Hotword not picking up

[ejay-ibm]

Hello,
I agree with Sam :
You need to remove the space at both places.
1st in MMM-AssistantMk2

module: "MMM-AssistantMk2",
		    position: "top_bar",
		    config: {
		      record: {
		        recordProgram : "arecord",  
		        device        : "plughw:1,0",

And as well in

module: "MMM-Hotword",
		    config: {
		      record: {
		        recordProgram : "arecord", 
		        device        : "plughw:1,0",

If that still doesn’t work try just :
plughw:1

As well you should check in the audio properties that your mic have enough gain.

you can check this by typing
alsamixer
in command line

hope this helps

Ejay

[jmartin1009]

@ejay-ibm @sdetweil what should I have in the module list in the config.js for the magicmirror program for each module? Not sure if I have the right stuff or too much or what

[jmartin1009]

@ejay-ibm also is there anyway to change the gain or whatever? I went to alsamixer and went to the capture section and the bar doesn’t move or anything when I speak into my mic. Not sure if anything is supposed to happen but it says both L and R capture are the 100, not sure what that means.

[jmartin1009]

@ejay-ibm I also changed it so the sauce wasn’t there and I made it so it said plughw:1 in all of them, but still nothing

[ejay-ibm]

This is my MMM-Hotword config.js part :

{
      module: "MMM-Hotword",
      config: {
        snowboy: [
          /*	{
						"hotwords": "smartmirror",
						"file": "resources/models/smart_mirror.umdl",
						"sensitivity": "0.5"
					},

*/
          {
            hotwords: "alexa",
            file: "resources/models/alexa.umdl",
            sensitivity: "0.6"
          },

          {
            file: "resources/models/jarvis.umdl",
            sensitivity: "0.6,0.60",
            hotwords: ["jarvis", "jarvis"]
          }
        ],
        record: {
          sampleRate: 16000,
          threshold: 0.5,
          thresholdStart: null,
          thresholdEnd: null,
          silence: 1,
          verbose: false,
          recordProgram: "arecord",
          device: "plughw:1"
        },
        autostart: true,
        autorestart: true,
        notifications: {
          PAUSE: "HOTWORD_PAUSE",
          RESUME: "HOTWORD_RESUME",
          LISTENING: "HOTWORD_LISTENING",
          SLEEPING: "HOTWORD_SLEEPING",
          ERROR: "HOTWORD_ERROR"
        },
        onDetected: {
          notification: function(payload) {
            return "ASSISTANT_ACTIVATE";
          },
          payload: function(payload) {
            return {
              profile: payload.hotword
            };
          }
        }
      }
    },

You can give it a try .

Ejay

[sdetweil]

@jmartin1009 but, that explains no response from the modules!

[jmartin1009]

@ejay-ibm that is for the MM config.js right? Or is that what you have in the MMM-Hotword.js config file?

[jmartin1009]

@sdetweil What explains no response from the modules? My mic’s gain in alsamixer? if so how can i fix that? Or should i just get a new mic

[sdetweil]

@jmartin1009 i would get a new mic… clearly this one is having issues… is that the array?

[jmartin1009]

@sdetweil yeah it’s the PS3 eye camera microphone, it has a 4 microphone array that alsamixer hates lol

[costascontis]

I use the ps3 eye cam mic and its working fine with hotword…

[ejay-ibm]

install audacity and give a quick test to your mic.
you will know if you mic is dead

sudo apt-get install audacity

[sdetweil]

@costascontis said in MMM-Assistantmk2 and MMM-Hotword not picking up:

I use the ps3 eye cam mic and its working fine with hotword…

yes, but there are lots of reports of individual mics not working… replace and all is ok…

[bachoo786]

Hi @ejay-ibm

I managed to get assistantmk2 and hotword working and everything is fine. However I will be grateful if you could please help me with the following queries:

1). When i say jarvis or smart mirror, the assistantmk2 module takes 1 to 2 seconds to respond i.e. the ding bell I mean after which I can ask any question. How can I remove this lag and make it instant? I have seen other people dont have this issue.

2). How do I get the assistantmk2 to play youtube videos on my mirror by asking it to play something from youtube?

3). Finally can I change the hotword from “jarvis” to say “ok google”?

Thanks.

This is my config:

{
    module: "MMM-AssistantMk2",
    position: "top_right",
    config: {
      deviceLocation: {
                        coordinates: { // set the latitude and longitude of the device to get localized information like weather or time. (ref. mygeoposition.com)
                        latitude: 51.597442, // -90.0 - +90.0
                        longitude: -0.338839, // -180.0 - +180.0
          }
        },
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      play: { // Full values are in `FOR EXPERTS` section.
              playProgram: "mpg321", // recommended.
      },
      notifications: {
        ASSISTANT_ACTIVATED: "HOTWORD_PAUSE",
        ASSISTANT_DEACTIVATED: "HOTWORD_RESUME",
      },
    }
  },
  {
    module: "MMM-Hotword",
    config: {
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      autostart:true,
      onDetected: {
        notification: function (payload) {
          return "ASSISTANT_ACTIVATE"
        },
        payload: function (payload){
          return {
            profile: payload.hotword
          }
        }
      },
    },
  },

Also you have notifications in your config, what is it for? can you please explain? thanks.

[ejay-ibm]

Hi,

1- I would say first to check you CPU charge first , the delay might be due to the load.
2- just say " Jarvis" … " Micheal jackson smooth criminal" it will play the youtube video clip
3- if you want to say " ok google" you have to add your own umdl or umdp file.

Info and new umd* file can be found and created here :
https://snowboy.kitt.ai/

hope this help .

Ejay

[bachoo786]

@ejay-ibm thanks for the quick reply.

you have notifications in your config, what is it for? can you please explain? thanks.

[ejay-ibm]

@bachoo786
The notification allows to the hotword module to receive instruction from the assistant module by notification to pause or resume itself in the right time.
When assistant 'talk it pause the hotword detection
ASSISTANT_ACTIVATED: “HOTWORD_PAUSE”,
When the assistant is done it restart the hotword detection .
ASSISTANT_DEACTIVATED: “HOTWORD_RESUME”,

Ejay

[AdnanAhmed97]

The hotword module should be called outside the assistant module
Add the brackets correctly and change and change device to plughw : 1;

[bachoo786]

@AdnanAhmed97 what do you mean?

[jmartin1009]

@sdetweil @ejay-ibm well i got a new mic and i tried it out, still no detection for MMM-Hotword. It works for GoogleAssistantMk2 when i click the button on the screen, but no hotword detection. I worried that it may be because of snowboy failing to install properly the first time for some reason, so i went into the module in the console and did npm install and got this:

pi@raspberrypi:~/MagicMirror/modules/MMM-Hotword $ npm install
npm WARN deprecated hoek@2.16.3: This version is no longer maintained. Please upgrade to the latest version.
npm WARN deprecated boom@2.10.1: This version is no longer maintained. Please upgrade to the latest version.
npm WARN deprecated cryptiles@2.0.5: This version is no longer maintained. Please upgrade to the latest version.
npm ERR! path /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm ERR! code EISGIT
npm ERR! git /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy: Appears to be a git repo or submodule.
npm ERR! git     /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm ERR! git Refusing to remove it. Update manually,
npm ERR! git or move it out of the way first.

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/pi/.npm/_logs/2019-03-18T22_16_00_319Z-debug.log

any idea how i can fix this?