MMM-Assistantmk2 and MMM-Hotword not picking up

jmartin1009

@sdetweil is that your config for magicmirror or in the config file or hotword?

jmartin1009

@sdetweil I tried getting rid of the space, I tried adding autorestart=true on both configs, and still no luck :/

sdetweil

@jmartin1009 just the config for hotword.

ejay-ibm

Hello,
I agree with Sam :
You need to remove the space at both places.
1st in MMM-AssistantMk2

module: "MMM-AssistantMk2",
		    position: "top_bar",
		    config: {
		      record: {
		        recordProgram : "arecord",  
		        device        : "plughw:1,0",

And as well in

module: "MMM-Hotword",
		    config: {
		      record: {
		        recordProgram : "arecord", 
		        device        : "plughw:1,0",

If that still doesn’t work try just :
plughw:1

As well you should check in the audio properties that your mic have enough gain.

you can check this by typing
alsamixer
in command line

hope this helps

Ejay

jmartin1009

@ejay-ibm @sdetweil what should I have in the module list in the config.js for the magicmirror program for each module? Not sure if I have the right stuff or too much or what

jmartin1009

@ejay-ibm also is there anyway to change the gain or whatever? I went to alsamixer and went to the capture section and the bar doesn’t move or anything when I speak into my mic. Not sure if anything is supposed to happen but it says both L and R capture are the 100, not sure what that means.

jmartin1009

@ejay-ibm I also changed it so the sauce wasn’t there and I made it so it said plughw:1 in all of them, but still nothing

ejay-ibm

This is my MMM-Hotword config.js part :

{
      module: "MMM-Hotword",
      config: {
        snowboy: [
          /*	{
						"hotwords": "smartmirror",
						"file": "resources/models/smart_mirror.umdl",
						"sensitivity": "0.5"
					},

*/
          {
            hotwords: "alexa",
            file: "resources/models/alexa.umdl",
            sensitivity: "0.6"
          },

          {
            file: "resources/models/jarvis.umdl",
            sensitivity: "0.6,0.60",
            hotwords: ["jarvis", "jarvis"]
          }
        ],
        record: {
          sampleRate: 16000,
          threshold: 0.5,
          thresholdStart: null,
          thresholdEnd: null,
          silence: 1,
          verbose: false,
          recordProgram: "arecord",
          device: "plughw:1"
        },
        autostart: true,
        autorestart: true,
        notifications: {
          PAUSE: "HOTWORD_PAUSE",
          RESUME: "HOTWORD_RESUME",
          LISTENING: "HOTWORD_LISTENING",
          SLEEPING: "HOTWORD_SLEEPING",
          ERROR: "HOTWORD_ERROR"
        },
        onDetected: {
          notification: function(payload) {
            return "ASSISTANT_ACTIVATE";
          },
          payload: function(payload) {
            return {
              profile: payload.hotword
            };
          }
        }
      }
    },

You can give it a try .

Ejay

sdetweil

@jmartin1009 but, that explains no response from the modules!

jmartin1009

@ejay-ibm that is for the MM config.js right? Or is that what you have in the MMM-Hotword.js config file?

jmartin1009

@sdetweil What explains no response from the modules? My mic’s gain in alsamixer? if so how can i fix that? Or should i just get a new mic

sdetweil

@jmartin1009 i would get a new mic… clearly this one is having issues… is that the array?

jmartin1009

@sdetweil yeah it’s the PS3 eye camera microphone, it has a 4 microphone array that alsamixer hates lol

costascontis

I use the ps3 eye cam mic and its working fine with hotword…

ejay-ibm

install audacity and give a quick test to your mic.
you will know if you mic is dead

sudo apt-get install audacity

sdetweil

@costascontis said in MMM-Assistantmk2 and MMM-Hotword not picking up:

I use the ps3 eye cam mic and its working fine with hotword…

yes, but there are lots of reports of individual mics not working… replace and all is ok…

bachoo786

Hi @ejay-ibm

I managed to get assistantmk2 and hotword working and everything is fine. However I will be grateful if you could please help me with the following queries:

1). When i say jarvis or smart mirror, the assistantmk2 module takes 1 to 2 seconds to respond i.e. the ding bell I mean after which I can ask any question. How can I remove this lag and make it instant? I have seen other people dont have this issue.

2). How do I get the assistantmk2 to play youtube videos on my mirror by asking it to play something from youtube?

3). Finally can I change the hotword from “jarvis” to say “ok google”?

Thanks.

This is my config:

{
    module: "MMM-AssistantMk2",
    position: "top_right",
    config: {
      deviceLocation: {
                        coordinates: { // set the latitude and longitude of the device to get localized information like weather or time. (ref. mygeoposition.com)
                        latitude: 51.597442, // -90.0 - +90.0
                        longitude: -0.338839, // -180.0 - +180.0
          }
        },
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      play: { // Full values are in `FOR EXPERTS` section.
              playProgram: "mpg321", // recommended.
      },
      notifications: {
        ASSISTANT_ACTIVATED: "HOTWORD_PAUSE",
        ASSISTANT_DEACTIVATED: "HOTWORD_RESUME",
      },
    }
  },
  {
    module: "MMM-Hotword",
    config: {
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      autostart:true,
      onDetected: {
        notification: function (payload) {
          return "ASSISTANT_ACTIVATE"
        },
        payload: function (payload){
          return {
            profile: payload.hotword
          }
        }
      },
    },
  },

Also you have notifications in your config, what is it for? can you please explain? thanks.

ejay-ibm

Hi,

1- I would say first to check you CPU charge first , the delay might be due to the load.
2- just say " Jarvis" … " Micheal jackson smooth criminal" it will play the youtube video clip
3- if you want to say " ok google" you have to add your own umdl or umdp file.

Info and new umd* file can be found and created here :
https://snowboy.kitt.ai/

hope this help .

Ejay

bachoo786

@ejay-ibm thanks for the quick reply.

you have notifications in your config, what is it for? can you please explain? thanks.

ejay-ibm

@bachoo786
The notification allows to the hotword module to receive instruction from the assistant module by notification to pause or resume itself in the right time.
When assistant 'talk it pause the hotword detection
ASSISTANT_ACTIVATED: “HOTWORD_PAUSE”,
When the assistant is done it restart the hotword detection .
ASSISTANT_DEACTIVATED: “HOTWORD_RESUME”,

Ejay