MMM-Assistantmk2 and MMM-Hotword not picking up

[sdetweil]

@costascontis said in MMM-Assistantmk2 and MMM-Hotword not picking up:

I use the ps3 eye cam mic and its working fine with hotword…

yes, but there are lots of reports of individual mics not working… replace and all is ok…

[bachoo786]

Hi @ejay-ibm

I managed to get assistantmk2 and hotword working and everything is fine. However I will be grateful if you could please help me with the following queries:

1). When i say jarvis or smart mirror, the assistantmk2 module takes 1 to 2 seconds to respond i.e. the ding bell I mean after which I can ask any question. How can I remove this lag and make it instant? I have seen other people dont have this issue.

2). How do I get the assistantmk2 to play youtube videos on my mirror by asking it to play something from youtube?

3). Finally can I change the hotword from “jarvis” to say “ok google”?

Thanks.

This is my config:

{
    module: "MMM-AssistantMk2",
    position: "top_right",
    config: {
      deviceLocation: {
                        coordinates: { // set the latitude and longitude of the device to get localized information like weather or time. (ref. mygeoposition.com)
                        latitude: 51.597442, // -90.0 - +90.0
                        longitude: -0.338839, // -180.0 - +180.0
          }
        },
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      play: { // Full values are in `FOR EXPERTS` section.
              playProgram: "mpg321", // recommended.
      },
      notifications: {
        ASSISTANT_ACTIVATED: "HOTWORD_PAUSE",
        ASSISTANT_DEACTIVATED: "HOTWORD_RESUME",
      },
    }
  },
  {
    module: "MMM-Hotword",
    config: {
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      autostart:true,
      onDetected: {
        notification: function (payload) {
          return "ASSISTANT_ACTIVATE"
        },
        payload: function (payload){
          return {
            profile: payload.hotword
          }
        }
      },
    },
  },

Also you have notifications in your config, what is it for? can you please explain? thanks.

[ejay-ibm]

Hi,

1- I would say first to check you CPU charge first , the delay might be due to the load.
2- just say " Jarvis" … " Micheal jackson smooth criminal" it will play the youtube video clip
3- if you want to say " ok google" you have to add your own umdl or umdp file.

Info and new umd* file can be found and created here :
https://snowboy.kitt.ai/

hope this help .

Ejay

[bachoo786]

@ejay-ibm thanks for the quick reply.

you have notifications in your config, what is it for? can you please explain? thanks.

[ejay-ibm]

@bachoo786
The notification allows to the hotword module to receive instruction from the assistant module by notification to pause or resume itself in the right time.
When assistant 'talk it pause the hotword detection
ASSISTANT_ACTIVATED: “HOTWORD_PAUSE”,
When the assistant is done it restart the hotword detection .
ASSISTANT_DEACTIVATED: “HOTWORD_RESUME”,

Ejay

[AdnanAhmed97]

The hotword module should be called outside the assistant module
Add the brackets correctly and change and change device to plughw : 1;

[bachoo786]

@AdnanAhmed97 what do you mean?

[jmartin1009]

@sdetweil @ejay-ibm well i got a new mic and i tried it out, still no detection for MMM-Hotword. It works for GoogleAssistantMk2 when i click the button on the screen, but no hotword detection. I worried that it may be because of snowboy failing to install properly the first time for some reason, so i went into the module in the console and did npm install and got this:

pi@raspberrypi:~/MagicMirror/modules/MMM-Hotword $ npm install
npm WARN deprecated hoek@2.16.3: This version is no longer maintained. Please upgrade to the latest version.
npm WARN deprecated boom@2.10.1: This version is no longer maintained. Please upgrade to the latest version.
npm WARN deprecated cryptiles@2.0.5: This version is no longer maintained. Please upgrade to the latest version.
npm ERR! path /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm ERR! code EISGIT
npm ERR! git /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy: Appears to be a git repo or submodule.
npm ERR! git     /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm ERR! git Refusing to remove it. Update manually,
npm ERR! git or move it out of the way first.

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/pi/.npm/_logs/2019-03-18T22_16_00_319Z-debug.log

any idea how i can fix this?

[jmartin1009]

@jmartin1009 this is possible it’s saying this because it’s already there, but i wasn’t sure i figured i’d give it another go. Let me know if there’s anything i should change or try, but i know this mic does work, as it shows up in

arecord -l

and it comes up and i can select it in alsamixer and everything, just can’t get hotword to hear me.

[A Former User]

@jmartin1009
rm -rf /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy/.git

Then try again

[raedonlpa]

Hi, why?
When I change the activation word, it doesn’t work for me?,
I want to change it to another word, like alexa, jarvis, etc, and it doesn’t work for me.
I have copied the parameters of @ejay-ibm and nothing.

language: "es",
timeFormat: 24,
units: "metric",

modules: [
	{
		module: "alert",
	},
	{
		module: "updatenotification",
		position: "top_bar"
	},
	{
		module: "clock",
		position: "top_left"
	},
	{
		module: "calendar",
		header: "Calendario",
		position: "top_left",
		config: {
			calendars: [
				{
					symbol: "calendar-check",
					url: "https://www.calendarlabs.com/ical-calendar/ics/70/Spain_Holidays.ics"					
				},
				{
					symbol: "MyCalendar",
					url: "https://calendar.google.com/calendar/ical/............/public/basic.ics"					
				}
			]
		}
	},
	{
		module: "compliments",
		position: "lower_third"
	},
	{
		module: "currentweather",
		position: "top_right",
		config: {
			location: "New York",
			locationID: "",  //ID from http://bulk.openweathermap.org/sample/city.list.json.gz; unzip the gz file and find your city
			appid: "YOUR_OPENWEATHER_API_KEY"
		}
	},
	{
		module: "weatherforecast",
		position: "top_right",
		header: "Weather Forecast",
		config: {
			location: "Arrecife, ES",
			locationID: "2521570",  //ID from http://bulk.openweathermap.org/sample/city.list.json.gz; unzip the gz file and find your city
			appid: "..........................."
		
		}
	},
		{

    		module: 'currentweather',
    		position: 'top_right',
		config: {
		        location: 'Arrecife, es',
		        locationID: '2521570', //ID from bulk.openweather.org/sample/
		        appid:" .............................'',
		        updateInterval: '3600000',
		        onlyTemp: true

		}

	},

		{
		module: "newsfeed",
		position: "bottom_bar",
		config: {
			feeds: [
				{
					title: "Canarias7",
					url: "https://www.canarias7.es/rss/portada.xml"
				}
			],
			showSourceTitle: true,
			showPublishDate: true,
			broadcastNewsFeeds: true,
			broadcastNewsUpdates: true
		}
	},
		{
		module: "MMM-Hotword",
		position: "top_right",
		config: {
			chimeOnFinish: null,
			mic: {
				recordProgram: "arecord",
				device: "plughw:1"
			},
			models: [
				{
					hotwords    : "Smart_mirror",
					file        : "smart_mirror.umdl",
					sensitivity : "0.5",
				},
			],
			commands: {
				"smart_mirror": {
					notificationExec: {
						notification: "ASSISTANT_ACTIVATE",
						payload: (detected, afterRecord) => {
							return {profile:"default"}
						}
					},
					restart:false,
					afterRecordLimit:0
				}
			}
		}
	},
	{
		module: "MMM-AssistantMk2",
		position: "top_right",
		config: {
			deviceLocation: {
				coordinates: {
					latitude: 28.969593, // -90.0 - +90.0
					longitude: -13.556344, // -180.0 - +180.0
				},
			},
			record: {
				recordProgram : "arecord",  
				device        : "plughw:1",
			},
			notifications: {
				ASSISTANT_ACTIVATED: "HOTWORD_PAUSE",
				ASSISTANT_DEACTIVATED: "HOTWORD_RESUME",
			},
			useWelcomeMessage: "brief today",
			profiles: {
				"default" : {
					lang: "es-ES"
				}
			},
		}
	},
]

};

[sdetweil]

@raedonlpa can u edit your post, and put three back-tics (shifted, left of 1) before the 1st line, and after the last line.

[raedonlpa]

@sdetweil Better this way, I’m sorry I use google traslator

[sdetweil]

@raedonlpa yes, much better… thank you … you missed one close brace }; at the end, inside the backtics

[raedonlpa]

@sdetweil I know, don’t let me put it in the forum

[sdetweil]

@raedonlpa it was only on the edit of the forum post…

[raedonlpa]

@sdetweil said in MMM-Assistantmk2 and MMM-Hotword not picking up:

it was only on the edit of the forum post…

Do you mean the end of everything?

[sdetweil]

@raedonlpa

this

};

is hanging out after the closing backtics… in your edited post

[raedonlpa]

yes, I get spawn error

[sdetweil]

@raedonlpa sorry, spawn error??

I was just trying to clean up the forum messages so that others with knowledge about the two modules can help you…

it was very hard to read the config.js info in the original posting.

the changes I mentioned should NOT be put into the actual config.js file.