MMM-Assistantmk2 and MMM-Hotword not picking up

bachoo786

I managed to get assistantmk2 and hotword working and everything is fine. However I will be grateful if you could please help me with the following queries:

1). When i say jarvis or smart mirror, the assistantmk2 module takes 1 to 2 seconds to respond i.e. the ding bell I mean after which I can ask any question. How can I remove this lag and make it instant? I have seen other people dont have this issue.

2). How do I get the assistantmk2 to play youtube videos on my mirror by asking it to play something from youtube?

3). Finally can I change the hotword from “jarvis” to say “ok google”?

Thanks.

This is my config:

{
    module: "MMM-AssistantMk2",
    position: "top_right",
    config: {
      deviceLocation: {
                        coordinates: { // set the latitude and longitude of the device to get localized information like weather or time. (ref. mygeoposition.com)
                        latitude: 51.597442, // -90.0 - +90.0
                        longitude: -0.338839, // -180.0 - +180.0
          }
        },
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      play: { // Full values are in `FOR EXPERTS` section.
              playProgram: "mpg321", // recommended.
      },
      notifications: {
        ASSISTANT_ACTIVATED: "HOTWORD_PAUSE",
        ASSISTANT_DEACTIVATED: "HOTWORD_RESUME",
      },
    }
  },
  {
    module: "MMM-Hotword",
    config: {
      record: {
        recordProgram : "arecord",
        device        : "default",
      },
      autostart:true,
      onDetected: {
        notification: function (payload) {
          return "ASSISTANT_ACTIVATE"
        },
        payload: function (payload){
          return {
            profile: payload.hotword
          }
        }
      },
    },
  },

Also you have notifications in your config, what is it for? can you please explain? thanks.

ejay-ibm

Hi,

1- I would say first to check you CPU charge first , the delay might be due to the load.
2- just say " Jarvis" … " Micheal jackson smooth criminal" it will play the youtube video clip
3- if you want to say " ok google" you have to add your own umdl or umdp file.

Info and new umd* file can be found and created here :
https://snowboy.kitt.ai/

hope this help .

Ejay

bachoo786

@ejay-ibm thanks for the quick reply.

you have notifications in your config, what is it for? can you please explain? thanks.

ejay-ibm

@bachoo786
The notification allows to the hotword module to receive instruction from the assistant module by notification to pause or resume itself in the right time.
When assistant 'talk it pause the hotword detection
ASSISTANT_ACTIVATED: “HOTWORD_PAUSE”,
When the assistant is done it restart the hotword detection .
ASSISTANT_DEACTIVATED: “HOTWORD_RESUME”,

Ejay

AdnanAhmed97

The hotword module should be called outside the assistant module
Add the brackets correctly and change and change device to plughw : 1;

bachoo786

@AdnanAhmed97 what do you mean?

jmartin1009

@sdetweil @ejay-ibm well i got a new mic and i tried it out, still no detection for MMM-Hotword. It works for GoogleAssistantMk2 when i click the button on the screen, but no hotword detection. I worried that it may be because of snowboy failing to install properly the first time for some reason, so i went into the module in the console and did npm install and got this:

pi@raspberrypi:~/MagicMirror/modules/MMM-Hotword $ npm install
npm WARN deprecated hoek@2.16.3: This version is no longer maintained. Please upgrade to the latest version.
npm WARN deprecated boom@2.10.1: This version is no longer maintained. Please upgrade to the latest version.
npm WARN deprecated cryptiles@2.0.5: This version is no longer maintained. Please upgrade to the latest version.
npm ERR! path /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm ERR! code EISGIT
npm ERR! git /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy: Appears to be a git repo or submodule.
npm ERR! git     /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy
npm ERR! git Refusing to remove it. Update manually,
npm ERR! git or move it out of the way first.

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/pi/.npm/_logs/2019-03-18T22_16_00_319Z-debug.log

any idea how i can fix this?

jmartin1009

@jmartin1009 this is possible it’s saying this because it’s already there, but i wasn’t sure i figured i’d give it another go. Let me know if there’s anything i should change or try, but i know this mic does work, as it shows up in

arecord -l

and it comes up and i can select it in alsamixer and everything, just can’t get hotword to hear me.

A Former User

@jmartin1009
rm -rf /home/pi/MagicMirror/modules/MMM-Hotword/node_modules/snowboy/.git

Then try again

raedonlpa

Hi, why?
When I change the activation word, it doesn’t work for me?,
I want to change it to another word, like alexa, jarvis, etc, and it doesn’t work for me.
I have copied the parameters of @ejay-ibm and nothing.

language: "es",
timeFormat: 24,
units: "metric",

modules: [
	{
		module: "alert",
	},
	{
		module: "updatenotification",
		position: "top_bar"
	},
	{
		module: "clock",
		position: "top_left"
	},
	{
		module: "calendar",
		header: "Calendario",
		position: "top_left",
		config: {
			calendars: [
				{
					symbol: "calendar-check",
					url: "https://www.calendarlabs.com/ical-calendar/ics/70/Spain_Holidays.ics"					
				},
				{
					symbol: "MyCalendar",
					url: "https://calendar.google.com/calendar/ical/............/public/basic.ics"					
				}
			]
		}
	},
	{
		module: "compliments",
		position: "lower_third"
	},
	{
		module: "currentweather",
		position: "top_right",
		config: {
			location: "New York",
			locationID: "",  //ID from http://bulk.openweathermap.org/sample/city.list.json.gz; unzip the gz file and find your city
			appid: "YOUR_OPENWEATHER_API_KEY"
		}
	},
	{
		module: "weatherforecast",
		position: "top_right",
		header: "Weather Forecast",
		config: {
			location: "Arrecife, ES",
			locationID: "2521570",  //ID from http://bulk.openweathermap.org/sample/city.list.json.gz; unzip the gz file and find your city
			appid: "..........................."
		
		}
	},
		{

    		module: 'currentweather',
    		position: 'top_right',
		config: {
		        location: 'Arrecife, es',
		        locationID: '2521570', //ID from bulk.openweather.org/sample/
		        appid:" .............................'',
		        updateInterval: '3600000',
		        onlyTemp: true

		}

	},

		{
		module: "newsfeed",
		position: "bottom_bar",
		config: {
			feeds: [
				{
					title: "Canarias7",
					url: "https://www.canarias7.es/rss/portada.xml"
				}
			],
			showSourceTitle: true,
			showPublishDate: true,
			broadcastNewsFeeds: true,
			broadcastNewsUpdates: true
		}
	},
		{
		module: "MMM-Hotword",
		position: "top_right",
		config: {
			chimeOnFinish: null,
			mic: {
				recordProgram: "arecord",
				device: "plughw:1"
			},
			models: [
				{
					hotwords    : "Smart_mirror",
					file        : "smart_mirror.umdl",
					sensitivity : "0.5",
				},
			],
			commands: {
				"smart_mirror": {
					notificationExec: {
						notification: "ASSISTANT_ACTIVATE",
						payload: (detected, afterRecord) => {
							return {profile:"default"}
						}
					},
					restart:false,
					afterRecordLimit:0
				}
			}
		}
	},
	{
		module: "MMM-AssistantMk2",
		position: "top_right",
		config: {
			deviceLocation: {
				coordinates: {
					latitude: 28.969593, // -90.0 - +90.0
					longitude: -13.556344, // -180.0 - +180.0
				},
			},
			record: {
				recordProgram : "arecord",  
				device        : "plughw:1",
			},
			notifications: {
				ASSISTANT_ACTIVATED: "HOTWORD_PAUSE",
				ASSISTANT_DEACTIVATED: "HOTWORD_RESUME",
			},
			useWelcomeMessage: "brief today",
			profiles: {
				"default" : {
					lang: "es-ES"
				}
			},
		}
	},
]

};