VoiceControl module

tyho

@Pierre @simonsays
First of all sorry for the long waiting…
I guess u already have run the voice control module with the speech files (pmdl) from snopwboy and put this in your root.
Here is my config part for the VoiceControl module:

{
            module: 'voicecontrol',
            config: {
                models: [
                    {
                        keyword: "gotosleep",   // keyword 
                        file: "gotosleep.pmdl", // trained model file name
                        message: "go_to_sleep"   // notification message that's broadcast in the MagicMirror app
                    },
					{
                        keyword: "wake up",   // keyword 
                        file: "Wake_up.pmdl", // trained model file name
                        message: "wake_up"   // notification message that's broadcast in the MagicMirror app
                    },
                ]
            }
        },
		{
        	module: 'notification',
        	position: 'bottom_right',    // This can be any of the regions.
    	},

Because the voicecontrol module send a notafication to all other modules i wrote a separate module to show text messages for what is happening:
notification.js

/* global Module */

/* Magic Mirror
 * Module: notification
 */
var awake = 1;
Module.register("notification",{

	// Default module config.
	defaults: {
		text: "",
		animationSpeed: 500,
	},
	start: function() { 
        this.sendSocketNotification("CONNECT", {});
    },

	notificationReceived: function(notification, callback) {
		var self = this;
				if (notification === "go_to_sleep" && awake === 1){
            		this.config.text = "going to sleep...";
					this.updateDom(this.config.animationSpeed);
					setTimeout(function(){
						self.sendSocketNotification('go_to_sleep', {});
						self.config.text = "";
						self.updateDom(self.config.animationSpeed);
					}, 1000);
					awake = 0;
					callback(awake);
        		}
				if (notification === "wake_up" && awake === 0){
					this.sendSocketNotification('wake_up', {});
            		this.config.text = "waking up...";
					this.updateDom(this.config.animationSpeed);
					setTimeout(function(){
						self.config.text = "";
						self.updateDom(self.config.animationSpeed);
					}, 5000);
					awake = 1;
					callback(awake);
        		}
    },
	socketNotificationReceived: function(notification) {
   if (notification === "autosleep") {
					awake = 0;
        		}
   	},
	// Override dom generator.
	getDom: function() {
		var wrapper = document.createElement("div");
		wrapper.innerHTML = this.config.text;
		return wrapper;
	}
});

In my node helper i put the exec code to turn on and off my monitor.
node_helper.js

'use strict';
const NodeHelper = require('node_helper');
const exec = require('child_process').exec;
var timer;
//function initialize() {
//}
//(function(){
//	initialize();
//			autosleep();
//})();


module.exports = NodeHelper.create({
  start: function() {
		this.started = false;
  }, 
 
  socketNotificationReceived: function(notification) {
	if (notification === "CONNECT") {
			clearTimeout(timer);
			this.autosleep();
	}
    if (notification === 'go_to_sleep') {
            exec("/opt/vc/bin/tvservice -o", null);
			clearTimeout(timer);
	}
	if (notification === 'wake_up') {
            exec("/opt/vc/bin/tvservice -p", null);
			exec("/bin/fbset -depth 8 && /bin/fbset -depth 16 ", null);
      		exec("/usr/bin/xrefresh",null);
			clearTimeout(timer);
			this.autosleep();
	}
  },
  autosleep: function(){
	  var self = this;
	  timer=setTimeout(function(){
				exec("/opt/vc/bin/tvservice -o", null);
			    self.sendSocketNotification("autosleep", {});
			},  10*60*1000);
  }
});

I also put conditions in it so it can only wake up when it’s asleep. There is also a autosleep function thats now on 10 minutes.

gismo2006

@Jopyth

Thank you everything workes fine. A big thank you!!!

greets gismo

gismo2006

@Jopyth

Maybe you can help me again?

If I put only one comand like Play everything ist fine. But if I put more than one comand, like Play and Stop the Player is completly confused. Then only a handclap or a any other word is need to start a track or to beginn from beginning again…

greets gismo

simonsays

This post is deleted!

simonsays

@alexyak @tyho I was able to get my sleep and wake up function to work using tyho’s code as well as able to find a way to turn the LED on. However, I cannot seem to turn it off once on. I am driving the switch with a gpio pin and transistor. It seems that after the pi executes the action, it wont listen for anything else. Example is if I tell it to turn the LED on, it does so. Then i say go to sleep, and it won’t. I go for the reboot and try again and start with the sleep command first. Then I try to turn the LED on and it won’t do that. Is there a way to have the function in tyho’s node_helper.js loop back again to the beginning? I feel like it get’s stuck once it executes a function. I also have an issue with the screen being yellow and zoomed in when i wake up the mirror after sleep. Don’t think it is a hardware issue, but I haven’t swapped HDMI cables yet.

For reference:

Code for modified node_helper.js:

socketNotificationReceived: function(notification) {
if (notification === “CONNECT”) {
clearTimeout(timer);
this.autosleep();
}
if (notification === ‘go_to_sleep’) {
exec(“/opt/vc/bin/tvservice -o”, null);
clearTimeout(timer);
=}
if (notification === ‘wake_up’) {
exec(“/opt/vc/bin/tvservice -p”, null);
exec(“/bin/fbset -depth 8 && /bin/fbset -depth 16 “, null);
exec(”/usr/bin/xrefresh”,null);
clearTimeout(timer);
this.autosleep();

}
if (notification === ‘lights_on’) {
exec(“echo ‘18’ > /sys/class/gpio/export”, null);
exec(“echo ‘out’ > /sys/class/gpio/gpio18/direction”, null);
gpio.setup(‘sys’);
gpio.digitalWrite(18,1);
clearTimeout(timer);
}
if (notification === ‘lights_off’) {
exec(“echo ‘18’ > /sys/class/gpio/export”, null);
exec(“echo ‘out’ > /sys/class/gpio/gpio18/direction”, null);
gpio.setup(‘sys’);
gpio.digitalWrite(18,0);
clearTimeout(timer);
}
},
autosleep: function(){
var self = this;
timer=setTimeout(function(){
exec(“/opt/vc/bin/tvservice -o”, null);
self.sendSocketNotification(“autosleep”, {});
}, 10601000);
}
});

Any help is greatly appreciated.

gismo2006

Hi,

maybe someone can help me… :-)

So far the musiccontroll works fine. Now I spent my time for a new project. I Copy the code from @tyho and save it as notification.js and node_helper.js. The I copy the code into my config file like he posted. Th two files I coppied into an new folder called notification, that I took under Modules. Then I train two Hotword for wake up and go sleeping an copy and paste the two pmdl files correctly. The Mirror stats fine and everything is working But the two Hotwords didn’t take their job.

Greets gismo

tgl

Hello :-)

At first - great job!

And the second - my English is not the best :-/

But I hope of Help.

I´ve allready installt the module.
Then I become the Error of Alsa.

Can anybody help me please?

Here my log:

[0_1476519121142_mm-error-0.log](Uploading 100%)

Thank you for help

MichMich

It would be nice if you can extend the module with hide/show options:

 {
    keyword: "simpleMode",   // keyword 
    description: "Say 'Simple Mode' to switch to the simple UI.",
    file: "simpleMode.pmdl", // trained model file name
    message: false,   // Unused in this command. Can be omitted.
    show: "simple foo bar",  // Show these modules.
    hide: "advanced" // Hide these modules.
}

When activating this command, it shows all modules with de classes defined in the show variable. And it hides all modules defined in the hide variable.

When implementing this, make sure you use the Visibility Locking mechanism that will be introduced in version 2.1.0: https://forum.magicmirror.builders/topic/241/2-1-0-api-revising-the-show-hide-mechanism/9

tgl

Hello again,

is it possible to post my log here?

gismo2006

Good evenning, morning,

I have now spent many hours to create @tyho notification module. And now it works.

Maybe the following can help someone, to…

If I say wake up the monito wake up but the the monitor picture was terrible and i had to reboot.

Now I have edit one line in the node_helper.js and everthing works fine. Here my changes:

if (notification === ‘wake_up’) {
exec(“/opt/vc/bin/tvservice -p”, null);
exec(“sudo /bin/chvt 6 && sudo /bin/chvt 7”, null);
clearTimeout(timer);
this.autosleep();

greets gismo