Hello everyone! I just thought I’d share what I’ve been working on. Thanks to @strawberry-3-141 and @Mykle1 for pointing me in the right direction from the very beginning. And of course thanks to @Jopyth for the great work on the MMM-Remote-Control module that I’m using to communicate commands to the MagicMirror’s modules from Mycroft.

Here’s a little video:
https://www.youtube.com/watch?v=wshzsd5hOMA

And here’s the complete history of how I got here, and a roadmap of how you can use Mycroft to control your MagicMirror.

I got the idea from seeing the really cool MMM-voice module @strawberry-3-141 created with the Hello-Lucy modifications @Mykle1 created. And while I like the idea of having the voice recognition on board (not sending it off to Google or Alexa), I wanted the ability to do more than control the Mirror. You know, an AI that could do other things. So that’s how I found Mycroft, an open source AI that I’m more comfortable with using.

Let me know what you think. I would love suggestions or ideas to improve on the combination of MagicMirror and Mycroft.

Cheers!

@cyberphox Yes to the RPi. It’s a RPi 3b. Both the MagicMirror and the Mycroft-core fit onto a 16gb sd card with loads of room to spare. It’s running Debian Jesse (not lite) with the Pixel desktop. For the most part, it’s pretty responsive. Occasionally it takes a few seconds like you see in the video. Part of the lag is my hardware is not put together and the video was done by using RealVNC and remoting into the RPi. All of the history is in the link above, including links to all the software.

@jopyth I just want to thank you again for your work on this module! Your module rocks!

BTW - It doesn’t have to be a mobile/tablet, I wrote an AI skill for Mycroft that uses your MMM-Remote-Control module to pass verbal commands to the MagicMirror.

If you’d like, check out the 2 min. video here.

And here’s a link to the repo if anyone would like to check out the Python code that interacts with the MMM-Remote-Control module.

Thanks again!
Cheers!

So I must say the MMM-voice module (also with Mykle’s Hello-Lucy enhancements) works perfectly on my mirror… when I don’t have my Mycroft AI running at start as well. It’s an Error: resource busy/unavailable referring to the Microphone. When I stop Mycroft/restart mirror it works perfectly, but then Mycroft gets the same error. Any suggestions?

I am thinking about building a MagicMirror skill for Mycroft, but Mycroft is Python not Java, and not a module. Would it be possible to send the same commands as Hello-Lucy (i.e. ‘HIDE_CLOCK’ for example) only use Websocket-client for Mycroft and send commands to the MagicMirror via socket.io?

If so, what would handle the socketmessage? Would it be communicated to the right module/s. Would I also need to create a fork of the MMM-voice module with code to handle the socketmessages from Mycroft?

Any guidance would be much appreciated!

Sorry, I should have also said my mirror is running on a RPi 3b running Debian Jessie on a 16gb sd.

@sispheor @sdetweil Hey guys, thanks for your help! I got things working over the weekend.

Here’s a short video.

Cheers!

@cowboysdude Yes! Once I get the code worked into a skill instead of the current hack. I will require installing Mycroft on the same pi/ or another pi on the same network. Could be used just about anywhere you can use Mycroft. I will keep the forum posted. I’m going to be out of town for the next week so… maybe in a couple of weeks.

@richland007 If all you want to do is control the modules I would recommend using MMM-voice with the Hello-Lucy modifications. You may run into the same problem that I had though. Two services cannot use the same resource at the same time (microphone). In the end, I wrote a skill for Mycroft and just decided to use the open-source AI Mycroft to also control the mirror.

Here’s a short video.

Here’s a thread on the Mycroft forum that covers the history of how I got there.

I have not used the MMM-assistant, but my guess is you will run into the same Error: Resource busy that I had with Mycroft and the MMM-voice module.

I hope this post helps.

@jmartin1009 I am using Mycroft. Great open source AI and I created a skill to control the Mirror that requires the MMM-Remote-control module. It can be installed on the same RPi but works much snappier on a separate RPi.

You can see a video and instructions Here

Not sure if you are interested in an open source assistant, but this one works well.

@raywo Dude! I just found your module! This is freaking amazing! Followed your setup instructions and it works like magic! Awesome job man!

@ezeraj Oh yeah, here’s another post you may like as well.

https://forum.magicmirror.builders/topic/6615/kalliope-assistant-mm/57

I have a fork of the MMM-kalliope module that I have modified to work with Mycroft as well to display the user and Mycroft utterances on the Magic Mirror as well. @sispheor did some great work that I modified for use with Mycroft. You can find it here.

@ezeraj check out this post.

https://forum.magicmirror.builders/topic/7366/yet-another-ai-for-magicmirror-this-time-it-s-mycroft/4

@sispheor I just wanted to let you know that I’ve worked out how to have the text display longer based on how long the reply from Mycroft is in my fork of your module. I thought I would share the solution I came up with just in case it would be something you could use.

First I set the keep_seconds to 0 in the config.js to stop the module from clearing out the messages. Then in my Mycroft skill, when the audio_output_end event gets triggered I send a notification to the kalliope module “REMOVE_MESSAGE”. Then added a bit of code to the kalliope module to process the notification like so:

if (notification == "REMOVE_MESSAGE"){
            // When Mycroft signals the AUDIO_OUTPUT_END remove the message from the screen
            this.messages.splice(0, this.messages.length);

I’ll see if I can do a short video to show the results.

Cheers!

@sispheor I have made a minor tweak in your code on my fork to display the mycroft icon just above the title, which in my case I have changed to Mycroft. But I was wondering, any ideas on how I could tweak your code to display the message for an interval based on how long the message is? I played with it a little bit, but I think I’m missing exactly how it works. I tried to add an if statement for example:

for(var i = 0; i < this.messages.length; i++){
            var dif = currentDate.getTime() - this.messages[i].timestamp.getTime();
            if (this.message.length > 30){
              var secondsFromCurrentDateToMessageDate = dif / 1500;
              }else{
                var secondsFromCurrentDateToMessageDate = dif / 1000;
              }
            var secondsBetweenDates = Math.abs(secondsFromCurrentDateToMessageDate);

            // delete the message if to old
            if (secondsBetweenDates > this.config.keep_seconds){
                this.messages.splice(i, 1);
            }
        }
    },

But the old messages never get cleaned off the mirror.

Any thoughts about how to increase the time interval that the message is displayed based on the length of the message?

Any help would be much appreciated!

Edit:
Nevermind, I see what I’m doing wrong here. I will work on getting messages to display for different intervals based on how long they are and let you know what I come up with.:face_savouring_delicious_food:

@cowboysdude Yes! Once I get the code worked into a skill instead of the current hack. I will require installing Mycroft on the same pi/ or another pi on the same network. Could be used just about anywhere you can use Mycroft. I will keep the forum posted. I’m going to be out of town for the next week so… maybe in a couple of weeks.

@sispheor @sdetweil Hey guys, thanks for your help! I got things working over the weekend.

Here’s a short video.

Cheers!

Thanks to @sispheor 's MMM-kalliope module and a few modifications, I’ve added additional functionality to the MagicMirror - Mycroft interaction.

Here’s another short video.

It requires a hack of the Mycroft-core, and I’m looking to add that functionality to the Mycroft skill. That is as soon as I figure out how.

@richland007 If all you want to do is control the modules I would recommend using MMM-voice with the Hello-Lucy modifications. You may run into the same problem that I had though. Two services cannot use the same resource at the same time (microphone). In the end, I wrote a skill for Mycroft and just decided to use the open-source AI Mycroft to also control the mirror.

Here’s a short video.

Here’s a thread on the Mycroft forum that covers the history of how I got there.

I have not used the MMM-assistant, but my guess is you will run into the same Error: Resource busy that I had with Mycroft and the MMM-voice module.

I hope this post helps.