Voice/motion control

coolbotic

New to the forum and I am looking to make one of these mirrors for a while but would love to add some extra function to mine for a school project and was wondering if anyone had any ideas on how to achieve some of this…

Motion control - This was my first idea when I saw these, I wanted to put a leap motion controller in the mirror and use it as a mouse as such to scroll through social feeds and move and hide elements of the page until I found that you are unable to use the leap motion with the raspberry PI as it does not have the right specs and have been looking for a new motion detector that will work with the pi or a more powerfully micro computer, if you have any ideas I would love to hear them!!! - https://www.leapmotion.com/

Voice detection - I was looking around and saw this page about this http://docs.smart-mirror.io and was wondering if anyone had tried this or something like this and how well it worked !?!?!

Thanks James

MichMich

@coolbotic Voice control is still on my wish list /todo list. 😁

coolbotic

How long is this to do list XD Need it for a school project and would love to have it done as it would be sooooo cool !!!

MichMich

Well, you could try to built it yourself ofcourse. :)

coolbotic

Hahaha yes I could TRY, I have studied HTML, CSS and Javascript but I don’t think I could do it with ease but I’ll give it a go XD

coolbotic

Saw this which could make it easier https://www.talater.com/annyang/ :D

MichMich

Yes, I looked into that. It seems it doesn’t work with Electron on the Raspberry Pi and has an API limit.

Give it a try, and if it does work, let me know and I’ll build a module.

coolbotic

Oh right hmmmm what about this https://github.com/thomascullen/voicebox As you can tell i’m really not sure what I am looking for haha XD

MichMich

@coolbotic not sure if that ine runs on the RasPi. Give it a try.

coolbotic

Okay will do waiting on a new SD card, if it work should I tell you? 8-D

MichMich

@coolbotic Please do!

coolbotic

Hope it works now haha !

Simon

Hi
i haven’t put voice control into my mirror but have played around with it for a kitchen based recipe generator. (Say Baked Alaska and the display pulled a recipe off BBC food website and displayed it. )

Basically voice recognition is fairly simple. What is difficult is getting it to start listening.
The easiest way of doing it is to use the google api Here is a good source. http://stevenhickson.blogspot.co.uk/2013/06/voice-command-v30-for-raspberry-pi.html

The problem I had when I played with this is that. It records what you say and sends it to google for recognition. If you want a system that is always listening then you would end up sending recordings to google 24/7. . You could try using http://cmusphinx.sourceforge.net/ to recognize an initial key word then turn on google recognition. But I couldn’t really get a great response from that. However I have a strong Irish accent which doesn’t help :)
So you might have more luck. Also a good microphone will make your life easier.

MichMich

@Simon Hi Simon. Do you know if the google API is supported under Electron?

PtrBld

It seems that Google has removed this feature for electron, however when you use chromium together with MM² it may works… See this stackoverflow question.

Simon

Don’t know. I coded with it in python. To tell you the truth I have only heard of Electron about 10 minutes ago :) My magic mirror is coded in python (far more hacky and inelegant then your solution) but it entertained me for a while. :)

paviro

electron-speech, alexa-voice-service & pocketsphinx might be worth a look :)

coolbotic

@Simon Have you posted you code anywhere would love to see it!!!

Simon

@coolbotic No it’s not very pretty :) I’ll see what I can do

matt08

What do you think about using wit.ai to voice control MM?
Free, unlimited API that could be implemented