Read the statement by Michael Teeuw here.
Start or not...?
-
@sean said in Start or not...?:
It is a separate program and runs out of MM environment independently. So it might not be combined chemically.
What do you mean?
This module work in the background without connecting to MM?
Example: I ask something to GA that executes the command but I will not see the result on MM. Correct?Thanks.
-
@egnos
As I know, you’re right.
Maybe there could be some bridge method, but gassistpi is standalone program by default. It is not made for MM. -
Anyway, there are many modules for google assistant or alexa or others including offline local detector beside GAssistPi in MM Scenes.
Some might be a simple implementation of standalone, but some might be deeply combined with MM. see the list and find for your purpose. -
@sean thank you for your help!
I’ll have to buy a new Raspberry (the first one is already busy …), plus the other components (usb microphone, HDMI/VGA adaptor, etc…).
Can you recommend a site at a good price where to buy all the components including Raspberry?Thanks
-
@egnos having experimented with voice on my mirror in the past (I my case, Amazon Alexa) I can say with relative confidence that most, if not all, of what you want to do IS possible, but likely not out of the box. Most of the services you suggest would actually have nothing to do with MagicMirror, but can run along side on the same Pi. Be prepared to write some of your own integration to make things work in the way you want.
I would suggest though that you not use the pi for voice recognition and instead use a real Google Home device. Since it’s responding to voice it doesn’t need to be on the mirror… just in the same room. If budget is a concern, maybe start a project to build your own using a second Raspberry Pi, although once you add up the cost of all the parts you need it may add to about the same cost.
Take a look at some of the modules others have suggested above. For example, it’s possible to display a video stream on the mirror using the module suggested above. You would just need to figure out how to notify the MagicMirror to do so in response to your voice command.
Similarly, an integration using Google Home to control you lights likely already exists. So maybe all you need to do to extend this to the mirror is to write a module that monitors and displays the status of the lights. Take a look at my module MMM-MyWink which monitors a wink hub for the status of door locks. While it was possible to also have the mirror accept a command to lock or unlock the doors, using Siri on my phone already did this. There was no need to duplicate this effort on the Pi. And now having a few Echo Dots around the house I can say that the responsiveness to voice on my mirror was never as good as the real thing, especially when my wife or kids tried to use it… for some reason it had a hard time responding to higher pitches voices.
I have not used Google assistant so I don’t know what it’s programming API is like, but this was all possible using Amozon’s. I have to believe that Google’s API is equally as capable.
Try not to make your mirror a do-it-all device. The Pi is simply not up to that task. Also it’s a single point of failure when something goes wrong. Instead explore ways to make all of your single purpose devices work together through the various API’s that are freely available.
I hope this helps! Happy hacking
-
@Egnos: I think I made something like you want.
I started with the original Google AIY (https://aiyprojects.withgoogle.com/) and made it working (I have the V1 kit).
After that I installed MM on the same SD card.
GA and MM are working seperately.
So I cannot hide modules with GA, but I can ask a lot of questions and GA answers me in my own language.
I can set timers, ask for appointments in my agenda, turn on the gardenlights and the fountain in my garden pond.
I think it would be possible to set the temperature in the house if I had a smart thermostate (maybe next buy).
Playing songs on youtube or spotify: I did not get it working (I think you need the “real” Google home for that.I am really fond of my Magic Mirror: it turns on and of by a Pir, shows me a lot of personal information and if I say: “Hey Google, goodmorning” it answers: Good morning, Peter, the time is …, the temperature is … it is going to be a cold day, it is not busy on the road to your work, it will take you … minutes, have a nice day … (all in Dutch = my own language).
Finally I build the RPI, AIY with the original speaker and microphone at the back of an old monitor.
I did not use a mirrorglass because my mirror shows thousands of holidaypictures and behind a mirrorglass they were to hard to see clearly in my vision.
So I mounted a plate of clear glass in front of the monitor.If you need more information, you can mail me.
I hope this will help you with your project!
Peter -
@j-e-f-f Thank you so much for your advice.
@j-e-f-f said
@egnos having experimented with voice on my mirror in the past (I my case, Amazon Alexa) I can say with relative confidence that most, if not all, of what you want to do IS possible, but likely not out of the box. Most of the services you suggest would actually have nothing to do with MagicMirror, but can run along side on the same Pi. Be prepared to write some of your own integration to make things work in the way you want.
I have seen several modules that integrate into MM and could be right for me, for example:
-
Command the light in the house: mmm-openhabfloorplan.
-
View the cameras positioned at home: MMM-RTSPStream
-
Regulate the home temperature: MMM-Toon
I do not know how to connect Google Assistant to these modules.
Is it possible to set a sentence to execute a command?
For example: “Hey Google, set the temperature to 21 C °.” and the thermostat set the temperature at 21 C ° …@j-e-f-f said
Take a look at my module MMM-MyWink which monitors a wink hub for the status of door locks. While it was possible to also have the mirror accept a command to lock or unlock the doors, using Siri on my phone already did this.
Excellent module!
What kind of sensors did you use to install on the doors? Wireless (WiFI, …) or wired?
How did you display the open / closed door information on the MM? Do you have an example image?@j-e-f-f said
Try not to make your mirror a do-it-all device. The Pi is simply not up to that task. Also it’s a single point of failure when something goes wrong.
I’m looking for a device that does everything, an “all-in-one”.
In this way I would not have several devices scattered around the house…
Surely I will encounter difficulties, but I want to try … !!:winking_face:@Peter Thanks also to you for your testimony!
@peter said
So I cannot hide modules with GA, but I can ask a lot of questions and GA answers me in my own language.
I can set timers, ask for appointments in my agenda, turn on the gardenlights and the fountain in my garden pond.To turn on the lights in the garden did you use a module for the MM?
If so, how did you manage to connect the GA commands with the module?@peter said in Start or not...?:
I started with the original Google AIY (https://aiyprojects.withgoogle.com/) and made it working (I have the V1 kit).
Are you obliged to purchase the “Voice Kit (V1)” to use Google Assistant?
Thank you all!!!:winking_face:
-
-
Turning on the gardenlights and the fountain is done with a Sonoff 4ch pro.
A cheap smart switch.
You can add all kinds of smart stuff to GA (Philips hue, Ikea,etc).Second question; I think you do not need the Google AIY, but I experienced it to be very easy to setup.
And I bought it very cheap secondhand …
But it is possible to build it yourself (google is your friend).Peter
-
As a private-hobby developer, I don’t want to talk about my things by myself. So still yet I haven’t.
But MMM-AssistantMk2 has what you want as its feature.-
embedded GA(Google Assistant SDK for device) fully integrated in MM with nodejs.
-
custom commands available by transcription hooking, IFTTT and google Action for assistant.
-
it could control RPI, MM and modules by sending notification, executing external shell commands and calling module’s method directly.
-
screen output like Lenovo smart display, youtube playing, TTS and more…
-
But this is not the kinds of out-of-box things. installation and tweak might not be so easy if you are not experienced.
-
-
@egnos said in Start or not...?:
What kind of sensors did you use to install on the doors? Wireless (WiFI, …) or wired?
How did you display the open / closed door information on the MM? Do you have an example image?I used Schlage Connect locks which have a Z-Wave transceiver built-in for the doors, and the Chamberlain MyQ WiFi for the garage. Both integrate with the Wink hub. The Wink Hub sends out pubnub notifications when the state of connected devices changes. My module subscribes to the pubnub feed for the the Wink Hub and subsequently displays an icon depending on status.
Here’s a screenshot:
In it’s current status it only monitors doors (it was the only thing I found personally useful for display on my mirror). I had intended to extend this to monitor anything connected to the hub, but then I sold the house and all of the smart home gear with it when I moved to the UK. So I’ve ceased development on it.
@egnos said in Start or not...?:
Is it possible to set a sentence to execute a command?
For example: “Hey Google, set the temperature to 21 C °.” and the thermostat set the temperature at 21 C ° …Yes, but again, Magic Mirror is not doing any of the work here. Your voice assistant needs to have this integration into your smart thermostat. It doesn’t matter if you’re attempting to roll your own – say using GA to trigger Home Assistant to tap into Nest’s API – or are using an existing integration – say a Nest thermostat integrating with Apple Home Kit with Siri enabled. You could use a module to display feedback on the mirror in response to your voice command and another to report the current state of the thermostat – modules for both tasks exist in some form so they should be able to get you started.
