Read the statement by Michael Teeuw here.
Start or not...?
-
@sean many thanks for you answers!
I love building anything and the raspberry is my longtime adventures companion …
When I discovered the MM project a world opened up, and the idea of commanding things using the Google Assistant and seeing the result on the display I think it’s very nice!
For my purposes the MM is much more scenographic and impact than the Lenovo Smart Display.My answers in bold:
1- possible. What is the name of the module that manages this function?
2- obvious. What do you mean exactly? I would like to put cameras for video surveillance in the garden and see them in real time on the MM (to check the children…) .
3- Maybe or not. Only REAL Google Assistant(Google Home) has an unlimited accessibility for YouTube Music. Exists another way to listen the music?
4- possible.
5- Why do you need Google Assistant to regulate your home temperature? Of course, RPI itself can do. Because it is more comfortable to set the thermostat by voiceIn youtube there is a project that is very close to my idea:
https://www.youtube.com/watch?v=cVmDjJmcd2MI hope to succeed in my project…and surely I would make it available to the community!!
-
@egnos
Most of your question could be found here;
https://github.com/MichMich/MagicMirror/wiki/3rd-Party-Modules1- possible. What is the name of the module that manages this function?
If you mean embeded Google Assistant, a few modules exist. Check above link. Not only GA, various kinds of voice commander there.
2- obvious. What do you mean exactly? I would like to put cameras for video surveillance in the garden and see them in real time on the MM (to check the children…) .
Check also link. I think MMM-RTSPStream would be one of them.
3- Maybe or not. Only REAL Google Assistant(Google Home) has an unlimited accessibility for YouTube Music. Exists another way to listen the music?
From your local SD card? there are also several local or internet music related modules.
5- Why do you need Google Assistant to regulate your home temperature? Of course, RPI itself can do. Because it is more comfortable to set the thermostat by voice
As I wrote above, Not only GA but several modules for voice command exist.
But some module exists doesn’t mean that could be perfect to your purpose. You should read documents of each module carefully, and should confirm what could be able or not. Some task would be very easy, but some tasks wouldn’t be so easy to work nicely as your expectation. I wish you a good luck.
-
@sean said in Start or not...?:
From your local SD card? there are also several local or internet music related modules.
I would prefer on the internet
Another question:
is it possible to assign a specific action to a voice command ?.Have you watched the video I posted to you?
Thank you for all the advice and if you can think of anything else do not hesitate to write …:winking_face:
-
@egnos
In video, he usedGassistPi(https://github.com/shivasiddharth/GassistPi), not MM module. It is a separate program and runs out of MM environment independently. So it might not be combined chemically. (but physically, anyway its ok.)
I think if you have a plan to use that program, ask your question and request related with GA to its developer. -
@sean said in Start or not...?:
It is a separate program and runs out of MM environment independently. So it might not be combined chemically.
What do you mean?
This module work in the background without connecting to MM?
Example: I ask something to GA that executes the command but I will not see the result on MM. Correct?Thanks.
-
@egnos
As I know, you’re right.
Maybe there could be some bridge method, but gassistpi is standalone program by default. It is not made for MM. -
Anyway, there are many modules for google assistant or alexa or others including offline local detector beside GAssistPi in MM Scenes.
Some might be a simple implementation of standalone, but some might be deeply combined with MM. see the list and find for your purpose. -
@sean thank you for your help!
I’ll have to buy a new Raspberry (the first one is already busy …), plus the other components (usb microphone, HDMI/VGA adaptor, etc…).
Can you recommend a site at a good price where to buy all the components including Raspberry?Thanks
-
@egnos having experimented with voice on my mirror in the past (I my case, Amazon Alexa) I can say with relative confidence that most, if not all, of what you want to do IS possible, but likely not out of the box. Most of the services you suggest would actually have nothing to do with MagicMirror, but can run along side on the same Pi. Be prepared to write some of your own integration to make things work in the way you want.
I would suggest though that you not use the pi for voice recognition and instead use a real Google Home device. Since it’s responding to voice it doesn’t need to be on the mirror… just in the same room. If budget is a concern, maybe start a project to build your own using a second Raspberry Pi, although once you add up the cost of all the parts you need it may add to about the same cost.
Take a look at some of the modules others have suggested above. For example, it’s possible to display a video stream on the mirror using the module suggested above. You would just need to figure out how to notify the MagicMirror to do so in response to your voice command.
Similarly, an integration using Google Home to control you lights likely already exists. So maybe all you need to do to extend this to the mirror is to write a module that monitors and displays the status of the lights. Take a look at my module MMM-MyWink which monitors a wink hub for the status of door locks. While it was possible to also have the mirror accept a command to lock or unlock the doors, using Siri on my phone already did this. There was no need to duplicate this effort on the Pi. And now having a few Echo Dots around the house I can say that the responsiveness to voice on my mirror was never as good as the real thing, especially when my wife or kids tried to use it… for some reason it had a hard time responding to higher pitches voices.
I have not used Google assistant so I don’t know what it’s programming API is like, but this was all possible using Amozon’s. I have to believe that Google’s API is equally as capable.
Try not to make your mirror a do-it-all device. The Pi is simply not up to that task. Also it’s a single point of failure when something goes wrong. Instead explore ways to make all of your single purpose devices work together through the various API’s that are freely available.
I hope this helps! Happy hacking
-
@Egnos: I think I made something like you want.
I started with the original Google AIY (https://aiyprojects.withgoogle.com/) and made it working (I have the V1 kit).
After that I installed MM on the same SD card.
GA and MM are working seperately.
So I cannot hide modules with GA, but I can ask a lot of questions and GA answers me in my own language.
I can set timers, ask for appointments in my agenda, turn on the gardenlights and the fountain in my garden pond.
I think it would be possible to set the temperature in the house if I had a smart thermostate (maybe next buy).
Playing songs on youtube or spotify: I did not get it working (I think you need the “real” Google home for that.I am really fond of my Magic Mirror: it turns on and of by a Pir, shows me a lot of personal information and if I say: “Hey Google, goodmorning” it answers: Good morning, Peter, the time is …, the temperature is … it is going to be a cold day, it is not busy on the road to your work, it will take you … minutes, have a nice day … (all in Dutch = my own language).
Finally I build the RPI, AIY with the original speaker and microphone at the back of an old monitor.
I did not use a mirrorglass because my mirror shows thousands of holidaypictures and behind a mirrorglass they were to hard to see clearly in my vision.
So I mounted a plate of clear glass in front of the monitor.If you need more information, you can mail me.
I hope this will help you with your project!
Peter -
@j-e-f-f Thank you so much for your advice.
@j-e-f-f said
@egnos having experimented with voice on my mirror in the past (I my case, Amazon Alexa) I can say with relative confidence that most, if not all, of what you want to do IS possible, but likely not out of the box. Most of the services you suggest would actually have nothing to do with MagicMirror, but can run along side on the same Pi. Be prepared to write some of your own integration to make things work in the way you want.
I have seen several modules that integrate into MM and could be right for me, for example:
-
Command the light in the house: mmm-openhabfloorplan.
-
View the cameras positioned at home: MMM-RTSPStream
-
Regulate the home temperature: MMM-Toon
I do not know how to connect Google Assistant to these modules.
Is it possible to set a sentence to execute a command?
For example: “Hey Google, set the temperature to 21 C °.” and the thermostat set the temperature at 21 C ° …@j-e-f-f said
Take a look at my module MMM-MyWink which monitors a wink hub for the status of door locks. While it was possible to also have the mirror accept a command to lock or unlock the doors, using Siri on my phone already did this.
Excellent module!
What kind of sensors did you use to install on the doors? Wireless (WiFI, …) or wired?
How did you display the open / closed door information on the MM? Do you have an example image?@j-e-f-f said
Try not to make your mirror a do-it-all device. The Pi is simply not up to that task. Also it’s a single point of failure when something goes wrong.
I’m looking for a device that does everything, an “all-in-one”.
In this way I would not have several devices scattered around the house…
Surely I will encounter difficulties, but I want to try … !!:winking_face:@Peter Thanks also to you for your testimony!
@peter said
So I cannot hide modules with GA, but I can ask a lot of questions and GA answers me in my own language.
I can set timers, ask for appointments in my agenda, turn on the gardenlights and the fountain in my garden pond.To turn on the lights in the garden did you use a module for the MM?
If so, how did you manage to connect the GA commands with the module?@peter said in Start or not...?:
I started with the original Google AIY (https://aiyprojects.withgoogle.com/) and made it working (I have the V1 kit).
Are you obliged to purchase the “Voice Kit (V1)” to use Google Assistant?
Thank you all!!!:winking_face:
-
-
Turning on the gardenlights and the fountain is done with a Sonoff 4ch pro.
A cheap smart switch.
You can add all kinds of smart stuff to GA (Philips hue, Ikea,etc).Second question; I think you do not need the Google AIY, but I experienced it to be very easy to setup.
And I bought it very cheap secondhand …
But it is possible to build it yourself (google is your friend).Peter
-
As a private-hobby developer, I don’t want to talk about my things by myself. So still yet I haven’t.
But MMM-AssistantMk2 has what you want as its feature.-
embedded GA(Google Assistant SDK for device) fully integrated in MM with nodejs.
-
custom commands available by transcription hooking, IFTTT and google Action for assistant.
-
it could control RPI, MM and modules by sending notification, executing external shell commands and calling module’s method directly.
-
screen output like Lenovo smart display, youtube playing, TTS and more…
-
But this is not the kinds of out-of-box things. installation and tweak might not be so easy if you are not experienced.
-
-
@egnos said in Start or not...?:
What kind of sensors did you use to install on the doors? Wireless (WiFI, …) or wired?
How did you display the open / closed door information on the MM? Do you have an example image?I used Schlage Connect locks which have a Z-Wave transceiver built-in for the doors, and the Chamberlain MyQ WiFi for the garage. Both integrate with the Wink hub. The Wink Hub sends out pubnub notifications when the state of connected devices changes. My module subscribes to the pubnub feed for the the Wink Hub and subsequently displays an icon depending on status.
Here’s a screenshot:
In it’s current status it only monitors doors (it was the only thing I found personally useful for display on my mirror). I had intended to extend this to monitor anything connected to the hub, but then I sold the house and all of the smart home gear with it when I moved to the UK. So I’ve ceased development on it.
@egnos said in Start or not...?:
Is it possible to set a sentence to execute a command?
For example: “Hey Google, set the temperature to 21 C °.” and the thermostat set the temperature at 21 C ° …Yes, but again, Magic Mirror is not doing any of the work here. Your voice assistant needs to have this integration into your smart thermostat. It doesn’t matter if you’re attempting to roll your own – say using GA to trigger Home Assistant to tap into Nest’s API – or are using an existing integration – say a Nest thermostat integrating with Apple Home Kit with Siri enabled. You could use a module to display feedback on the mirror in response to your voice command and another to report the current state of the thermostat – modules for both tasks exist in some form so they should be able to get you started.
-
@peter said in Start or not...?:
Turning on the gardenlights and the fountain is done with a Sonoff 4ch pro.
A cheap smart switch.
You can add all kinds of smart stuff to GA (Philips hue, Ikea,etc).Second question; I think you do not need the Google AIY, but I experienced it to be very easy to setup.
And I bought it very cheap secondhand …
But it is possible to build it yourself (google is your friend).Peter
Ok, thanks Peter!
In theory to start I would need:- Mini USB Microphone
- Bluetooth Speaker
- WiFi Router
- Patience…:winking_face:
after installing everything, I will need:
- Sonoff 4ch pro (to control lights, etc…)
- IP Camera
- Smart Thermostat (what do you think about this? MAX! Wall Thermostat+)
@sean said in Start or not...?:
As a private-hobby developer, I don’t want to talk about my things by myself. So still yet I haven’t.
But MMM-AssistantMk2 has what you want as its feature.-
embedded GA(Google Assistant SDK for device) fully integrated in MM with nodejs.
-
custom commands available by transcription hooking, IFTTT and google Action for assistant.
-
it could control RPI, MM and modules by sending notification, executing external shell commands and calling module’s method directly.
-
screen output like Lenovo smart display, youtube playing, TTS and more…
-
But this is not the kinds of out-of-box things. installation and tweak might not be so easy if you are not experienced.
Thank you so much Sean.
Spectacular module!
Have you already tested it?@j-e-f-f said in Start or not...?:
Both integrate with the Wink hub. The Wink Hub sends out pubnub notifications when the state of connected devices changes. My module subscribes to the pubnub feed for the the Wink Hub and subsequently displays an icon depending on status.
Ok, thanks j-e-f-f!
Your form is very interesting and I congratulate you!!
Sorry j-e-f-f…but I’m a noob :smiling_face_with_open_mouth_cold_sweat::
could you explain to me what is the use and how does it work the connection between Wink Hub and Pubnub?Question for all:
As a guide to get started …can i use this? Complete Setup Tutorial
Or are there better guides?Thank you all!
-
@egnos said in Start or not...?:
Sorry j-e-f-f…but I’m a noob :
could you explain to me what is the use and how does it work the connection between Wink Hub and Pubnub?No worries!
Wink Hub is a home automation appliance. It is meant as a single device to consolidate all your smart home devices into a single point of control. Here’s a link:
https://www.wink.com/products/wink-hub-2/PubNub is a notification system API that Wink uses to broadcast devices status updates to anything that wishes to consume them.
https://www.pubnub.com/ -
Ok, I understood.
@j-e-f-f said in Start or not...?:
PubNub is a notification system API that Wink uses to broadcast devices status updates to anything that wishes to consume them.
https://www.pubnub.com/Wrong or pubnub is a paid service?
Wink can only use Pubnub to send notifications or exist non-payment services?
Thanks -
@peter said in Start or not...?:
Turning on the gardenlights and the fountain is done with a Sonoff 4ch pro.
A cheap smart switch.
You can add all kinds of smart stuff to GA (Philips hue, Ikea,etc).Peter, how did you connect the GA item with the Sonoff?
Each Sonoff channel have an IP address? How does it work?Thanks
-
@Egnos: I think you should just start!
MM is a very funny project!
Buy a Raspberry Pi, SD card, find an old monitor, keyboard and mouse and go!
Burn an image on the SD card and try to get MM running.
You don’t need all the other stuff (you can add it later).
And I will give you some advice: after MM is working, save the config.js file (I saved it on a USB stick).
Then try to add or change a module; is it working: fine!
Is it not working: you still have the working config.js on the USB!About the Sonoff: you do not need a RPI or MM to maken the Sonoff working.
The Sonoff is hardwired with the gardenlights; it has 1 IP adress with 4 channels.
You can use your cellphone or a 433 Mhz remote to switch the channels.
But I find it more fun to say: “Hey Google, turn on the fountain …”Another advice: read, read, read, search, read and finally: ask here …
Peter
-
@peter thanks for your precious advice!
I would like to start but for work I am often around Europe and time is always a little … !!
I’ll start soon … promised!:smiling_face_with_halo:@peter said in Start or not...?:
But I find it more fun to say: “Hey Google, turn on the fountain …”
Ok, but how do you connect a sentence to GA with a command to Sonoff?
Thanks for your patience!
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login