MagicMirror project for sister

[blaukon]

I’ve recently finished my sister’s magicmirror running a 27" monitor and pilkington mirropane chrome spy 4mm glass.
Adopted many great modules (thank you authors!), added my own modules as well as embedded custom voice commands and a custom wake word.
Run into m a n y issues during the whole process until it finally hang at the desired wall. (3 1/2 years :/ due to stacked schedules)
Funniest problem was that the mirror wasn’t able to recognise my sister’s voice, but had no problem with my deeper voice.

problems

• sdcard failure
  solution: replaced sd card, frequent sdcard image backups after bigger software changes, removed auto-restart every day and replaced it with auto-reload MM instead
• MMM-GoogleMapsTraffic crashing the software
  solution: auto-reload MM twice a day
• MMM-AssistantMk2 v2 having slow reaction time on first request (mirror start/reload)
  solution: added useWelcomeMessage: “hi” and simultaneously mute the sound output and put it back on after 60seconds
• voice of sister not being recognised
  solution: raised mic sensitivity and added custom wakeword with her voice
• performance and temperature
  solution: used a stretch and buster version simultaneously and let it run for a month - stretch version was slower, hotter and crashed 3 times
  buster was flawless and cooler / similar temperature (even without an active fan)

used modules

• weatherforecast by MichMich
• currentweather by MichMich
• mmm-systemtemperature by MichMich
• compliments by MichMich
• newsfeed by MichMich
• calendar by MichMich 3x (customized)
• MMM-pages by edward-shen
• MMM-Remote-Control by Jopyth
• MMM-AssistantMk2 by eouia (customized)
• MMM-Hotword by eouia (customized)
• MMM-Wunderlist by paviro (customized)
• MMM-NetworkScanner by ianperrin (customized)
• MMM-cryptocurrency by matteodanelli (customized)
• calendar_monthly by KirAsh4 (customized)
• MMM-GoogleMapsTraffic by sdetweil (customized)
• custom modules:
  logo
  notification
  frame

MMM-Page has 3 pages configured - normal screen | fullscreen google maps | “guest screen”, hiding calendar, todo,… - module is controlled by MMM-AssistantMk2

currently running beside the MM software

• flask webserver
• openvpn for maintenance
• python script that searches for devices in her network (smartphone, notebook) to detect if someone’s home and therefore turns the display on - otherwise display is off
• the same script also restarts the mirror in case of getting 80 degrees and restarts the openvpn connection on failure

hardware

• Raspberry Pi 3b+
• Transcend Ultimate microSDHC 8GB Class 10 UHS-I
• kinobo mini akiro usb microphone
• 27" fullhd monitor AOC i2770PQ
• spy-mirror-glass Pilkington Mirropane Chrome Spy 4mm

enough issues, here’s the mirror and a live demonstration:

Pictures and Files:
https://drive.google.com/open?id=16hNIqnGdpdmm9KeE-jcLGc0-fB80OpML

video was recorded with the stretch version and rpi3b
https://youtu.be/fZR0dvKM5q8

I am also running a “terminal” on my desk with an old netbook display and MM software and will soon finish my own mirror.

[Fozi]

You‘re sister will love you forever! Absolutely gorgeous job! I‘d be interested in the script for presence detection. Any GitHub link you can provide?

[blaukon]

sure, might not be great, but it works well for me: https://gist.github.com/blaukon/1e6c4c9ad6ae98ad62545e1659555ecd

Might not work with every smartphone, for example, it works well with my Samsung Galaxy S8, but not without turning deepsleep off at my parents S7. Also did not work properly on my Sisters Huawei P20. Tried every setting but Android does turn Wifi off although “keep wifi alive even in standby” setting is active.
Just added my sisters Laptop IP and so far, it’s working fine at her place.

Added a picture of the mounted mirror: https://drive.google.com/open?id=1Qg0bFbfYzMh_SpuGu-rBGkeVRfeSMuOe

[Fozi]

@blaukon thanks! Will check it out.

[hayman]

@blaukon said in MagicMirror project for sister:

dded a picture of the mounted

nice work,never got the Google to work ,will try it again later

[banbutcher]

awesome stuff… if you wouldnt mind showing some config files… my assistant doesnt work aswell as yours, also with the googlemapstraffic do you need to buy an api from them of is there a free version? also the ring my phone feature is really cool, how did you achieve this?

thanks

[blaukon]

sure :-)
Uploaded my config.js and custum.css files (https://drive.google.com/open?id=16hNIqnGdpdmm9KeE-jcLGc0-fB80OpML)

You have to add your credit card to use googlemapstraffic, but you’ll have a free contingent per month which I never exceeded.
The ring my phone thingy is already implemented in the original google-assistant - as long as you use the same google account, you might have to grant the rights to use this function.

[banbutcher]

@blaukon

Thanks alot :)

[banbutcher]

hi again,

loking at your video and i was wondering how you got hotword or assistant to show the speech to txt? with mine i say the hotword followed by command which brings up the assistant rather than automatically onsceen like yours. i hope this makes sense to you!

Richie

[blaukon]

@banbutcher hey, I’m using Version 2 from https://github.com/eouia/MMM-AssistantMk2 and the newest version of https://github.com/eouia/MMM-Hotword. Removed the presence on the mirror of both when nothing is decected and I belive that’s all I’ve changed :)

[bachoo786]

@blaukon hey well done man. Amazing job.
Please help me understand the following:

1. how did you attach the monitor and the mirror together?

2. How did you hold the monitor to the frame?

3. Is the frame strong enough to hold the mirror and the monitor?
   Thanks.

[blaukon]

@bachoo786
sadly, I do not have more pictures or access to the mirror at the moment -

But I made 3d modell in tinkercad to show you the necessary construction:

front:

-> orange: mirrorglass (bigger than the hole)

-> monitor right onto the glass

backside:

the frame is massiv, about 2-2.5cm wood, I have absolutly no worries that this frame would brake by itself :)
and that’s basically how it’s mounted:

[thoeng]

Hi, I have seen the video and its great work.

I have similar setup with yours i.e.: AssistantMK2 and Kinobo USB mic (not Akiro but that mini USB one) and it is nowhere as sensitive as yours. I have to speak almost next to the microphone for the hotword to activate AssistantMK2. This reduce the mirror usability considerably.

Can you please let me know what you have done to increase the sensitivity? so far, I have increased mic to max sensitivity with ALSA mixer but still nowhere near yours.

Regards,

[blaukon]

hi, all I did is to set a higher but not too high sensitivity via alsa mixer or on desktop - right click on audio - audio input - input device settings and adjust the sesitivity:

did you test your mic? arecord test.wav -> aplay test.wav?

[thoeng]

Thanks @blaukon

Yes, i tried to raise the sensitivity via UI and Terminal. Volume from arecord is still very low.

If I replace the mic, is it direct replacement or any configuration required?

[blaukon]

if your recoding is still quiet, even when you’ve raised the sensitivity, it’s mostlikly your microphone :/
I’ve bought this one https://www.amazon.de/Kinobo-Mini-Akiro-Mikrofon-Windows/dp/B00NSOWWIS
and also one that looked like 99% the same, was cheaper, but wayyy worse in comparison.

[amsuvarna27]

@blaukon I’m doing also same project.
Sir can you please share the Back up file of this project.
I’m trying from last 3 months but unable to complete.
Please share with me.

[thoeng]

@blaukon yep its definetely the mic. I will change and reply back.

Thanks!

[bachoo786]

@blaukon hey so are you saying your mirror glass is bigger than your monitor?

I have the issue if the mirror glass is bigger than the monitor then the edge which is not covered by the monitor it needs to be painted black or covered with a black material. This causes reflection issues on the mirror from the front I.e. you can see distorted images on the edge I.e. the image looks stretched…

[blaukon]

@bachoo786
hey, as far as I can remember, the glass is slightly bigger than the monitor and the frame is also slightly bigger than the glass, no tape was used, since you only see the monitor in the frame and not the “frame” of the 27" monitor.

tried to show it graphically with my old expanded notebookdisplay: