Assistant with screen

[A Former User]

I’m back!

9 months ago, I released MMM-Assistant. But it was notorious for its difficulty of maintenance and installation, due to my lack of skills.
I was so disappointed with limits of early Google’s API and the problems in Electron. And my real world job makes me so busy not to support my hobby enough. So I have half forgotten it and it was abandoned from me.
Sorry to everyone. (and special thanks to @E3V3A)

Anyway, from last week I’ve been making my 3rd Mirrorless Mirror. I’ve found I have to improve my old voice module.

Prototype demo (youtube)

• pure javascript (no other python program or daemon needed)
• easier installation (than my prior)
• hotword detection and GA module are separated. (for better maintenance and other method to wakeup)
• command module removed (use gactions or ifttt or webhooking instead)
• screen output enabled!!! (like google home with the screen. But somewhat limited)
• multi-profile supported. Every family can get their own assistant with own account.

To do(before release)

• YouTube playing(originally not supported)
• notification trigger for other modules
• some dedicated gactions process

Problem and wanted
-I have no rpi so I’m building it on ATB. But after Mm 2.4, there is an electron issue for ATB. So currently I run it with Serveronly mode, not kiosk mode. I need who has interest and experienced in node compiling(especially electron rebuild) for help.

Thanx!

[Mykle1]

@sean

Hey! Welcome back, Sean!

[sero]

Very interesting :)
I’ll try to get my setup up-to-date in the upcoming weeks. Afterwards I could happily give your beta a test run 😎

[A Former User]

Not yet publicly released(however, it is opened in github. :D), but if there is anyone who wants to test,
Please check here.

MMM-AssistantMk2

And it might be good to use with these modules.

• MMM-Hotword : For voice invocation like Jarvis!
• MMM-NotificationTrigger : For relaying notification with other modules (eg. From MMM-Hotword to MMM-AssistantMk2 for invocation, or From MMM-AssistantMk2 to MMM-remote-controller for commanding)
• MMM-GAction : Instruction and sample for custom Assistant commands.

[A Former User]

Voice commands demo. It shows 3 ways to command by voice. - transcription hooking, IFTTT, custom gaction (linked to youtube clip, click image)

It can support multi-accounts or multi-languages. It means, your family can use Assistant personally with this module. (linked to youtube clip, click image)

[A Former User]

Last demo for

• continuousConversation
• use Calendar, shopping list
• And youtube playing…

Ok, almost done. :D

[Sun]

This is fantastic. Hope will come with full guide and instruction in each step.

[A Former User]

RPI & Kiosk mode is tested. and I added some tiny features for touchscreen.

If you want to run this module on the Kiosk mode, you should rebuild some module for matching electron version. See Installation.