MMM-AssistantMk2 (v3)

nakedrabbit

Thanks so much for the new version! I know you guys are working hard on this, I love the plugin, and I appreciate everything that went into making it.

Unfortunately I still have some more issues, and they seem memory related this time around as well. To recap: I’m on a Pi 3B with latest MM, but still on Raspbian Stretch.

I cleared out the old AssistantMk2 and pulled the new version from scratch. Though I used the autoinstaller, I still had to manually rebuild electron…? That’s OK, though, because it did work fine.

I used both recommended config options , namely
useHTML5: false,
playProgram: “mpg321”,

Everything seems OK, and my first test yesterday worked great. I asked a simple question, “What time is it?” and got the answer and all worked great. I left it on overnight, but today Hotword does not summon the plugin. I get these messages from PM2 log:

0|mm | [HOTWORD] Detector starts listening.
0|mm | [HOTWORD] Detected: SMARTMIRROR
0|mm | [HOTWORD] stops.
0|mm | [HOTWORD] After Recording is too short
0|mm | [HOTWORD] Final Result: { detected: true, hotword: ‘SMARTMIRROR’, file: null }

And the corresponding error messages:

0|mm | at Module._compile (internal/modules/cjs/loader.js:678:28)
0|mm | at Object.Module._extensions…js (internal/modules/cjs/loader.js:722:10)
0|mm | at Module.load (internal/modules/cjs/loader.js:620:32)
0|mm | at tryModuleLoad (internal/modules/cjs/loader.js:559:12)
0|mm | at Function.Module._load (internal/modules/cjs/loader.js:551:3)
0|mm | at Module.require (internal/modules/cjs/loader.js:658:17)
0|mm | at require (internal/modules/cjs/helpers.js:20:18)
0|mm | mmap() failed: Cannot allocate memory
0|mm | Failed to create permanent mapping for memfd region with ID = 775865347
0|mm | Failed to regester memfd mempool. Reason: could not attach memfd SHM ID to pipe
0|mm | mmap() failed: Cannot allocate memory
0|mm | Failed to create permanent mapping for memfd region with ID = 3943571786
0|mm | mmap() failed: Cannot allocate memory
0|mm | Failed to create permanent mapping for memfd region with ID = 2623177707
0|mm | Ignoring received block reference with non-registered memfd ID = 2623177707

I gave you all 15 lines in case there’s something there.

So I stopped MM entirely, started again. Hotword brought up AssistantMk2, but only once, with identical error messages. Once the plugin told me it did not understand, it was unresponsive to my voice.

pnobrega

@Sean what files need to be translated?
I can do a Pt-pt translation ;)

A Former User

@pnobrega

This module needs two kinds of translations.
Basic terms used by the module.
https://github.com/eouia/MMM-AssistantMk2/tree/master/translations
Error messages or some basic text would be used by the module itself. You can contribute by translating these files.
Send us translation direclty.
Or make a fork from the original github repository to your own repository. Add your work, then make Pull Request(PR) to the original repository. If the original author( - we) accept it, your working will be merged into the original repository.
vocal patterns for locale on recipes.
Recipe also might needs some translations. For example, with-MMM-Youtube.js recipe (https://github.com/eouia/MMM-AssistantMk2/blob/master/recipes/with-MMM-Youtube.js) is written in English. So, stop video as a pattern of transcriptionHook is used. If you could provide with-MMM-Youtube.PT_BR.js with translation of stop video, send us directly or make a PR as I’ve said above.

pnobrega

@Sean i’m gonna install now the module. After installed I’ll translate it.
Wanna see context for better translate.

I’ll send you the files after

pnobrega

hi.
What am i missing here?

https://ibb.co/TcH3MHF

current config never works. I’m shown 2 devices

card 0: Generic [HD-Audio Generic], device 3: HDMI 0 [HDMI 0]
card 1: SB [HDA ATI SB], device 0: ALC269VB Analog [ALC269VB Analog]

i’ve choosen different settings but never works.
Sound it working good cause i hear it from youtube. Speakers are from the monitor through hdmi

A Former User

Hi, I wrote audio script with play plughw. If don’t work try manually to find your configuration

Kevinho195

Hi @Sean
I just updated from 3.0 to the latest version. I did git pull and npm install and did create the token.json again and store it as decribed in your manual. Version 3.0 did work great, but now I get this error: What am I doing wrong?

0|MagicMirror  | [21:35:32.002] [LOG]    
0|MagicMirror  | Starting MagicMirror: v2.10.0
0|MagicMirror  | [21:35:32.032] [LOG]    
0|MagicMirror  | Loading config ...
0|MagicMirror  | [21:35:32.071] [LOG]    
0|MagicMirror  | Loading module helpers ...
0|MagicMirror  | [21:35:32.078] [LOG]    
0|MagicMirror  | No helper found for module: MMM-pages.
0|MagicMirror  | [21:35:36.901] [ERROR]  
0|MagicMirror  | WARNING! Could not load config file. Starting with default configuration. Error found: Error: Cannot find module 'play-sound'
0|MagicMirror  | [21:35:36.903] [LOG]    Loading module helpers ...
0|MagicMirror  | [21:35:36.906] [LOG]    No helper found for module: MMM-pages.
0|MagicMirror  | [21:35:36.913] [ERROR]  App threw an error during load
0|MagicMirror  | [21:35:36.919] [ERROR]  Error: Cannot find module 'play-sound'
0|MagicMirror  |     at Module._resolveFilename (internal/modules/cjs/loader.js:602:15)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/electron/dist/resources/electron.asar/common/reset-search-paths.js:35:12)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/module-alias/index.js:49:29)
0|MagicMirror  |     at Function.Module._load (internal/modules/cjs/loader.js:528:25)
0|MagicMirror  |     at Module.require (internal/modules/cjs/loader.js:658:17)
0|MagicMirror  |     at require (internal/modules/cjs/helpers.js:20:18)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:12:19)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:201:3)
0|MagicMirror  |     at Module._compile (internal/modules/cjs/loader.js:711:30)
0|MagicMirror  |     at Object.Module._extensions..js (internal/modules/cjs/loader.js:722:10)
0|MagicMirror  | [21:35:36.939] [LOG]    
0|MagicMirror  | Whoops! There was an uncaught exception...
0|MagicMirror  | [21:35:36.941] [ERROR]  
0|MagicMirror  | { Error: Cannot find module 'play-sound'
0|MagicMirror  |     at Module._resolveFilename (internal/modules/cjs/loader.js:602:15)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/electron/dist/resources/electron.asar/common/reset-search-paths.js:35:12)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/module-alias/index.js:49:29)
0|MagicMirror  |     at Function.Module._load (internal/modules/cjs/loader.js:528:25)
0|MagicMirror  |     at Module.require (internal/modules/cjs/loader.js:658:17)
0|MagicMirror  |     at require (internal/modules/cjs/helpers.js:20:18)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:12:19)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:201:3)
0|MagicMirror  |     at Module._compile (internal/modules/cjs/loader.js:711:30)
0|MagicMirror  |     at Object.Module._extensions..js (internal/modules/cjs/loader.js:722:10) code: 'MODULE_NOT_FOUND' }
0|MagicMirror  | [21:35:36.975] [LOG]    MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|MagicMirror  | [21:35:36.977] [LOG]    If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
0|MagicMirror  | Fontconfig error: "/home/pi/.config/fontconfig/fonts.conf", line 10: junk after document element
0|MagicMirror  | [21:35:37.852] [LOG]    
0|MagicMirror  | Launching application.

A Former User

Try this :

cd ~/MagicMirror/modules/MMM-AssistantMk2

./update

I think package. Json and package-lock. Json are outdated. I wrote a script for this ;)

Kevinho195

@Bugsounet thanks for your help :)

A Former User

We have updated AMk2 to v3.1.0-2
Changes:

Standby icon Touch to activate assistant
AMk2 is now prepared to receive addons

Note: I prepare sample and template addons.
Coming soon ;)
Just a little patience and I will come back to you for the addons

EDIT
Addons repository is now online

nakedrabbit

New version installed fine for me, though I did not git pull, just wiped the old one off. Installer worked great, and I no longer have to rebuild electron afterwards, as I did previously. Everything worked great.

HOWEVER

I still can’t get much action out of the plugin. Here’s my latest error dump:

[AMK2] MMM-AssistantMk2 Version: 3.1.0-3
0|mm | [AMK2] AssistantMk2 is initialized.
0|mm | [HOTWORD] begins.
0|mm | [HOTWORD] Detector starts listening.
0|mm | [HOTWORD] Detected: SMARTMIRROR
0|mm | [HOTWORD] After Recording: 4000
0|mm | [HOTWORD] After Recording: 4000
0|mm | [HOTWORD] After Recording: 4000
0|mm | [HOTWORD] After Recording: 4000
0|mm | [HOTWORD] stops.
0|mm | [HOTWORD] After Recording finised. size: 16050
0|mm | [HOTWORD:B2W] WAV_FILE_CREATED: /home/pi/MagicMirror/modules/MMM-Hotword/temp/afterRecording.wav 16050
0|mm | [HOTWORD] Final Result: { detected: true,
0|mm | hotword: ‘SMARTMIRROR’,
0|mm | file: ‘temp/afterRecording.wav’ }

Seems to indicate Hotword is the problem…?

Here are the last 15 errors:

0|mm | at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/components/assistant.js:235:3)
0|mm | at Module._compile (internal/modules/cjs/loader.js:711:30)
0|mm | at Object.Module._extensions…js (internal/modules/cjs/loader.js:722:10)
0|mm | at Module.load (internal/modules/cjs/loader.js:620:32)
0|mm | { Error: Cannot find module ‘google-assistant’
0|mm | at Module._resolveFilename (internal/modules/cjs/loader.js:602:15)
0|mm | at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/electron/dist/resources/electron.asar/common/reset-search-paths.js:35:12)
0|mm | at Function.Module._load (internal/modules/cjs/loader.js:528:25)
0|mm | at Module.require (internal/modules/cjs/loader.js:658:17)
0|mm | at require (internal/modules/cjs/helpers.js:20:18)
0|mm | at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/components/assistant.js:1:180)
0|mm | at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/components/assistant.js:235:3)
0|mm | at Module._compile (internal/modules/cjs/loader.js:711:30)
0|mm | at Object.Module._extensions…js (internal/modules/cjs/loader.js:722:10)
0|mm | at Module.load (internal/modules/cjs/loader.js:620:32) code: ‘MODULE_NOT_FOUND’ }

Triggered the module with MMM-Buttons, but when I do that, AssistantMk2 just waits and doesn’t listen, finally timing out.

A Former User

hi, google-assistant module is not installed.

try this:

cd ~/MagicMirror/modules/MMM-AssistantMk2
npm install

and execute electron rebuild :)

nakedrabbit

Yes, that seems obvious, but I did, in fact, follow the installation instructions, so I’m not sure why I have this error message either… left over from an aborted earlier attempt?

In addition I took out Hotword and used your fine snowboy addon. Exactly the same effect, so I must have something wrong with my general setup… still testing…

Thanks for your patience!

A Former User

@nakedrabbit : oupss, i have not seen your post :(
maybe your problem is now solved…

A Former User

MMM-AssisantMk2 v3.1.1-1

3.1.1-1 (05/03/2020)

BUG: correct audio cutting response for mpg321 (test)
ADD: add cvlc audio out support (vlc using)

3.1.1-0 (02/03/2020)

ADD: add new function for addons-recipe (socketExec, onSocketExec)
BUG: continous conversation bug - infinite loop on no user response
BUG: double chimed on TRANSCRIPTION_FAILS retry
ADD: ability to set no chime on activate assistant
ADD: touching the keyword “try to say” activates the assistant for the suggested search (Fullscreen and Classic2 ui)
ADD: ASSISTANT_WEB server for activate with keyword
MOTIFY : search KEYWORD/ TRYTOSAY translation script to improve performance
BUG: correct screen parser log

Assistant2Display v1.0.0

addons of AMk2 to display result links and photos of assistant search

credits:

@Sean
@bugsounet

Addons repository updated

see addon repository for more information ;)

Good assistant to you !

@bugsounet, @Sean

Serge

@Bugsounet said in MMM-AssistantMk2 (v3):

MMM-AssisantMk2 v3.1.1-1

Excellent updates!
@Bugsounet could you please explain in a few words the functionality of these two features:

ADD: ASSISTANT_WEB server for activate with keyword
MOTIFY : search KEYWORD/ TRYTOSAY translation script to improve performance

I have looked briefly on module’s wiki and did not found what do they mean.

A Former User

@Serge said in MMM-AssistantMk2 (v3):

ASSISTANT_WEB server

internal server to activate assistant with http://127.0.0.1:8080/activatebytext/?query='your request'
it’s used in Fullscreen ui for touch help response screen word to active assistant with it

KEYWORD/ TRYTOSAY

script to search and store
try to say... translation
keyword is help word if found

it’s used in Classic 2 ui

A Former User

MMM-AssisantMk2 v3.1.1-2

3.1.1-2 (06/03/2020)

ADD/MODIFY: ui: "Fullscreen"
- position: "fullscreen_above" is now ui like Google Home
MODIFY: user interface priority order Assistant2Display -> AMk2
ADD: move native sound to class

Serge

@Bugsounet got it. thanx for quick reply. will test shortly

athavanraja

@Bugsounet Hi I am on version 3.0.2 and trying to update to latest version.
Running npm run update at ~/MagicMirror/modules/MMM-AssistantMk2 gives the following error message

pi@raspberrypi:~/MagicMirror/modules/MMM-AssistantMk2 $ npm run update
npm ERR! missing script: update

npm ERR! A complete log of this run can be found in:
npm ERR! /home/pi/.npm/_logs/2020-03-15T18_41_39_806Z-debug.log

Any help is highly appreciated.

Thanks.