MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    MMM-AssistantMk2 (v3)

    Scheduled Pinned Locked Moved System
    135 Posts 27 Posters 84.9k Views 25 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ? Offline
      A Former User
      last edited by

      From V3.0.x to V3.1.x: npm install is needed
      check wiki for new features configuration

      1 Reply Last reply Reply Quote 0
      • N Offline
        nakedrabbit
        last edited by

        Thanks so much for the new version! I know you guys are working hard on this, I love the plugin, and I appreciate everything that went into making it.

        Unfortunately I still have some more issues, and they seem memory related this time around as well. To recap: I’m on a Pi 3B with latest MM, but still on Raspbian Stretch.

        I cleared out the old AssistantMk2 and pulled the new version from scratch. Though I used the autoinstaller, I still had to manually rebuild electron…? That’s OK, though, because it did work fine.

        I used both recommended config options , namely
        useHTML5: false,
        playProgram: “mpg321”,

        Everything seems OK, and my first test yesterday worked great. I asked a simple question, “What time is it?” and got the answer and all worked great. I left it on overnight, but today Hotword does not summon the plugin. I get these messages from PM2 log:

        0|mm | [HOTWORD] Detector starts listening.
        0|mm | [HOTWORD] Detected: SMARTMIRROR
        0|mm | [HOTWORD] stops.
        0|mm | [HOTWORD] After Recording is too short
        0|mm | [HOTWORD] Final Result: { detected: true, hotword: ‘SMARTMIRROR’, file: null }

        And the corresponding error messages:

        0|mm | at Module._compile (internal/modules/cjs/loader.js:678:28)
        0|mm | at Object.Module._extensions…js (internal/modules/cjs/loader.js:722:10)
        0|mm | at Module.load (internal/modules/cjs/loader.js:620:32)
        0|mm | at tryModuleLoad (internal/modules/cjs/loader.js:559:12)
        0|mm | at Function.Module._load (internal/modules/cjs/loader.js:551:3)
        0|mm | at Module.require (internal/modules/cjs/loader.js:658:17)
        0|mm | at require (internal/modules/cjs/helpers.js:20:18)
        0|mm | mmap() failed: Cannot allocate memory
        0|mm | Failed to create permanent mapping for memfd region with ID = 775865347
        0|mm | Failed to regester memfd mempool. Reason: could not attach memfd SHM ID to pipe
        0|mm | mmap() failed: Cannot allocate memory
        0|mm | Failed to create permanent mapping for memfd region with ID = 3943571786
        0|mm | mmap() failed: Cannot allocate memory
        0|mm | Failed to create permanent mapping for memfd region with ID = 2623177707
        0|mm | Ignoring received block reference with non-registered memfd ID = 2623177707

        I gave you all 15 lines in case there’s something there.

        So I stopped MM entirely, started again. Hotword brought up AssistantMk2, but only once, with identical error messages. Once the plugin told me it did not understand, it was unresponsive to my voice.

        1 Reply Last reply Reply Quote 0
        • P Offline
          pnobrega
          last edited by

          @Sean what files need to be translated?
          I can do a Pt-pt translation ;)

          ? 1 Reply Last reply Reply Quote 0
          • ? Offline
            A Former User @pnobrega
            last edited by

            @pnobrega

            This module needs two kinds of translations.
            Basic terms used by the module.
            https://github.com/eouia/MMM-AssistantMk2/tree/master/translations
            Error messages or some basic text would be used by the module itself. You can contribute by translating these files.
            Send us translation direclty.
            Or make a fork from the original github repository to your own repository. Add your work, then make Pull Request(PR) to the original repository. If the original author( - we) accept it, your working will be merged into the original repository.
            vocal patterns for locale on recipes.
            Recipe also might needs some translations. For example, with-MMM-Youtube.js recipe (https://github.com/eouia/MMM-AssistantMk2/blob/master/recipes/with-MMM-Youtube.js) is written in English. So, stop video as a pattern of transcriptionHook is used. If you could provide with-MMM-Youtube.PT_BR.js with translation of stop video, send us directly or make a PR as I’ve said above.

            P 1 Reply Last reply Reply Quote 0
            • P Offline
              pnobrega @Guest
              last edited by

              @Sean i’m gonna install now the module. After installed I’ll translate it.
              Wanna see context for better translate.

              I’ll send you the files after

              1 Reply Last reply Reply Quote 0
              • P Offline
                pnobrega
                last edited by

                hi.
                What am i missing here?

                https://ibb.co/TcH3MHF

                current config never works. I’m shown 2 devices

                card 0: Generic [HD-Audio Generic], device 3: HDMI 0 [HDMI 0]
                card 1: SB [HDA ATI SB], device 0: ALC269VB Analog [ALC269VB Analog]

                i’ve choosen different settings but never works.
                Sound it working good cause i hear it from youtube. Speakers are from the monitor through hdmi

                1 Reply Last reply Reply Quote 0
                • ? Offline
                  A Former User
                  last edited by

                  Hi, I wrote audio script with play plughw. If don’t work try manually to find your configuration

                  1 Reply Last reply Reply Quote 0
                  • K Offline
                    Kevinho195
                    last edited by

                    Hi @Sean
                    I just updated from 3.0 to the latest version. I did git pull and npm install and did create the token.json again and store it as decribed in your manual. Version 3.0 did work great, but now I get this error: What am I doing wrong?

                    0|MagicMirror  | [21:35:32.002] [LOG]    
0|MagicMirror  | Starting MagicMirror: v2.10.0
0|MagicMirror  | [21:35:32.032] [LOG]    
0|MagicMirror  | Loading config ...
0|MagicMirror  | [21:35:32.071] [LOG]    
0|MagicMirror  | Loading module helpers ...
0|MagicMirror  | [21:35:32.078] [LOG]    
0|MagicMirror  | No helper found for module: MMM-pages.
0|MagicMirror  | [21:35:36.901] [ERROR]  
0|MagicMirror  | WARNING! Could not load config file. Starting with default configuration. Error found: Error: Cannot find module 'play-sound'
0|MagicMirror  | [21:35:36.903] [LOG]    Loading module helpers ...
0|MagicMirror  | [21:35:36.906] [LOG]    No helper found for module: MMM-pages.
0|MagicMirror  | [21:35:36.913] [ERROR]  App threw an error during load
0|MagicMirror  | [21:35:36.919] [ERROR]  Error: Cannot find module 'play-sound'
0|MagicMirror  |     at Module._resolveFilename (internal/modules/cjs/loader.js:602:15)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/electron/dist/resources/electron.asar/common/reset-search-paths.js:35:12)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/module-alias/index.js:49:29)
0|MagicMirror  |     at Function.Module._load (internal/modules/cjs/loader.js:528:25)
0|MagicMirror  |     at Module.require (internal/modules/cjs/loader.js:658:17)
0|MagicMirror  |     at require (internal/modules/cjs/helpers.js:20:18)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:12:19)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:201:3)
0|MagicMirror  |     at Module._compile (internal/modules/cjs/loader.js:711:30)
0|MagicMirror  |     at Object.Module._extensions..js (internal/modules/cjs/loader.js:722:10)
0|MagicMirror  | [21:35:36.939] [LOG]    
0|MagicMirror  | Whoops! There was an uncaught exception...
0|MagicMirror  | [21:35:36.941] [ERROR]  
0|MagicMirror  | { Error: Cannot find module 'play-sound'
0|MagicMirror  |     at Module._resolveFilename (internal/modules/cjs/loader.js:602:15)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/electron/dist/resources/electron.asar/common/reset-search-paths.js:35:12)
0|MagicMirror  |     at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/module-alias/index.js:49:29)
0|MagicMirror  |     at Function.Module._load (internal/modules/cjs/loader.js:528:25)
0|MagicMirror  |     at Module.require (internal/modules/cjs/loader.js:658:17)
0|MagicMirror  |     at require (internal/modules/cjs/helpers.js:20:18)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:12:19)
0|MagicMirror  |     at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:201:3)
0|MagicMirror  |     at Module._compile (internal/modules/cjs/loader.js:711:30)
0|MagicMirror  |     at Object.Module._extensions..js (internal/modules/cjs/loader.js:722:10) code: 'MODULE_NOT_FOUND' }
0|MagicMirror  | [21:35:36.975] [LOG]    MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|MagicMirror  | [21:35:36.977] [LOG]    If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
0|MagicMirror  | Fontconfig error: "/home/pi/.config/fontconfig/fonts.conf", line 10: junk after document element
0|MagicMirror  | [21:35:37.852] [LOG]    
0|MagicMirror  | Launching application.
                    1 Reply Last reply Reply Quote 0
                    • ? Offline
                      A Former User
                      last edited by A Former User

                      Try this :

                      cd ~/MagicMirror/modules/MMM-AssistantMk2

./update

                      I think package. Json and package-lock. Json are outdated. I wrote a script for this ;)

                      K 1 Reply Last reply Reply Quote 0
                      • K Offline
                        Kevinho195 @Guest
                        last edited by

                        @Bugsounet thanks for your help :)

                        1 Reply Last reply Reply Quote 0
                        • ? Offline
                          A Former User
                          last edited by A Former User

                          We have updated AMk2 to v3.1.0-2
                          Changes:

                          • Standby icon Touch to activate assistant
                          • AMk2 is now prepared to receive addons

                          Note: I prepare sample and template addons.
                          Coming soon ;)
                          Just a little patience and I will come back to you for the addons

                          EDIT
                          Addons repository is now online

                          1 Reply Last reply Reply Quote 1
                          • N Offline
                            nakedrabbit
                            last edited by

                            New version installed fine for me, though I did not git pull, just wiped the old one off. Installer worked great, and I no longer have to rebuild electron afterwards, as I did previously. Everything worked great.

                            HOWEVER

                            I still can’t get much action out of the plugin. Here’s my latest error dump:

                            [AMK2] MMM-AssistantMk2 Version: 3.1.0-3
                            0|mm | [AMK2] AssistantMk2 is initialized.
                            0|mm | [HOTWORD] begins.
                            0|mm | [HOTWORD] Detector starts listening.
                            0|mm | [HOTWORD] Detected: SMARTMIRROR
                            0|mm | [HOTWORD] After Recording: 4000
                            0|mm | [HOTWORD] After Recording: 4000
                            0|mm | [HOTWORD] After Recording: 4000
                            0|mm | [HOTWORD] After Recording: 4000
                            0|mm | [HOTWORD] stops.
                            0|mm | [HOTWORD] After Recording finised. size: 16050
                            0|mm | [HOTWORD:B2W] WAV_FILE_CREATED: /home/pi/MagicMirror/modules/MMM-Hotword/temp/afterRecording.wav 16050
                            0|mm | [HOTWORD] Final Result: { detected: true,
                            0|mm | hotword: ‘SMARTMIRROR’,
                            0|mm | file: ‘temp/afterRecording.wav’ }

                            Seems to indicate Hotword is the problem…?

                            Here are the last 15 errors:

                            0|mm | at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/components/assistant.js:235:3)
                            0|mm | at Module._compile (internal/modules/cjs/loader.js:711:30)
                            0|mm | at Object.Module._extensions…js (internal/modules/cjs/loader.js:722:10)
                            0|mm | at Module.load (internal/modules/cjs/loader.js:620:32)
                            0|mm | { Error: Cannot find module ‘google-assistant’
                            0|mm | at Module._resolveFilename (internal/modules/cjs/loader.js:602:15)
                            0|mm | at Function.Module._resolveFilename (/home/pi/MagicMirror/node_modules/electron/dist/resources/electron.asar/common/reset-search-paths.js:35:12)
                            0|mm | at Function.Module._load (internal/modules/cjs/loader.js:528:25)
                            0|mm | at Module.require (internal/modules/cjs/loader.js:658:17)
                            0|mm | at require (internal/modules/cjs/helpers.js:20:18)
                            0|mm | at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/components/assistant.js:1:180)
                            0|mm | at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/components/assistant.js:235:3)
                            0|mm | at Module._compile (internal/modules/cjs/loader.js:711:30)
                            0|mm | at Object.Module._extensions…js (internal/modules/cjs/loader.js:722:10)
                            0|mm | at Module.load (internal/modules/cjs/loader.js:620:32) code: ‘MODULE_NOT_FOUND’ }

                            Triggered the module with MMM-Buttons, but when I do that, AssistantMk2 just waits and doesn’t listen, finally timing out.

                            1 Reply Last reply Reply Quote 0
                            • ? Offline
                              A Former User
                              last edited by A Former User

                              hi, google-assistant module is not installed.

                              try this:

                              cd ~/MagicMirror/modules/MMM-AssistantMk2
npm install

                              and execute electron rebuild :)

                              1 Reply Last reply Reply Quote 0
                              • N Offline
                                nakedrabbit
                                last edited by

                                Yes, that seems obvious, but I did, in fact, follow the installation instructions, so I’m not sure why I have this error message either… left over from an aborted earlier attempt?

                                In addition I took out Hotword and used your fine snowboy addon. Exactly the same effect, so I must have something wrong with my general setup… still testing…

                                Thanks for your patience!

                                1 Reply Last reply Reply Quote 0
                                • ? Offline
                                  A Former User
                                  last edited by A Former User

                                  @nakedrabbit : oupss, i have not seen your post :(
                                  maybe your problem is now solved…

                                  1 Reply Last reply Reply Quote 0
                                  • ? Offline
                                    A Former User
                                    last edited by A Former User

                                    MMM-AssisantMk2 v3.1.1-1

                                    3.1.1-1 (05/03/2020)

                                    • BUG: correct audio cutting response for mpg321 (test)
                                    • ADD: add cvlc audio out support (vlc using)

                                    3.1.1-0 (02/03/2020)

                                    • ADD: add new function for addons-recipe (socketExec, onSocketExec)
                                    • BUG: continous conversation bug - infinite loop on no user response
                                    • BUG: double chimed on TRANSCRIPTION_FAILS retry
                                    • ADD: ability to set no chime on activate assistant
                                    • ADD: touching the keyword “try to say” activates the assistant for the suggested search (Fullscreen and Classic2 ui)
                                    • ADD: ASSISTANT_WEB server for activate with keyword
                                    • MOTIFY : search KEYWORD/ TRYTOSAY translation script to improve performance
                                    • BUG: correct screen parser log

                                    Assistant2Display v1.0.0

                                    addons of AMk2 to display result links and photos of assistant search

                                    credits:

                                    • @Sean
                                    • @bugsounet

                                    Addons repository updated

                                    see addon repository for more information ;)

                                    Good assistant to you !

                                    @bugsounet, @Sean

                                    SergeS 1 Reply Last reply Reply Quote 0
                                    • SergeS Offline
                                      Serge @Guest
                                      last edited by

                                      @Bugsounet said in MMM-AssistantMk2 (v3):

                                      MMM-AssisantMk2 v3.1.1-1

                                      Excellent updates!
                                      @Bugsounet could you please explain in a few words the functionality of these two features:

                                      • ADD: ASSISTANT_WEB server for activate with keyword
                                      • MOTIFY : search KEYWORD/ TRYTOSAY translation script to improve performance

                                      I have looked briefly on module’s wiki and did not found what do they mean.

                                      1 Reply Last reply Reply Quote 0
                                      • ? Offline
                                        A Former User
                                        last edited by A Former User

                                        @Serge said in MMM-AssistantMk2 (v3):

                                        ASSISTANT_WEB server

                                        internal server to activate assistant with http://127.0.0.1:8080/activatebytext/?query='your request'
                                        it’s used in Fullscreen ui for touch help response screen word to active assistant with it

                                        KEYWORD/ TRYTOSAY

                                        script to search and store
                                        try to say... translation
                                        keyword is help word if found

                                        it’s used in Classic 2 ui

                                        1 Reply Last reply Reply Quote 0
                                        • ? Offline
                                          A Former User
                                          last edited by

                                          MMM-AssisantMk2 v3.1.1-2

                                          3.1.1-2 (06/03/2020)

                                          • ADD/MODIFY: ui: "Fullscreen"
                                            • position: "fullscreen_above" is now ui like Google Home
                                          • MODIFY: user interface priority order Assistant2Display -> AMk2
                                          • ADD: move native sound to class
                                          SergeS A 2 Replies Last reply Reply Quote 0
                                          • SergeS Offline
                                            Serge @Guest
                                            last edited by

                                            @Bugsounet got it. thanx for quick reply. will test shortly

                                            1 Reply Last reply Reply Quote 0

                                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                            With your input, this post could be even better 💗

                                            Register Login
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 6
                                            • 7
                                            • 3 / 7
                                            • First post
                                              Last post
                                            Enjoying MagicMirror? Please consider a donation!
                                            MagicMirror created by Michael Teeuw.
                                            Forum managed by Sam, technical setup by Karsten.
                                            This forum is using NodeBB as its core | Contributors
                                            Contact | Privacy Policy