MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    MMM-AssistantMk2

    Scheduled Pinned Locked Moved System
    421 Posts 61 Posters 630.8k Views 57 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • W Offline
      wearable9083 @Guest
      last edited by

      @sean
      After assistant-mk2 has detected hotword, no voice command has been recognized. (during video playback)
      .
      .
      [Voice commands are well recognized when the video is played through without stop.]

      ? 1 Reply Last reply Reply Quote 0
      • ? Offline
        A Former User @wearable9083
        last edited by A Former User

        @wearable9083
        Only after closing video, you can order to assistant.
        If command be allowed during video playing, Assistant will be activated by sounds of video. So during playing, Assistant is disabled.

        W 1 Reply Last reply Reply Quote 0
        • W Offline
          wearable9083 @Guest
          last edited by

          @sean
          Thank you so much. ♥♥
          I’ll make the most of the information you’ve given me. Thank you. :)
          Have a nice day!

          1 Reply Last reply Reply Quote 0
          • C Offline
            costascontis
            last edited by costascontis

            @Sean at last got MMM-AssistantMk2 up and running with MMM-Hotword.I have only one little problem,when i ask something i lose the first word of the answer.It is like hdmi sound channel is down and needs 1 sec to wake so i cant hear the first word of the answer.I add to /boot/config.txt the line “force_hdmi_open=1” but didnt help.At my standalone raspberry google assistant installation i had the same problem and this line solved it,but not here…

            ? 1 Reply Last reply Reply Quote 0
            • ? Offline
              A Former User @costascontis
              last edited by

              @costascontis
              Sorry, I have no idea about it. Maybe my module would close HDMI when it doesn’t be needed. (Standalone version could open HDMI continuously by force, because there is no need to close for other’s occupation)

              C 1 Reply Last reply Reply Quote 0
              • C Offline
                costascontis @Guest
                last edited by costascontis

                @sean it is very annoying not to listen the first word or missing the half of it,do you have an idea to keep hdmi on all the time?
                edit: if i use the .asoundrc file of my other gassistant i have no delay but the voice is choppy.

                pcm.dsnooper {
                    type dsnoop
                    ipc_key 816357492
                    ipc_key_add_uid 0
                    ipc_perm 0666
                    slave {
                        pcm "hw:1,0"
                        channels 1
                    }
                }
                
                pcm.!default {
                        type asym
                        playback.pcm {
                                type plug
                                slave.pcm "hw:0,1"
                        }
                        capture.pcm {
                                type plug
                                slave.pcm "dsnooper"
                        }
                }
                

                if i use the default .asoundrc the voice is clear but with a start delay

                pcm.!default {
                	type hw
                	card 0
                }
                
                ctl.!default {
                	type hw
                	card 0
                }
                

                with the first .asoundrc delayless file all other sounds at the Rpi are playback just fine ,only the MMM-AssistantMk2 voice is grainy and choppy… : (

                ? 1 Reply Last reply Reply Quote 0
                • ? Offline
                  A Former User @costascontis
                  last edited by A Former User

                  @costascontis
                  But in that case, Other modules cannot use speaker-out. I rather recommend to use other speaker instead HDMI.

                  1 Reply Last reply Reply Quote 0
                  • C Offline
                    costascontis
                    last edited by

                    yes i understand,i just think that is a MMM-AssistantMk2 's problem because when i trigger MMM-Hotword it makes a ding sound to show that its listening and that sound i can always hear it so hdmi is awake ,then i make a request to MMM-AssistantMk2 and when it answers i cant hear the first word or the first letters of it anyway…

                    1 Reply Last reply Reply Quote 0
                    • L Offline
                      Lowis
                      last edited by

                      Hello

                      how can MMM-AssistantMk2 start a webradio stream ? i tell the Assistant to play radio 1live. Respone is “OK” but nothing will come up.
                      I say "show me a picture from a Dog . Respone “OK” but nothing comes up.

                      BTW : Great Module !

                      ? 1 Reply Last reply Reply Quote 0
                      • ? Offline
                        A Former User @Lowis
                        last edited by A Former User

                        @lowis
                        Those features are allowed to REAL GOOGLE HOME devices at this moment. I hope somedays it could be allowed to Assistant SDK.

                        1 Reply Last reply Reply Quote 0
                        • L Offline
                          Lowis
                          last edited by

                          But a something like your youtube search and playing Should be possible for a webradio

                          ? 1 Reply Last reply Reply Quote 0
                          • ? Offline
                            A Former User @Lowis
                            last edited by

                            @lowis Youtube features are added by myself with Youtube API.

                            L 1 Reply Last reply Reply Quote 0
                            • L Offline
                              Lowis
                              last edited by Lowis

                              @Sean Yes i know. Great work ! Maybe it could expand with a webradio directory like shoutcast.com

                              1 Reply Last reply Reply Quote 0
                              • J Offline
                                Jmh474
                                last edited by Jmh474

                                I’m guessing that this question has been asked quite a few times so I’m sorry for the repeat.

                                I’ve got my mirror up and running using latest resabian, MagicMirror2, modules MMM-AssistantMk2 and MMM-HOTWORD.
                                Adding more modules soon just taking a step at a time as I’m a total beginner.

                                Seems to be running OK apart from the Google Assistant, its running so slow when asking questions and waiting for replies, and I don’t get voice response back just like a humming sound (I’m guessing this is when Google is answering), I know sound and mic are working as I can her myself talk when testing the mic.

                                Also what is the best setup for mic and speakers in using a USB sound card
                                Mic is just standard 3.5mm jack type
                                Speakers are running through a separate amp after the sound card.

                                One more this is there a way to add an Led for when the Google Assistant is listening??

                                Sorry for the long post I’m just so close

                                ? 1 Reply Last reply Reply Quote 0
                                • ? Offline
                                  A Former User @Jmh474
                                  last edited by

                                  @jmh474
                                  For slow speed, I have no idea about it. Maybe it is related with your network status. Usually others have no problem about speed.
                                  I think, it is not about speed. You just couldn’t get the response with some reason.
                                  Test like this;

                                  • Stop the pm2 (If you are using)
                                  • Execute MM with npm start dev on MagicMirror directory.
                                  • See what happens on terminal shell.
                                    There could be errors or some useful messages to examine.
                                  1 Reply Last reply Reply Quote 0
                                  • LicoriniL Offline
                                    Licorini
                                    last edited by

                                    Hello … I am a beginner, I am trying to install Mk2 following the instructions, however it presents errors as below:

                                    pi@raspberrypi:~/MagicMirror $ npm start

                                    magicmirror@2.6.0 start /home/pi/MagicMirror
                                    sh run-start.sh

                                    Starting MagicMirror: v2.6.0
                                    Loading config …
                                    Loading module helpers …
                                    No helper found for module: alert.
                                    Initializing new module helper …
                                    Module helper loaded: updatenotification
                                    WARNING! Could not load config file. Starting with default configuration. Error found: Error: Failed to load gRPC binary module because it was not installed for the current system
                                    Expected directory: electron-v2.0-linux-arm-glibc
                                    Found: [node-v64-linux-arm-glibc]
                                    This problem can often be fixed by running “npm rebuild” on the current system
                                    Original error: Cannot find module ‘/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/node/extension_binary/electron-v2.0-linux-arm-glibc/grpc_node.node’

                                    Loading module helpers …
                                    No helper found for module: alert.
                                    Initializing new module helper …
                                    Module helper loaded: updatenotification
                                    App threw an error during load
                                    Error: Failed to load gRPC binary module because it was not installed for the current system
                                    Expected directory: electron-v2.0-linux-arm-glibc
                                    Found: [node-v64-linux-arm-glibc]
                                    This problem can often be fixed by running “npm rebuild” on the current system
                                    Original error: Cannot find module ‘/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/node/extension_binary/electron-v2.0-linux-arm-glibc/grpc_node.node’
                                    at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:53:17)
                                    at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:63:3)
                                    at Module._compile (module.js:642:30)
                                    at Object.Module._extensions…js (module.js:653:10)
                                    at Module.load (module.js:561:32)
                                    at tryModuleLoad (module.js:504:12)
                                    at Function.Module._load (module.js:496:3)
                                    at Module.require (module.js:586:17)
                                    at require (internal/module.js:11:18)
                                    at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/client_interceptors.js:144:12)
                                    Whoops! There was an uncaught exception…
                                    { Error: Failed to load gRPC binary module because it was not installed for the current system
                                    Expected directory: electron-v2.0-linux-arm-glibc
                                    Found: [node-v64-linux-arm-glibc]
                                    This problem can often be fixed by running “npm rebuild” on the current system
                                    Original error: Cannot find module ‘/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/node/extension_binary/electron-v2.0-linux-arm-glibc/grpc_node.node’
                                    at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:53:17)
                                    at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:63:3)
                                    at Module._compile (module.js:642:30)
                                    at Object.Module._extensions…js (module.js:653:10)
                                    at Module.load (module.js:561:32)
                                    at tryModuleLoad (module.js:504:12)
                                    at Function.Module._load (module.js:496:3)
                                    at Module.require (module.js:586:17)
                                    at require (internal/module.js:11:18)
                                    at Object. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/client_interceptors.js:144:12) code: ‘MODULE_NOT_FOUND’ }
                                    MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
                                    If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
                                    Launching application.

                                    Can someone help me ??

                                    ? 1 Reply Last reply Reply Quote 0
                                    • L Offline
                                      Lowis @Guest
                                      last edited by

                                      @sean but how can i setup the notification to start play MMM_Webradio ?

                                      MMM_Webradio has this notifications :

                                      WEBRADIO_ONOFF Starts / Pauses playback
                                      WEBRADIO_VOLUP Volume up by 5%
                                      WEBRADIO_VOLDOWN Volume down by 5%
                                      WEBRADIO_NEXT Next station
                                      WEBRADIO_PREV Previous station

                                      ? 1 Reply Last reply Reply Quote 0
                                      • ? Offline
                                        A Former User @Licorini
                                        last edited by

                                        @licorini
                                        You’ve missed or failed electron-rebuild step. Do it with instruction on README

                                        1 Reply Last reply Reply Quote 0
                                        • ? Offline
                                          A Former User @Lowis
                                          last edited by

                                          @lowis
                                          There are two options to make custom commands - transcriptionHook and gAction.

                                          I’ll explain with transcriptionHook because it is easier (but limited)
                                          first. define hook phrase.

                                          transcriptionHook: {
                                            "RADIO": {
                                              pattern: "my radio",  // When you say "my radio",
                                              command: "RADIO_ONOFF" // command "RADIO_ONOFF" will be executed
                                            },
                                            ... // if you need more hooks, add here.
                                          }
                                          

                                          Then, Let’s make command RADIO_ONOFF to emit notification when your voice is hooked.

                                          command: {
                                            "RADIO_ONOFF": {
                                              notificationExec: {
                                                notification: "WEBRADIO_ONOFF",
                                              },
                                            },
                                            ... // if you need more commands, add here.
                                          },
                                          

                                          Now, when you say “my radio” in your voice order, “RADIO_ONOFF” command will be executed to send notification “WEBRADIO_ONOFF”.

                                          But, I think there could be a problem to use webradio. Because your radio sound will interrupt HOTWORD or AMK2 occasionally, it could make unintended misbehaviours. Anyway, I wish you good luck.

                                          L 1 Reply Last reply Reply Quote 0
                                          • L Offline
                                            Lowis @Guest
                                            last edited by

                                            @sean thank you very much for the detailed information . Webradio is running !

                                            1 Reply Last reply Reply Quote 0

                                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                            With your input, this post could be even better 💗

                                            Register Login
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 6
                                            • 21
                                            • 22
                                            • 4 / 22
                                            • First post
                                              Last post
                                            Enjoying MagicMirror? Please consider a donation!
                                            MagicMirror created by Michael Teeuw.
                                            Forum managed by Sam, technical setup by Karsten.
                                            This forum is using NodeBB as its core | Contributors
                                            Contact | Privacy Policy