MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    MMM-AssistantMk2

    Scheduled Pinned Locked Moved System
    421 Posts 61 Posters 630.8k Views 57 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ? Offline
      A Former User @jomwells
      last edited by

      @jomwells
      You can fork my repository to yours and modify it.
      When you want to relay status to other modules, add .sendNotification() in ’socketNotificationReceived()’ of AssistantMk2.js where proper event is located.
      When you want to do something directly, add your job in ’Conversation.on(EVENT)’ of node_helper.js.

      1 Reply Last reply Reply Quote 0
      • S Offline
        Sun
        last edited by

        1. What else do I need to do for install for mmm-assistantmk2 to play youtube.

        2. I try the same command say Celine Dion The power of love. Then pop up below detail about Celine Dion and the youtube video automatically pop up but cannot play anything.

        3. My magic mirror is vertical mode, rotate = 1 . I try to adjust from your height 480 width 854 of display but it also show in vertical mode height 480 with 640 also height 640 width 480. No different.

        ? 1 Reply Last reply Reply Quote 0
        • ? Offline
          A Former User @Sun
          last edited by

          @sun

          • Some youtube videos are not allowed for embedded player.
          • some videos are not caught, it will be fixed.
          • some videos are not only video but playlist, so it is not caught, but it will be fixed also.
          • sometime Google gives no information about youtube. I guess smart tv is using not only YouTube but also other dedicated apps for music and video, yogether
          D 1 Reply Last reply Reply Quote 0
          • J Offline
            JRCelis @jomwells
            last edited by

            @jomwells

            I get the same issue, I hear a buzz at the beginning of the answered sentences in my speaker and clear voice after two seconds of the sentences start.

            ? 1 Reply Last reply Reply Quote 0
            • ? Offline
              A Former User @JRCelis
              last edited by

              @jrcelis
              What kind of speaker do you use? Analog? HDMI output? USB? Bluetooth?
              Except for Bluetooth speaker, All others could have buzz sound.

              J T 2 Replies Last reply Reply Quote 0
              • J Offline
                JRCelis @Guest
                last edited by

                @sean
                Hello @Sean and thanks for your help. I’m using the speaker that is coming with Google Voice Kit V1 and is working fine when I’m testing the sound, no buzz or distorted sound and the beginning of the sentences, the issue starts when I click the speaker icon when MMM-assistantk2 is running, the assistants answer start whit a big distorted noise o buzz and then will be fine.

                ? 1 Reply Last reply Reply Quote 0
                • ? Offline
                  A Former User @JRCelis
                  last edited by

                  @jrcelis
                  Unfortunately, I’m not an expert in sound configuration.
                  I use node module speaker for output. The buffered voice output from Google Assistant Server is directly piped to speaker module. And there is narrowly little margin to control speaker module.

                  My guess is, burden of system could make some delay causing distortion. but just guessing.

                  Anyway, I’m considering to convert voice output to mp3 file then play it. but it needs somewhat computing power, so I’m not sure whether it will be really good for RPI.
                  Or I will search other solution for better result.

                  1 Reply Last reply Reply Quote 0
                  • M Offline
                    mariecbilodeau
                    last edited by

                    Hello! I got Hotword working but assistant triggers error. I tried to rebuild electron as explained in the installation guide but it’s not working. I have the google voice kit installed on my raspberry… do you think that is the problem?

                    ? 1 Reply Last reply Reply Quote 0
                    • ? Offline
                      A Former User @mariecbilodeau
                      last edited by

                      @mariecbilodeau more details are needed to answer. Error logs or screenshots could be helpful.

                      1 Reply Last reply Reply Quote 0
                      • M Offline
                        mariecbilodeau
                        last edited by

                        this is when I load my mirror with just hotword and assistant installed. I’ll try to rebuild electron again to get the log

                        > magicmirror@2.4.1 start /home/pi/MagicMirror
                        > sh run-start.sh
                        
                        Starting MagicMirror: v2.4.1
                        Loading config ...
                        Loading module helpers ...
                        Initializing new module helper ...
                        Module helper loaded: MMM-Hotword
                        WARNING! Could not load config file. Starting with default configuration. Error found: Error: Failed to load gRPC binary module because it was not installed for the current system
                        Expected directory: electron-v2.0-linux-arm-glibc
                        Found: [node-v59-linux-arm-glibc]
                        This problem can often be fixed by running "npm rebuild" on the current system
                        Original error: Cannot find module '/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/node/extension_binary/electron-v2.0-linux-arm-glibc/grpc_node.node'
                        Loading module helpers ...
                        Initializing new module helper ...
                        Module helper loaded: MMM-Hotword
                        App threw an error during load
                        Error: Failed to load gRPC binary module because it was not installed for the current system
                        Expected directory: electron-v2.0-linux-arm-glibc
                        Found: [node-v59-linux-arm-glibc]
                        This problem can often be fixed by running "npm rebuild" on the current system
                        Original error: Cannot find module '/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/node/extension_binary/electron-v2.0-linux-arm-glibc/grpc_node.node'
                            at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:53:17)
                            at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:63:3)
                            at Module._compile (module.js:642:30)
                            at Object.Module._extensions..js (module.js:653:10)
                            at Module.load (module.js:561:32)
                            at tryModuleLoad (module.js:504:12)
                            at Function.Module._load (module.js:496:3)
                            at Module.require (module.js:586:17)
                            at require (internal/module.js:11:18)
                            at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/client_interceptors.js:145:12)
                        Whoops! There was an uncaught exception...
                        { Error: Failed to load gRPC binary module because it was not installed for the current system
                        Expected directory: electron-v2.0-linux-arm-glibc
                        Found: [node-v59-linux-arm-glibc]
                        This problem can often be fixed by running "npm rebuild" on the current system
                        Original error: Cannot find module '/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/node/extension_binary/electron-v2.0-linux-arm-glibc/grpc_node.node'
                            at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:53:17)
                            at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/grpc_extension.js:63:3)
                            at Module._compile (module.js:642:30)
                            at Object.Module._extensions..js (module.js:653:10)
                            at Module.load (module.js:561:32)
                            at tryModuleLoad (module.js:504:12)
                            at Function.Module._load (module.js:496:3)
                            at Module.require (module.js:586:17)
                            at require (internal/module.js:11:18)
                            at Object.<anonymous> (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/src/client_interceptors.js:145:12) code: 'MODULE_NOT_FOUND' }
                        MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
                        If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
                        Launching application.
                        pi@raspberrypi:~/MagicMirror $ 
                        
                        
                        1 Reply Last reply Reply Quote 0
                        • M Offline
                          mariecbilodeau
                          last edited by

                          this is part of my rebuild error

                          pi@raspberrypi:~/MagicMirror/modules/MMM-AssistantMk2 $ npm install --save-dev electron-rebuild
                          npm WARN MMM-AssistantMk2@1.0.1 No repository field.
                          
                          + electron-rebuild@1.8.2
                          updated 1 package in 18.167s
                          pi@raspberrypi:~/MagicMirror/modules/MMM-AssistantMk2 $ ./node_modules/.bin/electron-rebuild
                          ✖ Rebuild Failed
                          
                          An unhandled error occurred inside electron-rebuild
                          gyp info it worked if it ends with ok
                          gyp info using node-gyp@3.8.0
                          gyp info using node@9.11.2 | linux | arm
                          gyp info spawn /usr/bin/python2
                          gyp info spawn args [ '/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/node-gyp/gyp/gyp_main.py',
                          gyp info spawn args   'binding.gyp',
                          gyp info spawn args   '-f',
                          gyp info spawn args   'make',
                          gyp info spawn args   '-I',
                          gyp info spawn args   '/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/build/config.gypi',
                          gyp info spawn args   '-I',
                          gyp info spawn args   '/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/node-gyp/addon.gypi',
                          gyp info spawn args   '-I',
                          gyp info spawn args   '/home/pi/.electron-gyp/.node-gyp/iojs-2.0.0/common.gypi',
                          gyp info spawn args   '-Dlibrary=shared_library',
                          gyp info spawn args   '-Dvisibility=default',
                          gyp info spawn args   '-Dnode_root_dir=/home/pi/.electron-gyp/.node-gyp/iojs-2.0.0',
                          gyp info spawn args   '-Dnode_gyp_dir=/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/node-gyp',
                          gyp info spawn args   '-Dnode_lib_file=/home/pi/.electron-gyp/.node-gyp/iojs-2.0.0/<(target_arch)/iojs.lib',
                          gyp info spawn args   '-Dmodule_root_dir=/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc',
                          gyp info spawn args   '-Dnode_engine=v8',
                          gyp info spawn args   '--depth=.',
                          gyp info spawn args   '--no-parallel',
                          gyp info spawn args   '--generator-output',
                          gyp info spawn args   'build',
                          gyp info spawn args   '-Goutput_dir=.' ]
                          gyp info spawn make
                          gyp info spawn args [ 'BUILDTYPE=Release', '-C', 'build' ]
                          make : on entre dans le répertoire « /home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/grpc/build »
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/surface/init.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/avl/avl.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/backoff/backoff.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/channel_args.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/channel_stack.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/channel_stack_builder.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/channel_trace.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/channelz.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/channelz_registry.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/connected_channel.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/handshaker.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/handshaker_factory.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/handshaker_registry.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/channel/status_util.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/compression/compression.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/compression/compression_internal.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/compression/message_compress.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/compression/stream_compression.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/compression/stream_compression_gzip.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/compression/stream_compression_identity.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/debug/stats.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/debug/stats_data.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/http/format_request.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/http/httpcli.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/http/parser.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/call_combiner.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/combiner.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/endpoint.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/endpoint_pair_posix.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/endpoint_pair_uv.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/endpoint_pair_windows.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/error.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/ev_epoll1_linux.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/ev_epollex_linux.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/ev_epollsig_linux.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/ev_poll_posix.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/ev_posix.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/ev_windows.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/exec_ctx.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/executor.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/fork_posix.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/fork_windows.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/gethostname_fallback.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/gethostname_host_name_max.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/gethostname_sysconf.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/iocp_windows.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/iomgr.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/iomgr_custom.o
                            CXX(target) Release/obj.target/grpc/deps/grpc/src/core/lib/iomgr/iomgr_internal.o
                          
                          
                          ? 1 Reply Last reply Reply Quote 0
                          • ? Offline
                            A Former User @mariecbilodeau
                            last edited by

                            @mariecbilodeau
                            “gyp ERR …” lines are needed. Your log is missing those infos.

                            M 1 Reply Last reply Reply Quote 0
                            • T Offline
                              themc
                              last edited by

                              is there any way to play local stored mp3 files on the raspbery pi using the play … command

                              currently when saying prhases like play mp3 it says oke and stops.

                              im wondering if it is possible to play music mp3s from the music folder using the built in player of vlc player by sying the google command of a gaction

                              would be a nice addition to the plugin

                              ? 1 Reply Last reply Reply Quote 0
                              • ? Offline
                                A Former User @themc
                                last edited by

                                @themc
                                If you have a module to play mp3 and it is able to be activated by notification, it could. But adding some specific job to Assistant itself, I think it is not so good idea, because each circumstance is different.
                                So have you a module which can play mp3? I can make gaction sample for it.

                                1 Reply Last reply Reply Quote 0
                                • D Offline
                                  dvbit @Guest
                                  last edited by

                                  @sean thanks for all the info.
                                  Just saw this after sending you request for info.
                                  will search better / more in the future :-)

                                  1 Reply Last reply Reply Quote 0
                                  • D Offline
                                    dvbit
                                    last edited by

                                    Looking for a solution for my vertical setup and browsing the file system I have seen that the cardsare stored in a temp_screen html file in the plugin folder.

                                    changing there font size from 40px to 20px makes already a big diff (no scroll bars… in the cards)

                                    is htere a way I can intercept that file and edit before presentation?

                                    that would already do a good trick :-)

                                    ? 1 Reply Last reply Reply Quote 0
                                    • ? Offline
                                      A Former User @dvbit
                                      last edited by A Former User

                                      @dvbit
                                      I’ve already done that. screenZoom is that.
                                      But anyway, That screenOutput was made for SmartTV, so it was optimized for Landscape mode. And unfortunately, the screenOutput is uncontrollable static HTML itself. There is no enough room for control.
                                      I wish the next version of Google SDK could provide structured data instead static HTML for screenOutput.

                                      1 Reply Last reply Reply Quote 0
                                      • D Offline
                                        dvbit
                                        last edited by

                                        Ok. Tx will use that parameter then :-)

                                        1 Reply Last reply Reply Quote 0
                                        • M Offline
                                          mariecbilodeau @Guest
                                          last edited by

                                          @sean here is my complete log
                                          https://www.dropbox.com/s/7l4wd8xtb3t9odk/error log?dl=0
                                          thank you for your help :)

                                          1 Reply Last reply Reply Quote 0
                                          • M Offline
                                            mariecbilodeau
                                            last edited by

                                            I got it working with your solution in the troubleshooting section!!! thx

                                            1 Reply Last reply Reply Quote 0

                                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                            With your input, this post could be even better 💗

                                            Register Login
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 21
                                            • 22
                                            • 1 / 22
                                            • First post
                                              Last post
                                            Enjoying MagicMirror? Please consider a donation!
                                            MagicMirror created by Michael Teeuw.
                                            Forum managed by Sam, technical setup by Karsten.
                                            This forum is using NodeBB as its core | Contributors
                                            Contact | Privacy Policy