MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    mmm assistant mk2

    Scheduled Pinned Locked Moved Troubleshooting
    112 Posts 12 Posters 55.5k Views 11 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ? Offline
      A Former User
      last edited by A Former User

      @reddyman : don’t remove it ;)

      I am ready to deploy the new assistant
      AND … I am ready to deploy the new Assistant2Display

      Edit:

      • MMM-Assistant2Display is deployed
      1 Reply Last reply Reply Quote 0
      • R Offline
        reddyman
        last edited by

        !!!

        I had thought you meant you were stepping down completely. I misunderstood, this is wonderful news!

        I will be checking for days for your new assistant then… and let me know if you take donations!

        1 Reply Last reply Reply Quote 0
        • ? Offline
          A Former User
          last edited by

          For clarify why closing it:

          • In this forum, there 2 gays who arcel me and there are now stopped

          So, I don’t want to continue with AMk2 name (sorry @sean)
          too many bad memories are in mind with this module name

          1 Reply Last reply Reply Quote 0
          • D Offline
            dvbit
            last edited by

            Hi @Bugsounet thanks !
            Your work is really appreciated.
            I wish I knew js to help.
            However if you need polite and Linux expert beamta testers or simply financial contribution please let me know.

            1 Reply Last reply Reply Quote 0
            • ? Offline
              A Former User
              last edited by A Former User

              @dvbit: thx :)

              Time -> 23:30
              Deploy new Assistant in 30 min !

              1 Reply Last reply Reply Quote 0
              • D Offline
                dvbit
                last edited by

                Bien heureux de t’aider si tu veux. Je suis italien mais je parle francais. Meme si c’est seulement pour traduire ;-)

                1 Reply Last reply Reply Quote 0
                • ? Offline
                  A Former User
                  last edited by A Former User

                  AND… it’s now time !

                  Welcome to the new assistant : MMM-GoogleAssistant

                  Welcome to the new Assistant2Display: MMM-Assistant2Display

                  D S D 3 Replies Last reply Reply Quote 0
                  • D Offline
                    dvbit @Guest
                    last edited by dvbit

                    @Bugsounet great!
                    Will be testing.
                    And reporting quietly .

                    Tx again. Merci

                    Ps: good I have exactly the same setup.

                    1 Reply Last reply Reply Quote 0
                    • ? Offline
                      A Former User
                      last edited by

                      Attention … configuration is not the same.
                      Read Wiki

                      D ChrisC 2 Replies Last reply Reply Quote 1
                      • D Offline
                        dvbit @Guest
                        last edited by dvbit

                        @Bugsounet yep. Sure. Reading now. Installing tomorrow.and giving you feedback.
                        If you need help in giving simple support (i.e. dumb Linux, not reading the wiki … Aka not real issue / first level support I can try to help you there :-))

                        1 Reply Last reply Reply Quote 0
                        • ? Offline
                          A Former User
                          last edited by

                          no problem :)

                          1 Reply Last reply Reply Quote 0
                          • R Offline
                            reddyman
                            last edited by reddyman

                            Started partial installation tonight…and I can say: what an absolutely beautiful and efficient installer! This is the best installer I have seen for a module.

                            I’m running it on a fresh installation of Raspberry Pi OS and fresh installation of MagicMirror with no other modules installed.

                            Ran into a small hiccup during the post-installation process, during audio configuration for the speakers. I can’t get any sound output.

                            It’s late so I will fiddle and experiment more tomorrow but in case anyone else runs into the same problem before I figure out a solution, I’ll leave some data below:

                            Sending audio output via aux cable from pi to monitor and can confirm audio is working when playing a youtube video.

                            Interestingly I hear a beep during this part of the installation, but nothing after that:

                            Do you want to check compatible GCC version [Y/n] 
Your choice:

                            No sound from here onwards:

                            Checking Speaker and Microphone...
Do you want check your audio configuration [Y/n] 
Your choice: Y
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 0
Indicate the device # to use [0-9]: 0
you have selected: hw:0,0 (plughw:0)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 0
Indicate the device # to use [0-9]: 1
you have selected: hw:0,1 (plughw:0)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 1
Indicate the device # to use [0-9]: 0
you have selected: hw:1,0 (plughw:1)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 1
Indicate the device # to use [0-9]: 1
you have selected: hw:1,1 (plughw:1)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n


                            aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
  Subdevices: 4/4
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
  Subdevices: 4/4
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3

                            EDIT:
                            I couldn’t sleep so I continued playing. I set audio speaker output to 1,0 which should be the correct configuration for me even though I couldn’t hear anything and I was getting an error. HOWEVER, in the next portion where I had to setup my microphone, I was able to hear my own voice playback.

                            Ran through the sample config example, and everything works perfectly with the brief testing I have done. Beautiful work Bugsounet!

                            1 Reply Last reply Reply Quote 0
                            • S Offline
                              sdmydbr @Guest
                              last edited by

                              @Bugsounet thank you so much for this awesome module… works like a charm… 🤩

                              1 Reply Last reply Reply Quote 0
                              • D Offline
                                djdocta @Guest
                                last edited by

                                @Bugsounet said in mmm assistant mk2:

                                AND… it’s now time !

                                Welcome to the new assistant : MMM-GoogleAssistant

                                Welcome to the new Assistant2Display: MMM-Assistant2Display

                                Will do some tests and debug on it but …
                                Impressive.
                                Good work.
                                Congrats. and THANKS for sharing.

                                1 Reply Last reply Reply Quote 0
                                • D Offline
                                  dvbit
                                  last edited by

                                  Installing . Flawless process

                                  1 Reply Last reply Reply Quote 0
                                  • D Offline
                                    dvbit
                                    last edited by

                                    and flawless install!
                                    Thanks @Bugsounet

                                    1 Reply Last reply Reply Quote 0
                                    • D Offline
                                      dvbit
                                      last edited by

                                      A2D was not working at first launch.
                                      npm rebuild in the directory did the trick.
                                      Working now

                                      1 Reply Last reply Reply Quote 0
                                      • D Offline
                                        dvbit
                                        last edited by dvbit

                                        Hi
                                        Curious it has been working for the first calls.
                                        Now It answers on screen.
                                        Not via speakers (but that could be for sure a problem with my audio setup)
                                        The other thing is that the on screen google assistant prompt on top keeps spinning and no further interaction is possible.

                                        Here is the debug log.
                                        I can see the call is successfully created files inthe tmp directory and have scped them to my laptop and they are ok.
                                        What changed in between was the tests are that I installed a2d .

                                        While I investigate on my audio output to check if it works I post the log in debug mode
                                        I see a suspicious “null” in volume in the log.
                                        I tried a vlc lastResponse.mp3 and it was correctly output

                                        [2020-06-01 12:15:47.539] [LOG]    [ASSISTANT:AS] CONVERSATION:SCREEN object
[2020-06-01 12:15:47.542] [LOG]    [ASSISTANT:AS] CONVERSATION:ACTION { requestId: '5ed37b16-0000-2f10-85f3-089e0827ce88' }
[2020-06-01 12:15:47.543] [LOG]    [ASSISTANT:AS] CONVERSATION:RESPONSE 
[2020-06-01 12:15:47.589] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.592] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.593] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.594] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.596] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.597] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.598] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 768
[2020-06-01 12:15:47.602] [LOG]    [ASSISTANT:AS] CONVERSATION_ALL_RESPONSES_RECEIVED
[2020-06-01 12:15:47.603] [LOG]    [ASSISTANT:AS] CONVERSATION_END:COMPLETED
[2020-06-01 12:15:47.603] [LOG]    [ASSISTANT:AS] CONVERSATION_PP:RESPONSE_AUDIO_PROCESSED
[2020-06-01 12:15:47.604] [LOG]    [MP3] MP3 FILE CREATED 10368 bytes
[2020-06-01 12:15:47.656] [LOG]    [ASSISTANT:SP] CONVERSATION:SCREENOUTPUT_CREATED
[2020-06-01 12:15:47.657] [LOG]    [ASSISTANT] ASSISTANT_RESULT { error: null,
  action: { requestId: '5ed37b16-0000-2f10-85f3-089e0827ce88' },
  text: null,
  screen:
   { text:
      'Bracciano RM / Ora locale\n12:15\nlunedì 1 giugno 2020\nOrario (Edited)',
     links: [],
     photos: [],
     path:
      '/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastScreenOutput.html',
     uri: 'tmp/lastScreenOutput.html' },
  audio:
   { path:
      '/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastResponse.mp3',
     uri: 'tmp/lastResponse.mp3' },
  transcription: { transcription: 'a che ora è', done: true },
  continue: false,
  volume: null,
  lastQuery:
   { type: 'MIC',
     key: null,
     lang: 'it-IT',
     useScreenOutput: true,
     useAudioOutput: true,
     status: 'standby',
     chime: true } }
                                        1 Reply Last reply Reply Quote 0
                                        • D Offline
                                          dvbit
                                          last edited by

                                          Update: I reinstalled from scratch (again for a2d I had to do a npm rebuild, you may want to take note)

                                          Still the same issue of assistant hanging after query:
                                          I do the query, hotword recognized, query recognized, answer fetched, answer saved in temp and displayed on screen bottom but no audio feedback and gogle spin icon going.
                                          After refreshing the screen goes again in “steady state”

                                          Now I am sure I have a sound output issue.
                                          Meaning that I can play sounds on the mirror via vlc but somehow the plugin cannot.
                                          I guess that somehow the plugin does not receive a feedback of “play ended” from the output.
                                          What I also noticed is that if I refresh the browser by vnc the mirror will go again in a waiting status.
                                          Will continue checking

                                          D 1 Reply Last reply Reply Quote 0
                                          • ChrisC Offline
                                            Chris @Guest
                                            last edited by

                                            @Bugsounet

                                            Hello,

                                            First of all, thank you for not stopping your work on this module which is of high quality.

                                            I tried to install the new assistant. I followed the wiki. However, I have a problem.
                                            Indeed, when the mirror is launched, I find myself with the following message:

                                            [2020-06-01 14:04:54.256] [LOG]    [ASSISTANT][ERROR] token.json file not found

                                            However, I followed the WIKI well and applied the following command:

                                            (env) pi@raspberrypi:~/MagicMirror/modules/MMM-GoogleAssistant $ ACCESSTOKEN=ya29.a0AfH6SMABBPj590X_itMQG616F8QpxddhPVuSXCE4qvZs6znHKbG2n5RggszFMdl0V5HP0lf956H9O7VHlbuGuMxSzkU3pMkdbpFxs485NwfXYl9T7hfLzB0EOPlRTwcifZW-8rIUlZlWXXXXXXXXXXXXXXXXXXX

                                            Do you have any idea about this problem?

                                            Thanking you in advance,

                                            Regards,

                                            1 Reply Last reply Reply Quote 0

                                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                            With your input, this post could be even better 💗

                                            Register Login
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 6
                                            • 2 / 6
                                            • First post
                                              Last post
                                            Enjoying MagicMirror? Please consider a donation!
                                            MagicMirror created by Michael Teeuw.
                                            Forum managed by Sam, technical setup by Karsten.
                                            This forum is using NodeBB as its core | Contributors
                                            Contact | Privacy Policy