• Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
MagicMirror Forum
  • Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
A New Chapter for MagicMirror: The Community Takes the Lead
Read the statement by Michael Teeuw here.

mmm assistant mk2

Scheduled Pinned Locked Moved Troubleshooting
112 Posts 12 Posters 28.1k Views 11 Watching
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • D Offline
    dvbit
    last edited by dvbit Jun 1, 2020, 10:31 AM Jun 1, 2020, 10:28 AM

    Hi
    Curious it has been working for the first calls.
    Now It answers on screen.
    Not via speakers (but that could be for sure a problem with my audio setup)
    The other thing is that the on screen google assistant prompt on top keeps spinning and no further interaction is possible.

    Here is the debug log.
    I can see the call is successfully created files inthe tmp directory and have scped them to my laptop and they are ok.
    What changed in between was the tests are that I installed a2d .

    While I investigate on my audio output to check if it works I post the log in debug mode
    I see a suspicious “null” in volume in the log.
    I tried a vlc lastResponse.mp3 and it was correctly output

    [2020-06-01 12:15:47.539] [LOG]    [ASSISTANT:AS] CONVERSATION:SCREEN object
    [2020-06-01 12:15:47.542] [LOG]    [ASSISTANT:AS] CONVERSATION:ACTION { requestId: '5ed37b16-0000-2f10-85f3-089e0827ce88' }
    [2020-06-01 12:15:47.543] [LOG]    [ASSISTANT:AS] CONVERSATION:RESPONSE 
    [2020-06-01 12:15:47.589] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
    [2020-06-01 12:15:47.592] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
    [2020-06-01 12:15:47.593] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
    [2020-06-01 12:15:47.594] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
    [2020-06-01 12:15:47.596] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
    [2020-06-01 12:15:47.597] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
    [2020-06-01 12:15:47.598] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 768
    [2020-06-01 12:15:47.602] [LOG]    [ASSISTANT:AS] CONVERSATION_ALL_RESPONSES_RECEIVED
    [2020-06-01 12:15:47.603] [LOG]    [ASSISTANT:AS] CONVERSATION_END:COMPLETED
    [2020-06-01 12:15:47.603] [LOG]    [ASSISTANT:AS] CONVERSATION_PP:RESPONSE_AUDIO_PROCESSED
    [2020-06-01 12:15:47.604] [LOG]    [MP3] MP3 FILE CREATED 10368 bytes
    [2020-06-01 12:15:47.656] [LOG]    [ASSISTANT:SP] CONVERSATION:SCREENOUTPUT_CREATED
    [2020-06-01 12:15:47.657] [LOG]    [ASSISTANT] ASSISTANT_RESULT { error: null,
      action: { requestId: '5ed37b16-0000-2f10-85f3-089e0827ce88' },
      text: null,
      screen:
       { text:
          'Bracciano RM / Ora locale\n12:15\nlunedì 1 giugno 2020\nOrario (Edited)',
         links: [],
         photos: [],
         path:
          '/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastScreenOutput.html',
         uri: 'tmp/lastScreenOutput.html' },
      audio:
       { path:
          '/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastResponse.mp3',
         uri: 'tmp/lastResponse.mp3' },
      transcription: { transcription: 'a che ora è', done: true },
      continue: false,
      volume: null,
      lastQuery:
       { type: 'MIC',
         key: null,
         lang: 'it-IT',
         useScreenOutput: true,
         useAudioOutput: true,
         status: 'standby',
         chime: true } }
    
    
    
    1 Reply Last reply Reply Quote 0
    • D Offline
      dvbit
      last edited by Jun 1, 2020, 12:57 PM

      Update: I reinstalled from scratch (again for a2d I had to do a npm rebuild, you may want to take note)

      Still the same issue of assistant hanging after query:
      I do the query, hotword recognized, query recognized, answer fetched, answer saved in temp and displayed on screen bottom but no audio feedback and gogle spin icon going.
      After refreshing the screen goes again in “steady state”

      Now I am sure I have a sound output issue.
      Meaning that I can play sounds on the mirror via vlc but somehow the plugin cannot.
      I guess that somehow the plugin does not receive a feedback of “play ended” from the output.
      What I also noticed is that if I refresh the browser by vnc the mirror will go again in a waiting status.
      Will continue checking

      D 1 Reply Last reply Jun 1, 2020, 1:24 PM Reply Quote 0
      • C Offline
        Chris @Guest
        last edited by Jun 1, 2020, 1:00 PM

        @Bugsounet

        Hello,

        First of all, thank you for not stopping your work on this module which is of high quality.

        I tried to install the new assistant. I followed the wiki. However, I have a problem.
        Indeed, when the mirror is launched, I find myself with the following message:

        [2020-06-01 14:04:54.256] [LOG]    [ASSISTANT][ERROR] token.json file not found 
        

        However, I followed the WIKI well and applied the following command:

        (env) pi@raspberrypi:~/MagicMirror/modules/MMM-GoogleAssistant $ ACCESSTOKEN=ya29.a0AfH6SMABBPj590X_itMQG616F8QpxddhPVuSXCE4qvZs6znHKbG2n5RggszFMdl0V5HP0lf956H9O7VHlbuGuMxSzkU3pMkdbpFxs485NwfXYl9T7hfLzB0EOPlRTwcifZW-8rIUlZlWXXXXXXXXXXXXXXXXXXX
        

        Do you have any idea about this problem?

        Thanking you in advance,

        Regards,

        1 Reply Last reply Reply Quote 0
        • ? Offline
          A Former User
          last edited by A Former User Jun 1, 2020, 1:03 PM Jun 1, 2020, 1:02 PM

          @dvbit try this:
          launch it in root directly in RPI terminal (not ssh)

          cd ~/MagicMirror
          sudo ./node_modules/.bin/electron js/electron.js --no-sandbox
          

          give me result

          S 1 Reply Last reply Jun 1, 2020, 1:11 PM Reply Quote 0
          • ? Offline
            A Former User
            last edited by Jun 1, 2020, 1:05 PM

            @chris: token.json file must be located in ~/MagicMirror/modules/MMM-GoogleAssistant/token.json

            C 1 Reply Last reply Jun 1, 2020, 1:24 PM Reply Quote 0
            • S Away
              sdetweil @Guest
              last edited by Jun 1, 2020, 1:11 PM

              @Bugsounet u can also run the fixsandbox script from my repo
              https://github.com/sdetweil/MagicMirror_scripts

              if they use my installer I fix it… otherwise they either need the --nosandbox or run my script

              Sam

              How to add modules

              learning how to use browser developers window for css changes

              1 Reply Last reply Reply Quote 0
              • ? Offline
                A Former User
                last edited by Jun 1, 2020, 1:12 PM

                sam, i suspect a bug in electron

                chown root and chmod 4755 ?

                S 1 Reply Last reply Jun 1, 2020, 1:13 PM Reply Quote 0
                • S Away
                  sdetweil @Guest
                  last edited by Jun 1, 2020, 1:13 PM

                  @Bugsounet yes, what my script does…

                  not a bug, new feature

                  Sam

                  How to add modules

                  learning how to use browser developers window for css changes

                  1 Reply Last reply Reply Quote 0
                  • ? Offline
                    A Former User
                    last edited by Jun 1, 2020, 1:14 PM

                    yes but i don’t understand why … with pulseaudio there is no sound but with root it’s works …

                    There is a permission missing somewhere

                    S 1 Reply Last reply Jun 1, 2020, 1:17 PM Reply Quote 0
                    • S Away
                      sdetweil @Guest
                      last edited by Jun 1, 2020, 1:17 PM

                      @Bugsounet sorry, got no idea what the side effects are…

                      they wanted some additional security

                      are u launching a player as a background task, or playing direct to the device? if the latter then u get all the security crap

                      Sam

                      How to add modules

                      learning how to use browser developers window for css changes

                      1 Reply Last reply Reply Quote 0
                      • 1
                      • 2
                      • 3
                      • 4
                      • 5
                      • 6
                      • 7
                      • 11
                      • 12
                      • 5 / 12
                      5 / 12
                      • First post
                        43/112
                        Last post
                      Enjoying MagicMirror? Please consider a donation!
                      MagicMirror created by Michael Teeuw.
                      Forum managed by Sam, technical setup by Karsten.
                      This forum is using NodeBB as its core | Contributors
                      Contact | Privacy Policy