mmm assistant mk2

A Former User

reddyman

@Bugsounet Ahh that makes sense. I’m sorry to hear that project is dead but I understand. I’m sorry you had to deal with so many crappy and ugly people; they don’t deserve anything from someone who put in so much hardwork and sweat as you have.

Gah, I just wish I didn’t update my mirror yesterday. The last time I updated it was in February and everything was working perfectly. And of course when I updated, I didn’t bother making a backup. Valuable lesson learned though!

I’ll take down my mirror for now I guess. But best of luck to you Bugsounet to anything you do in the future!

A Former User

@reddyman : don’t remove it ;)

I am ready to deploy the new assistant
AND … I am ready to deploy the new Assistant2Display

Edit:

MMM-Assistant2Display is deployed

reddyman

!!!

I had thought you meant you were stepping down completely. I misunderstood, this is wonderful news!

I will be checking for days for your new assistant then… and let me know if you take donations!

A Former User

For clarify why closing it:

In this forum, there 2 gays who arcel me and there are now stopped

So, I don’t want to continue with AMk2 name (sorry @sean)
too many bad memories are in mind with this module name

dvbit

Hi @Bugsounet thanks !
Your work is really appreciated.
I wish I knew js to help.
However if you need polite and Linux expert beamta testers or simply financial contribution please let me know.

A Former User

@dvbit: thx :)

Time -> 23:30
Deploy new Assistant in 30 min !

dvbit

Bien heureux de t’aider si tu veux. Je suis italien mais je parle francais. Meme si c’est seulement pour traduire ;-)

A Former User

AND… it’s now time !

Welcome to the new assistant : MMM-GoogleAssistant

Welcome to the new Assistant2Display: MMM-Assistant2Display

dvbit

@Bugsounet great!
Will be testing.
And reporting quietly .

Tx again. Merci

Ps: good I have exactly the same setup.

A Former User

Attention … configuration is not the same.
Read Wiki

dvbit

@Bugsounet yep. Sure. Reading now. Installing tomorrow.and giving you feedback.
If you need help in giving simple support (i.e. dumb Linux, not reading the wiki … Aka not real issue / first level support I can try to help you there :-))

A Former User

no problem :)

reddyman

Started partial installation tonight…and I can say: what an absolutely beautiful and efficient installer! This is the best installer I have seen for a module.

I’m running it on a fresh installation of Raspberry Pi OS and fresh installation of MagicMirror with no other modules installed.

Ran into a small hiccup during the post-installation process, during audio configuration for the speakers. I can’t get any sound output.

It’s late so I will fiddle and experiment more tomorrow but in case anyone else runs into the same problem before I figure out a solution, I’ll leave some data below:

Sending audio output via aux cable from pi to monitor and can confirm audio is working when playing a youtube video.

Interestingly I hear a beep during this part of the installation, but nothing after that:

Do you want to check compatible GCC version [Y/n] 
Your choice:

No sound from here onwards:

Checking Speaker and Microphone...
Do you want check your audio configuration [Y/n] 
Your choice: Y
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 0
Indicate the device # to use [0-9]: 0
you have selected: hw:0,0 (plughw:0)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 0
Indicate the device # to use [0-9]: 1
you have selected: hw:0,1 (plughw:0)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 1
Indicate the device # to use [0-9]: 0
you have selected: hw:1,0 (plughw:1)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n
Selection of the speaker device
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Indicate the card # to use [0-9]: 1
Indicate the device # to use [0-9]: 1
you have selected: hw:1,1 (plughw:1)
Checking audio output...
Make sure your speakers are on press [Yes].
Press [No] if you don't want to check. [Y/n] 
Your choice: Y
Current configuration not working !
Did you hear Google beep? [Y/n] 
Your choice: n

aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
  Subdevices: 4/4
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
  Subdevices: 4/4
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3

EDIT:
I couldn’t sleep so I continued playing. I set audio speaker output to 1,0 which should be the correct configuration for me even though I couldn’t hear anything and I was getting an error. HOWEVER, in the next portion where I had to setup my microphone, I was able to hear my own voice playback.

Ran through the sample config example, and everything works perfectly with the brief testing I have done. Beautiful work Bugsounet!

sdmydbr

@Bugsounet thank you so much for this awesome module… works like a charm… 🤩

djdocta

@Bugsounet said in mmm assistant mk2:

AND… it’s now time !

Welcome to the new assistant : MMM-GoogleAssistant

Welcome to the new Assistant2Display: MMM-Assistant2Display

Will do some tests and debug on it but …
Impressive.
Good work.
Congrats. and THANKS for sharing.

dvbit

Installing . Flawless process

dvbit

and flawless install!
Thanks @Bugsounet

dvbit

A2D was not working at first launch.
npm rebuild in the directory did the trick.
Working now

dvbit

Hi
Curious it has been working for the first calls.
Now It answers on screen.
Not via speakers (but that could be for sure a problem with my audio setup)
The other thing is that the on screen google assistant prompt on top keeps spinning and no further interaction is possible.

Here is the debug log.
I can see the call is successfully created files inthe tmp directory and have scped them to my laptop and they are ok.
What changed in between was the tests are that I installed a2d .

While I investigate on my audio output to check if it works I post the log in debug mode
I see a suspicious “null” in volume in the log.
I tried a vlc lastResponse.mp3 and it was correctly output

[2020-06-01 12:15:47.539] [LOG]    [ASSISTANT:AS] CONVERSATION:SCREEN object
[2020-06-01 12:15:47.542] [LOG]    [ASSISTANT:AS] CONVERSATION:ACTION { requestId: '5ed37b16-0000-2f10-85f3-089e0827ce88' }
[2020-06-01 12:15:47.543] [LOG]    [ASSISTANT:AS] CONVERSATION:RESPONSE 
[2020-06-01 12:15:47.589] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.592] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.593] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.594] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.596] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.597] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 1600
[2020-06-01 12:15:47.598] [LOG]    [ASSISTANT:AS] CONVERSATION:AUDIO 768
[2020-06-01 12:15:47.602] [LOG]    [ASSISTANT:AS] CONVERSATION_ALL_RESPONSES_RECEIVED
[2020-06-01 12:15:47.603] [LOG]    [ASSISTANT:AS] CONVERSATION_END:COMPLETED
[2020-06-01 12:15:47.603] [LOG]    [ASSISTANT:AS] CONVERSATION_PP:RESPONSE_AUDIO_PROCESSED
[2020-06-01 12:15:47.604] [LOG]    [MP3] MP3 FILE CREATED 10368 bytes
[2020-06-01 12:15:47.656] [LOG]    [ASSISTANT:SP] CONVERSATION:SCREENOUTPUT_CREATED
[2020-06-01 12:15:47.657] [LOG]    [ASSISTANT] ASSISTANT_RESULT { error: null,
  action: { requestId: '5ed37b16-0000-2f10-85f3-089e0827ce88' },
  text: null,
  screen:
   { text:
      'Bracciano RM / Ora locale\n12:15\nlunedì 1 giugno 2020\nOrario (Edited)',
     links: [],
     photos: [],
     path:
      '/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastScreenOutput.html',
     uri: 'tmp/lastScreenOutput.html' },
  audio:
   { path:
      '/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastResponse.mp3',
     uri: 'tmp/lastResponse.mp3' },
  transcription: { transcription: 'a che ora è', done: true },
  continue: false,
  volume: null,
  lastQuery:
   { type: 'MIC',
     key: null,
     lang: 'it-IT',
     useScreenOutput: true,
     useAudioOutput: true,
     status: 'standby',
     chime: true } }