MMM-AssistantMk2

citizendevpi

@cr4z33 I am in the process of setting up now on voice kit v1. did you start yet?

citizendevpi

ok so i have installed hotword (working i guess), assistantmk2 i went all the way tru and got a response after typing hello what time is it . and get api interactions in my google cloud. also installed notifaction trigger the mirror starts up and if i say jarvis,smartmirror i get hotword dectected but nothing from assistant im at a loss on how to get it going/response. i will upload my terminal output if i can figure out how if any one can help im pretty sure im missing somthing in my config.EDIT ok i input the test config and BAM it is alive the audio is super crunchy but it could be a hardware issue so any one interested yes i am running pi3b+ with aiy kit v 1 and it works.

A Former User

@citizendevpi @Cr4z33
Still got problem?
I’m making whole new update. It will be more stable and easy to install & use. I’ll release this new update in this week. Plz wait a few days.

citizendevpi

@sean no i did some tweeking with mp3 for audio.encoding out and that cleared up the sound issue i do get a frequent js error like every time i use the hotword:Error: open() failed: -1
at Speaker._open (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/speaker/index.js:106:13)
at Speaker._write (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/speaker/index.js:183:23)
at doWrite (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:428:64)
at writeOrBuffer (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:417:5)
at Speaker.Writable.write (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/readable-stream/lib/_stream_writable.js:334:11)
at Reader. (/home/pi/MagicMirror/modules/MMM-AssistantMk2/node_helper.js:287:17)
at emitNone (events.js:111:20)
at Reader.emit (events.js:208:7)
at /home/pi/MagicMirror/modules/MMM-AssistantMk2/node_modules/wav/node_modules/readable-stream/lib/_stream_readable.js:934:16
at _combinedTickCallback (internal/process/next_tick.js:131:7)
Some error happens. Try again.

A Former User

@citizendevpi
First, I will abandon this annoying module dependency - Speaker. Sometimes it will not work as my feature. So, currently I’m not making fix about Speaker module. it will be deprecated.
Instead using node module, I will use other stable method - your default audio player program. I’m testing now and it will be released soon.

citizendevpi

@sean you are the man !!! thank you for the info and i will be looking forward to the latest release any time you need anything let me know fyi i love ghost in the shell also keep workin.

Cr4z33

@sean said in MMM-AssistantMk2 & MMM-GAction:

@citizendevpi @Cr4z33
Still got problem?
I’m making whole new update. It will be more stable and easy to install & use. I’ll release this new update in this week. Plz wait a few days.

Fortunately I was busy at getting to work two LED strips so OK I will wait with pleasure hehe.

Thanks for letting me know. :thumbs_up_medium-light_skin_tone:

A Former User

UPDATED (2.0.0)

Whole new build-up.
Annoying speaker dependencies deprecated
More stable. (I think)
Choppy sound issue solved(I think), If you get still this issue, that might be the lack of computing power of your device.
NotificationTrigger dependency free. Now you can activate without NotificationTrigger (But If you want, you can still use it.)
Making Hook and GAction becomes easier
MMM-TelegramBot and other modules supported

Cr4z33

@sean
HURRAY! :man_dancing_medium-light_skin_tone:
Going to implement it right now!

Cr4z33

@sean hmm it is to my understanding that a device ID is mandatory right?

Do you have any idea if the Raspberry Voice HAT can be used with your model?
And if yes how can I find out the device id then? :thinking_face:

A Former User

@cr4z33
Do you mean device ID for audio device?
If you have a sound card(HAT) or audio processing integrated into your motherboard, get a list of all the audio devices on your system by executing this command:

arecord --list-devices

You should get output similar to this:

**** List of CAPTURE Hardware Devices ****
card 0: IXP [ATI IXP], device 0: ATI IXP AC97 [ATI IXP AC97]
  Subdevices: 1/1
  Subdevice #0: subdevice #0

In this case, your recording device is hw:0,0.
You can test with this.

arecord  -D hw:0,0 -d 5 test.wav

For output device, similar. use

aplay --list-devices

Cr4z33

@sean
Thanks for helping a (Raspberry) noob here hehe.

I got a different result:

$ arecord --list-devices
**** List of CAPTURE Hardware Devices ****
card 0: sndrpigooglevoi [snd_rpi_googlevoicehat_soundcar], device 0: Google voiceHAT SoundCard HiFi voicehat-hifi-0 []
  Subdevices: 0/1
  Subdevice #0: subdevice #0

Therefore would my recording device still be hw:0,0?

aplay gave me this:

aplay --list-devices
**** List of PLAYBACK Hardware Devices ****
card 0: sndrpigooglevoi [snd_rpi_googlevoicehat_soundcar], device 0: Google voiceHAT SoundCard HiFi voicehat-hifi-0 []
  Subdevices: 0/1
  Subdevice #0: subdevice #0

I believe it’s the same ID like above right?

A Former User

@cr4z33 Details are dependent with also your asound config. But,
Can you record and play some audio in Terminal?

arecord -t 5 test.wav & aplay test.wav

Can you execute this? tell me the result.

(I haven’t had voiceHAT, so cannot guaranteed, but same name could be available.)

Cr4z33

@sean
I get an error and please note that I’ve tried to translate to English. :winking_face:

arecord -t 5 test.wav & aplay test.wav
[1] 2911
arecord: main:574: unrecognized file format 5
test.wav: File or directory does not exist
[1]+  Output 1                arecord -t 5 test.wav

A Former User

@cr4z33
Try this.

arecord -t 5 -D hw:0,0 test.wav

Does this make test.wav?
If so, try this again.

aplay -D hw:0,0 test.wav

Cr4z33

@sean
Nope. :pensive_face:

arecord -t 5 -D hw:0,0 test.wav
arecord: main:574: unrecognized file format 5

A Former User

@cr4z33

cat ~/.asoundrc

Tell me the result.

How you can setup previously? (I think you purchased that device for Google AIY project. Was there any instructions?)

A Former User

@cr4z33
Oops ! my mistake!

arecord -d 5 -D hw:0,0 test.wav

Cr4z33

@sean said in MMM-AssistantMk2 & MMM-GAction:

@cr4z33
cat ~/.asoundrc
Tell me the result.

How you can setup previously? (I think you purchased that device for Google AIY project. Was there any instructions?)

pi@raspberrypi:~ $ cat ~/.asoundrc
cat: /home/pi/.asoundrc: File or directory does not exist

It’s the so- called Google Voice Kit AIY (https://aiyprojects.withgoogle.com/voice-v1/).

I used a ready meal Raspbian image made by Google.
Apart from creating the JSON file everything else consists of ready scripts (i.e assistant_library_demo.py is a script to runs and uses Google Assistant):
https://github.com/google/aiyprojects-raspbian/tree/voicekit

A Former User

@cr4z33
Hmmm… As I know,

arecord -d 5 test.wav
aplay test.wav

This should work because there is no other suspicious things. your card and device no is 0,0 and that is the default.