mmm assistant mk2

dvbit

@Bugsounet I will ask your advice on a simple js helper plugin for the C kinect gesture proggie I wrote. It would be nice to integrate it in a2d plugin

dvbit

@Bugsounet @sdetweil https://drive.google.com/file/d/1mFsoz7ozNJ8Lc0-774D56SGqROIo3CP_/view?usp=drivesdk

eheh jumping from a pc (cleaning lady chased me away(, to another to a phone (discharged), to another PC.

the short clip above is the MM started .
I ask what time is it in italian
answer is retrieved
display but no audio
then keeps spinning
If I refresh through vnc, spinning goes away (I haev not tried another invocation)

A Former User

yes why not but i have Kinect for testing
i see your video, but i see something weird …
What is the windows in the top of the video ?

dvbit

If I find a good proposal on ebay I can buy you one . After all you are doing for the community if you like it’s a minimum. Should I look for France as delivery? It will work just with a Raspberry 4 however (below are not powerful enough). I really would like to be able to program in JS . I am dreaming of a play plugin like this https://www.youtube.com/watch?v=KLOB-T1mgdY . My son is waiting for it since he saw the video :-D. Ok I confess: I would like too
Do you refer to the chromium top? I am testing so I do launch it not in full screen (But I tried in full screen too)

Chris

Small feedback after installation and use:

it works very well.

I find it more fluid than the previous version. when invoked, it responds almost instantly. Before I used MMM-Hotword. I went on the integrated snowboy. Perhaps the speed of response comes from there.
I have multi task. I can play a youtube clip on the mirror and at the same time ask the assistant for a home automation or other command. Before that did not work.
I go through the Sony PS3 eye for the listening part. I did not have a problem with this one after the update.

In short, that happiness.

@Bugsounet
The work you have done is truly superb. Congratulations to you all.

Regards,

A Former User

I have optimized a maximum
my personal npm library help to do this, and deleted some bad code and recode new.

And … only few file in the git hub repo ! (my new install method)

for a final result less RAM used and less CPU time (in idle: CPU 4% // approx 300 MB Ram)

dvbit

@sdmydbr9 this happened to me too. It’s just that the error that is happening has a side effect the deletion of the index file. repull it.
After fixing the main problem this will not happen anymore

dvbit

@Chris said in mmm assistant mk2:

Small feedback after installation and use:

it works very well.

I find it more fluid than the previous version. when invoked, it responds almost instantly. Before I used MMM-Hotword. I went on the integrated snowboy. Perhaps the speed of response comes from there.

I have multi task. I can play a youtube clip on the mirror and at the same time ask the assistant for a home automation or other command. Before that did not work.

I go through the Sony PS3 eye for the listening part. I did not have a problem with this one after the update.

In short, that happiness.

@Bugsounet
The work you have done is truly superb. Congratulations to you all.

Regards,

Hi One question: were you successful with the sound wizard setup?
Could you share the asoundrc file (hidden file located in your home directory)?
I agree the plugin is just perfect (had it working but then I broke something)

A Former User

to regenerate it:

go to desktop of the RPI

Right click in the sound icon
-> select your prefered Output device
-> select your prefered Input device

Maybe reboot is needed after this (for MagicMirror app)

A Former User

Tips For all

Don’t Forget to activate hardware acceleration of rpi in raspi-config (OPEN GL)
needed for YT video / cast / weblinks in fullscreen and for have more reactive mirror

dvbit

@Bugsounet So I have "Output Device Settings " item greyed out in desktop sound menu.
entries:

Analog
HDMI
USB Kinect Audio
Output Audio Device Settings : Greyed out

Edit:
Before sending Firmware to Kinect after boot (to enable it) the Ouput Device Settings Option is NOT there (also no Kinect Audio available)
After sending it both Kinect and Output Deive Settings Appear

trying to play the response using cvlc works but there is a PulseAudio error:

VLC media player 3.0.8 Vetinari (revision 3.0.8-0-gf350b6b5a7)
[01cb1d60] vlcpulse audio output error: PulseAudio server connection failure: Connection refused
[01cd0fc8] dummy interface: using the dummy interface module...

Now rebooting and trying the plugin without uploading kinect audio firmware.

By the way the Pulseaudio refuse seems to me consistent with the failed audio for the plugin

DOH! I cannot try the plugin without the kinect audio firmware pushed (no other mic is attacched)

dvbit

@dvbit said in mmm assistant mk2:

HDMI

One little Step ahead.
Disabling Audio Output gives no audio feedback but then the mirrorr goes back into waiting state.
So it get’s stuck in “Spinning State” because the audio fails.
Maybe it’s obvious but I think it is interesting.

and this from the log is also useful:

[2020-06-01 19:27:11.533] [LOG]    [SNOWBOY] Retry restarting...
[2020-06-01 19:27:13.588] [LOG]    [LPCM16] WARN: arecord: main:828: audio open error: Device or resource busy

[2020-06-01 19:27:13.589] [LOG]    [SNOWBOY] Retry restarting...

So my audio ouput device is "owned " by some other process I guess

aplay -l gives:

pi@MagicMirror:~/MagicMirror $ aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: b1 [bcm2835 HDMI 1], device 0: bcm2835 HDMI 1 [bcm2835 HDMI 1]
  Subdevices: 4/4
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
  Subdevices: 4/4
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3

sdetweil

@dvbit do

ps -ef | grep aplay

and see if its still running…

dvbit

@sdetweil nope I just grep my grep :-D

reddyman

Hmmm sorry to go a bit off topic but has anyone tried the new Assistant2Display module with the new GoogleAssistant? I can’t get it to work but I suspect I am missing something very obvious. I just don’t know what.

I can’t get the screen, briefToday, or Pir to work. I don’t get any errors, just nothing happens.

Config file:

{
  module: "MMM-GoogleAssistant",
  position: "fullscreen_above",
  config: {
   A2DServer: {
      useA2D: true,
      }, 
    assistantConfig: {
      //latitude: 51.508530,
      //longitude: -0.076132,
      },
    micConfig: { // put there configuration generated by auto-installer
      recorder: "arecord",
      device: "plughw:2",
      },
    snowboy: {
      Model: "smart_mirror", 	
	},
    }
},
{
  module: "MMM-Assistant2Display",
  position: "top_left",
  config: {
    debug:true,
  },
  pir: {
      usePir: true,
      pin: 4,
      reverseValue: false
  },
  screen: {
  useScreen: true,
  delay: 1 * 60 * 1000,
  turnOffDisplay: true,
  ecoMode: true,
  displayCounter: true,
  text: "Auto Turn Off Screen:",
  detectorSleeping: false,
  governorSleeping: false,
  rpi4: false
},

briefToday: {
      useBriefToday: true,
      welcome: "brief Today"
    },

},

I don’t see the debug working either? Nothing generated on the terminal while the mirror is running at least.

[2020-06-01 16:51:49.870] [LOG]    [ASSISTANT] MMM-GoogleAssistant Version: 2.0.0
[2020-06-01 16:51:49.885] [LOG]    [SNOWBOY] Model selected: smart_mirror
[2020-06-01 16:51:49.893] [LOG]    [SNOWBOY] snowboy v1.5.0 Initialized...
[2020-06-01 16:51:49.902] [LOG]    [ASSISTANT] Assistant2Display Server Started
[2020-06-01 16:51:49.908] [LOG]    [ASSISTANT] Google Assistant is initialized.
[2020-06-01 16:51:49.916] [LOG]    [A2D] MMM-Assistant2Display Version: 2.0.0
[2020-06-01 16:51:49.928] [LOG]    [A2D] Assistant2Display is initialized.

Anyone see what I’m missing? I suspect it’s something super simple but I can’t figure out what.

sdetweil

well, I though i’d give it a try… see what all the fuss is about!

on the install y/n prompts, the protocol is the Uppercased letter is the default, so whn you hit enter is does the default
it doesn’t do anything, have to enter Y or N (and then it takes off without waiting??)
audio doesn’t work for me…
and none of the choices match the system config (and none of them work)
system config, sounds fine, music, web sounds, system sounds.

aplay -l info
Screenshot at 2020-06-01 16-54-32.png

dvbit

A big thank You to @Bugsounet for his help in troubleshooting.
It was nothing to do with the modules but with my asoundrc config.
the ouput card/device were not correct.
Thanks again!

A Former User

@dvbit: no problem ! with pleasure ;)

A Former User

@reddyman : turn on modules. just YouTube by default is turn on
link / photo is disabled by default

 config: {
    debug:true,
    // make you config there !
  },
 // not there
....

reddyman

@Bugsounet said in mmm assistant mk2:

 config: {
    debug:true,
    // make you config there !
  },
 // not there
....

…I am an idiot. Hahaha, I knew it was something super simple. Smh, thanks for putting up with idiots like me :p