MMM-AssistantMk2

sdetweil

related to this topic, I haven’t been able to understand what I need to do.

I am trying to coordinate between the voice module go to sleep/wake up, and my motion detection module MMM-SleepWake.

My displays will not turn off programmatically, so I have to hide/show modules

But you only show what was NOT already hidden at time of sleep.
Voice says sleep, motion says wake… but… I need to know what was already hidden, so I don’t wake them up (restore to same state)…

with MMM-voice we developed a notification process, where the voice module does the sleep, but informs my module who was already hidden… so IF motion wakes up, i don’t accidentally show modules I shouldn’t…

wake up voice command works ok, (changed screenOn to notify my module to wake)
go to sleep is missing…

this is the socketnotification code in MMM-voice.js after voice detects ‘go to sleep’, only if using the hide/show sleep approach

if (notification === 'STAND_BY_ACTION') {
            if (payload.type === 'show') {
                if (payload.hardware === false) {
                    MM.getModules().enumerate((module) => {
                        if (this.previouslyHidden.includes(module.identifier)) {
                            module.show(1000);
                        }
                    });
                    this.previouslyHidden = [];
                }

                this.sendNotification('STAND_BY', { status: false });
            } else if (payload.type === 'hide') {
                if (payload.hardware === false) {
                    MM.getModules().enumerate((module) => {
                        if (module.hidden === true) {
                            this.previouslyHidden.push(module.identifier);
                        } else {
                            module.hide(1000);
                        }
                    });
                }

                this.sendNotification('STAND_BY', { status: true, modules: this.previouslyHidden.slice(0) });

A Former User

@sdetweil
First, this module doesn’t manage module’s showing and hiding itself. Of course I provided some recipe about it, but it’s better to be considered as a just example. The main purpose of this AMK2 is to give an ability about voice command and to relay it to other module. Not to control all things by AMK2 itself.
I think real job should be done by proper extern module. So If you have any good module(which is existed already or be planned to be made by yourself) to manage modules’ showing and hiding(There would be several modules already for this job), just transfer proper commands(notifications) to that module to do its job.

sdetweil

@Sean ok, thanks… still don’t understand recipe process design…

voice triggers command? command is some routine? run in context of module.js?

A Former User

@sdetweil

To catch the specific voice order : use transcriptionHook or gAction. gAction is more natural way for user without side-effect.(something similar with Alexa Skill). But transcriptionHook is easier to make. Here is a just sample.

transcriptionHook : {
  "MY_TEST_ORDER" : {
    pattern: "execute order 66",
    command: "MY_TEST_COMMAND"
  }
}

This will hook your transcription from your speech when you say “Execute order 66”.
But this is just a kind of trigger. The real job(MY_TEST_COMMAND) needs to be defined.

To define what to do when this order is triggered. : define command.

command: {
  "MY_TEST_COMMAND": {
    notificationExec: {
      notification: "SHOW_ALERT",
      payload: {
        message: "Yes, my lord."
      }
    }
  }
}

This shows WHAT TO DO - to emit some notification(“SHOW_ALERT”) which alert module can understand and do as it’s job.

This is basic concept.

sdetweil

@Sean said in MMM-AssistantMk2:

which alert module can understand and do as it’s job.

well, SOME module MAY or may NOT understand and process

A Former User

@sdetweil
Yes. indeed. But it’s that module’s own business. Those kinds of modules are not designed to WORK TOGETHER with other modules. Sorry, but it’s not my fault.
In that case, you can execute module’s internal method by force. (Of course it is also not proper in some modules.)

command: {
  "MY_TEST_COMMAND": {
    moduleExec: {
      module: ["alert"],
      exec: (module, params, key) => {
        module.show_alert({message:"Yes, my lord."}) // this code might make an error on real usage, but you can catch what I mean.
      }
    }
  }
}

Anyway, you can build your own module for your specific job when there is no module to use.

teitlebot

@sean
Im planning on using face recognition to show compliments when someone approaches mirror. Or maybe just PIR sensor. Either way, how would I get the compliment text to be said by Google? Would this be difficult?

A Former User

@teitlebot You need just TTS(MMM-TTS, MMM-GoogleTTS you can find). Not google Assistant. AI assistant normally be performed by CONVERSATION (text or vocal). face recognition is not CONVERSATION.
If your face-recognition module can emit some notification, MMM-TTS/MMM-GoogleTTS can use that signal as a trigger for speech. (If you need, MMM-NotificationTrigger also could help to relay notification between modules.)

ejay-ibm

@Sean @teitlebot
Might sound stupid and not feasible at first but this is how I would do the trick.
1st I would use a Notification from input ( camera , pir sensor)
for PIR sensor it would be PRESENCE_DETECTED .
Then I would trigger a command and in this command use the repeat after me function .
So you can get voice output directly from the assistant saying “hello” when presence is detected .
Then for facial recognition it’s just a matter of condition and what notification to send. for each notification a different repat after me.

Does it make sense?

Ejay

A Former User

@ejay-ibm @teitlebot
Maybe possible.
Converting PRESENCE_DETECTED to ASSISTANT_SAY with some payload(“Good morning sir”) could be. you can modify PIR module itself or use MMM-NotificationTrigger instead.