MMM-OpenAI

MMRIZE

@Rags
I found it was token usage issue. I think I fixed it with the new update.

Rags

@MMRIZE @MMRIZE
Thanks for the update. Yes now it works fine. I am not getting "something is wrong’ messages, but prompts about the token lengths whenever they exceed.
Thanks. I hope there will be voice integration soon.

MMRIZE

@Rags
I will not implement Voice-feature into this module directly by myself.
But I believe other existing voice-related modules could be used together already.

MMRIZE

@Rags
Speech example: Conjunction with MMM-GoogleTTS, now it can speak.

https://youtu.be/daWuSfQc5Ns

postProcessing: (helper, resp) => {
  let choice = resp.response?.choices[0]
  if (choice) helper.sendNotification('TTS_SAY', choice?.message?.content ?? choice?.text)
}

sdmydbr9

@MMRIZE a similar idea has crossed my mind. Using a Hotword detector like the one used in google assignment module to activate a listener for voice and ask for voice input and then using the input provided, get the transcript of the audio using the whisper api or something similar to get the transcript… pass on the transcript as a content in the OPENAI_REQUEST notification and then SHOW_ALERT or just read it out loud using the MMM-GoogleTTS. Just a rough sketch. I’m sure someone out here will come up with more convincing and better ideas.

sdetweil

@sdmydbr9 use a GoogleAssistant recipe

see it’s recipies folder

MMRIZE

@sdmydbr9
I have a few already, like MMM-Hotword or MMM-Clap, and some…

Anyway new OpenAI’s Whisper looks so interesting, So I’ll make it as a STT module in a few days, hope so.

sdmydbr9

@sdetweil I just meant it as a similar approach, I don’t actually want to implement the whole assistant module.

sdmydbr9

@MMRIZE I think the Hotword module is not Available anymore and the clap module, might work but it will not look as asthetic as activating with the hot word…

Rags

@MMRIZE said in MMM-OpenAI:

@Rags
Speech example: Conjunction with MMM-GoogleTTS, now it can speak.

https://youtu.be/daWuSfQc5Ns
postProcessing: (helper, resp) => {
  let choice = resp.response?.choices[0]
  if (choice) helper.sendNotification('TTS_SAY', choice?.message?.content ?? choice?.text)
}

I am getting a syntax error in these lines can you please check.
Thanks