Friend companion made of memories?

3t1s

Hi everyone, I’m new here!
I’ve been trying to make a gift to my bf, a smart mirror who’s also a companion, a friend with whom he can interact with every morning and so on.

A “friend” that talks to you daily and says nice things and can reply back to you when asked a question or two. And by question I don’t mean “What’s the weather today?” but more like “How are you doing today?”

Is that possible? Has it been done here before?

Thank you!

MMRIZE

@3t1s
There are some AI powered modules; (GoogleAssistant, OpenAI, …)
But, usually, they would be more like What's the weather today, not How are you doing today.
And handling voice is not so easy. Only few modules are working at this moment.

3t1s

@MMRIZE Ohhhhh I see…I recall that one project posted on Youtube with the guy speaking to the mirror but that was 7 years ago so I was hoping something new had come up in the meantime.

sdetweil

@3t1s MagicMirror’s core design is a passive, output only, composable information panel.

one can add other components to enable voice, and tts output, BUT the other add ons don’t know and generally don’t have interactive support

MMRIZE

@3t1s said in Friend companion made of memories?:

@MMRIZE Ohhhhh I see…I recall that one project posted on Youtube with the guy speaking to the mirror but that was 7 years ago so I was hoping something new had come up in the meantime.

Yup, maybe it was me. :D

3t1s

@MMRIZE Oh wow nice to meet you sir! You made a great project back then! I was looking to make a gift for my best friend that would remind him of his “imaginary friend”, which “used to make compliments to him” like “you’re beautiful today” and stuff like that.

MMRIZE

@3t1s
Maybe this is a most similar thing that you want;
https://github.com/bugsounet/MMM-GoogleAssistant

3t1s

@MMRIZE Ok never seen this one before! I read about the translation part and that it doesn’t make the “mirror” speak in that language. Isn’t it possible to make it speak in another language?
I’m not too used to google assistant but I thought it could reply back in let’s say italian…

sdetweil

@3t1s it can only reply in languages supported by Google Assistant.

3t1s

@sdetweil Ok so that should be fine then, thank you!

MMRIZE

@3t1s
https://developers.google.com/assistant/sdk/reference/rpc/languages
These languages may be supported. (For this module, you’d better ask Here because the owner of the module will answer only in his place, not in this forum.)

3t1s

I just saw your other project with OpenAI. Wouldn’t that be more “smart”? I would like to give a small personality and tastes to the AI (like being vegan, loving pizza, being an ambientalist and so on).

MMRIZE

@3t1s
Well, you can give some “Character” to your AI, Like this;

But to be honest, there might be some annoying things;

Somewhat old. It was two years ago, and I never touched it for a while, so I don’t know if it still works. (By default, I never touched my modules unless somebody needs/requests updated features)
- I have a plan to update this module in the future, but I am not sure when exactly I will. :D
This module doesn’t have voice-related features. It is designed for collaboration with other modules(for input/output) (e.g. MMM-TelegramBot), So some other voice-related modules(like hotword detector, STT and TTS) are needed to be used as voice assistants. but it’s your job to combine them. (Maybe you need some skills or experiences)

MMRIZE

@3t1s
Ah, one more issue? problem.

Unlike Google Assistant, OpenAI doesn’t know the real-time environment or you by default unless those kinds of data are injected. It means it cannot answer How's the weather today? or What is my next appointment?. Well, until now, it is not so useful.
To teach that kind of data, it needs more codes, and that is what I will update on the next version. (but still plan… :D)

3t1s

@MMRIZE Ohhhhh ok, that makes sense then! Will stick to the Google Assistant then. 2 more things: Can it be activated by saying let’s say Kevin instead of Jarvis? And can it say “Goodmorning beautiful” instead of showing it on the display? Maybe I’m asking for too much and I’m sorry if I’m bothering you I just want this to “bother” my friend in the morning be speaking to him everyday at 7-8am ahah.

MMRIZE

@3t1s
That is called custom hotword detection. I have no idea which hotword detector is used in MMM-GoogleAssistant by default currently.(Maybe porcupine? it has that feature - custom hotword). Ask to module owner in his place.

3t1s

@MMRIZE Oh I see…will have to read more about that then, thank you! And what about the frame and the screen? Where do I get some more info how to get/do them? Thanks in advance. Truly appreciate your time dealing with me!