MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    MMM-OpenAI

    Scheduled Pinned Locked Moved Productivity
    24 Posts 4 Posters 12.1k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M Offline
      MMRIZE @Rags
      last edited by

      @Rags
      I’ll update the modules with more kind error messages in 1-2days. Plz wait a little

      1 Reply Last reply Reply Quote 0
      • M Offline
        MMRIZE
        last edited by

        1.2.0 (2022-03-06)

        • ADDED : More kind error message (in the terminal console, the display, telegram, and the dev-console)
        • ADDED : Token usage on success in TEXT and CHAT.
        • FIXED : Reducing default max_token for chat. (Too many token limit may cause the error unexpected)

        120_1

        120_2

        1 Reply Last reply Reply Quote 0
        • M Offline
          MMRIZE @Rags
          last edited by MMRIZE

          @Rags
          I found it was token usage issue. I think I fixed it with the new update.

          R 1 Reply Last reply Reply Quote 0
          • R Offline
            Rags @MMRIZE
            last edited by Rags

            @MMRIZE @MMRIZE
            Thanks for the update. Yes now it works fine. I am not getting "something is wrong’ messages, but prompts about the token lengths whenever they exceed.
            Thanks. I hope there will be voice integration soon.

            M R 2 Replies Last reply Reply Quote 0
            • M Offline
              MMRIZE @Rags
              last edited by

              @Rags
              I will not implement Voice-feature into this module directly by myself.
              But I believe other existing voice-related modules could be used together already.

              1 Reply Last reply Reply Quote 0
              • M Offline
                MMRIZE
                last edited by MMRIZE

                @Rags
                Speech example: Conjunction with MMM-GoogleTTS, now it can speak.

                https://youtu.be/daWuSfQc5Ns

                postProcessing: (helper, resp) => {
                  let choice = resp.response?.choices[0]
                  if (choice) helper.sendNotification('TTS_SAY', choice?.message?.content ?? choice?.text)
                }
                
                S R 2 Replies Last reply Reply Quote 0
                • S Offline
                  sdmydbr9 @MMRIZE
                  last edited by

                  @MMRIZE a similar idea has crossed my mind. Using a Hotword detector like the one used in google assignment module to activate a listener for voice and ask for voice input and then using the input provided, get the transcript of the audio using the whisper api or something similar to get the transcript… pass on the transcript as a content in the OPENAI_REQUEST notification and then SHOW_ALERT or just read it out loud using the MMM-GoogleTTS. Just a rough sketch. I’m sure someone out here will come up with more convincing and better ideas.

                  S M 2 Replies Last reply Reply Quote -1
                  • S Offline
                    sdetweil @sdmydbr9
                    last edited by

                    @sdmydbr9 use a GoogleAssistant recipe

                    see it’s recipies folder

                    Sam

                    How to add modules

                    learning how to use browser developers window for css changes

                    S 1 Reply Last reply Reply Quote 0
                    • M Offline
                      MMRIZE @sdmydbr9
                      last edited by MMRIZE

                      @sdmydbr9
                      I have a few already, like MMM-Hotword or MMM-Clap, and some…

                      Anyway new OpenAI’s Whisper looks so interesting, So I’ll make it as a STT module in a few days, hope so.

                      S 1 Reply Last reply Reply Quote 0
                      • S Offline
                        sdmydbr9 @sdetweil
                        last edited by

                        @sdetweil I just meant it as a similar approach, I don’t actually want to implement the whole assistant module.

                        1 Reply Last reply Reply Quote 0
                        • 1
                        • 2
                        • 3
                        • 1 / 3
                        • First post
                          Last post
                        Enjoying MagicMirror? Please consider a donation!
                        MagicMirror created by Michael Teeuw.
                        Forum managed by Sam, technical setup by Karsten.
                        This forum is using NodeBB as its core | Contributors
                        Contact | Privacy Policy