MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    MMM-voice

    Scheduled Pinned Locked Moved Utilities
    voice control
    329 Posts 55 Posters 930.8k Views 50 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • strawberry 3.141S Offline
      strawberry 3.141 Project Sponsor Module Developer @dogfeet
      last edited by

      @dogfeet i don’t know why it is FALL instead of VOICE in your case?

      this is the code https://github.com/fewieden/MMM-voice/blob/master/MMM-voice.js#L203-L217

      the important parts are if (notification === 'VOICE') and this.sendNotification(${notification}_${payload.mode}, payload.sentence);

      how can notification be voice and a few lines later it is fall? did you modify any files?

      Please create a github issue if you need help, so I can keep track

      D 1 Reply Last reply Reply Quote 0
      • D Offline
        dogfeet @strawberry 3.141
        last edited by dogfeet

        @strawberry-3.141 yes i did modify mmm-voice.js to suit my needs. to explain, i have a total of 5 commands. “fall” is the first mode and is native to the voice module, under which i have 2 commands, “asleep” and “wake up”. so i say “hey mirror” (my listen command), then “fall asleep” and it cuts out the monitor, then since it’s already in “fall” mode i just say “wake up” and it turns the display back on. the final commands are for the compliments module and they are “how do” (the mode) and “i look” which is where i’m having problems. fall asleep and wake up are working perfectly.
        so yes, i modified the lines that you highlighted such that the 2 places where it used to say ‘VOICE’ it now says ‘FALL’.
        should i not have done that? it seems to work. i had to make other minor changes of course to keep it working.

        strawberry 3.141S 1 Reply Last reply Reply Quote 0
        • strawberry 3.141S Offline
          strawberry 3.141 Project Sponsor Module Developer @dogfeet
          last edited by

          @dogfeet if you changed that, then you also have to apply your renamin here

          if(notification === "FALL_HOW DO" && sender.name === "MMM-voice"){
                  if(/(LOOK)/g.test(payload)){
                      this.hide(1000);
                      this.updateDom(300);
                      // unhide the module,
                      // set a 10 sec timeout
                      // hide your module
                  }
              }
          

          Please create a github issue if you need help, so I can keep track

          D 1 Reply Last reply Reply Quote 0
          • D Offline
            dogfeet @strawberry 3.141
            last edited by

            @strawberry-3.141 i feel so stupid :facepalm:

            1 Reply Last reply Reply Quote 0
            • D Offline
              dmwilsonkc
              last edited by dmwilsonkc

              So I must say the MMM-voice module (also with Mykle’s Hello-Lucy enhancements) works perfectly on my mirror… when I don’t have my Mycroft AI running at start as well. It’s an Error: resource busy/unavailable referring to the Microphone. When I stop Mycroft/restart mirror it works perfectly, but then Mycroft gets the same error. Any suggestions?

              I am thinking about building a MagicMirror skill for Mycroft, but Mycroft is Python not Java, and not a module. Would it be possible to send the same commands as Hello-Lucy (i.e. ‘HIDE_CLOCK’ for example) only use Websocket-client for Mycroft and send commands to the MagicMirror via socket.io?

              If so, what would handle the socketmessage? Would it be communicated to the right module/s. Would I also need to create a fork of the MMM-voice module with code to handle the socketmessages from Mycroft?

              Any guidance would be much appreciated!

              Sorry, I should have also said my mirror is running on a RPi 3b running Debian Jessie on a 16gb sd.

              strawberry 3.141S 1 Reply Last reply Reply Quote 1
              • D Offline
                dmwilsonkc
                last edited by

                This post is deleted!
                1 Reply Last reply Reply Quote 0
                • strawberry 3.141S Offline
                  strawberry 3.141 Project Sponsor Module Developer @dmwilsonkc
                  last edited by

                  @dmwilsonkc Error: resource busy/unavailable referring to the Microphone your microphone cannot be used by multiple processes at a time.

                  In your case I rather suggest to write an own module for mycroft instead of a fork, as you’re using a complete different stt engine.

                  If you’re interested in doing it via websockets you could have a look into mmm-mobile where i did something similar

                  Please create a github issue if you need help, so I can keep track

                  1 Reply Last reply Reply Quote 0
                  • D Offline
                    dmwilsonkc
                    last edited by dmwilsonkc

                    @strawberry-3.141 So I guess I kind of understood what is happening with the MMM-Mobile module of yours. I am very new to all of this and have only been dabbling in writing simple code up to now. It is much easier to build off of existing code that I know already works. If I could figure out a way to continuing to use your MMM-voice module and Mycroft at the same time, I would probably just do that, but as you pointed out both processes can’t use the microphone at the same time. Since Mycroft skills seem pretty straight forward to create, I thought eh… Why not attempt it.

                    I can create a Mycoft skill that will send ‘HIDE_CLOCK’ for example to socket.io. What happens when the Websocket-client for Mycroft connects to socket.io and sends ‘HIDE_CLOCK’? How would MagicMirror handle that?
                    Keep in mind, I have already added Mykle’s modifications from Hello-Lucy.

                    That’s part of what I can’t wrap my head around.

                    Thank you for responding and helping me!

                    strawberry 3.141S 1 Reply Last reply Reply Quote 0
                    • strawberry 3.141S Offline
                      strawberry 3.141 Project Sponsor Module Developer @dmwilsonkc
                      last edited by

                      @dmwilsonkc the module has a socket like https://github.com/MichMich/MagicMirror/blob/master/js/socketclient.js#L11, basically its a channel with the module name, if you then send messages, the module doesn#t differentiate if its from mycroft or node_helper, as it isnt aware of multiple entities.

                      Please create a github issue if you need help, so I can keep track

                      1 Reply Last reply Reply Quote 0
                      • D Offline
                        dmwilsonkc
                        last edited by

                        @strawberry-3.141 Oh! Wow! That was awesome! You opened my eyes. I really am starting to understand better thanks to your incite. That makes perfect sense to treat Mycroft more like a remote-control than a voice-control because it handles the STT and can send socket messages to the MagicMirror. The MMM-Mycroft module would need to be very similar in function to your MMM-mobile module.

                        For example it could have a number of ways to control the MagicMirror:

                                socket.on('SHOW_MODULES', () => {
                                    console.log(`${this.name}: Showing modules!`);
                                    this.sendSocketNotification('SHOW_MODULES');
                                });
                        
                                socket.on('HIDE_MODULES', () => {
                                    console.log(`${this.name}: Hiding modules!`);
                                    this.sendSocketNotification('HIDE_MODULES');
                                });
                        

                        Just as an example to handle the messages sent to the socket.

                        If I’m reading your code right, you’re using a qr image to handle security. I hadn’t really thought about the need for security with something like this, but I guess that really should be a consideration. In your opinion, would requiring some kind of user password/key set in the config for both MMM-Mycroft module and the Mycroft MM skill be sufficient?

                        strawberry 3.141S 1 Reply Last reply Reply Quote 0
                        • 1
                        • 2
                        • 28
                        • 29
                        • 30
                        • 31
                        • 32
                        • 33
                        • 30 / 33
                        • First post
                          Last post
                        Enjoying MagicMirror? Please consider a donation!
                        MagicMirror created by Michael Teeuw.
                        Forum managed by Sam, technical setup by Karsten.
                        This forum is using NodeBB as its core | Contributors
                        Contact | Privacy Policy