Facial Recognition - customize your mirror for every user!

[schlachtkreuzer6]

@desq that is exaclty what i want too :) and save the video file for later… but how? ^^

[bhepler]

@schlachtkreuzer6 Check out the tutorial I wrote for Motion & the mirror. Pretty much the part you’ll have to figure out is how to get a script to update the mirror. Motion can be configured to run a script, save a file, stream a video, etc. from an IP camera. There’s also a streaming server integrated into it, so you could probably put the contents of the IP camera into the stream from motion, and then use an IFRAME to display the stream’s output.

In my research, I found a lot of information on the Motion software, including a couple that were specifically about running Motion on a Raspberry Pi as a security system. Once you have that configured, the next part is just figuring out how to send an alert to your mirror and how you want to display it.

[schlachtkreuzer6]

@bhepler great thanks! I will check this soon :D

[desq]

@bhepler Thank you for your suggestion.

I already have this functionality. (Using my NAS´s “Synology Surveillance Station”).
If a “motion” is detected, I get an “Alert Notification” with a Mjpeg-Stream on my Magic Mirror. Every motion is reported,
so I get a lot of “false positive”.

I would prefer a face detection (and I´m wondering why software like “Motion” and the “Surveillance Station” does not implement these feature.)

Any OpenCV Gurus in the house?

[YourhighnessLeender]

Hi,

I have an issue with magicmirror not detecting my face. I got the training right and verified with the twst tool. The test tool recognizes me very good and quickly.

But whan i launch MM, I just get:
User undefined with confidence null logged in.

I tried tweaking the threshold values, but maybe not doing it right.

Any ideas? Pulling my hair here :-)

[YourhighnessLeender]

I am using an external USB cam.

[nuckinfutz]

Are you sure you put the training .xml file in the right place? Are you sure the training name syntax in your confis.jsg file matches the output from the train.py program you ran? those are about the only 2 things I can think of. Double check those and if you havent found the problem yet post the output from train.py and your config.js

[YourhighnessLeender]

@nuckinfutz Im not sure, tried to put it in the root of the Facial recognition module first, but for some reason it couldnt open the file there (permissons maybe?) So I changed the path in the config.js file to the files original location, (where the training script places it).

I will post output from train.py and my config.js when I get home.

Thoughts of mine:
Is it possible that the web cam captures to low resolution compared to the test script? How do one go avout changing that?

Some permissions problem? Root vs pi user?

If I set the confidence threshold to a much higher number, wouldn’t it eventually recognise anyone as me? (I only have one user)

Thanks for the help!

[YourhighnessLeender]

@nuckinfutz
Ok here is the output from train.py:

pi@raspberrypi:~/MagicMirror/modules/MMM-Facial-Recognition-Tools-master/facetrainer $ sudo python train.py
Which algorithm do you want to use?
[1] LBPHF (recommended)
[2] Fisherfaces
[3] Eigenfaces
--> 1

Reading training images...
--------------------
Assign label 1 to Johannes
--------------------

Read 13 positive images and 400 negative images.

13 images from subject Johannes
--------------------

Training model...
Training data saved to training.xml

Please add or update (if you added new people not just new images) ['Johannes'] inside config.js (mirror module) or config.py (model tester). You can change the names to whatever you want, just keep the same order and you'll be fine.
Please add 1 as your choosen algorithm inside config.js (mirror module) or config.py (model tester).
pi@raspberrypi:~/MagicMirror/modules/MMM-Facial-Recognition-Tools-master/facetrainer $ 

Here is my config.js:

GNU nano 2.2.6                                      File: config.js                                                                                    

/* Magic Mirror Config Sample
 *
 * By Michael Teeuw http://michaelteeuw.nl
 * MIT Licensed.
 */

var config = {
        port: 8080,
        ipWhitelist: ["127.0.0.1", "::ffff:127.0.0.1", "::1"],

        language: 'sv',
        timeFormat: 24,
        units: 'metric',

        modules: [
                {
                        module: 'MMM-Facial-Recognition',
                        config: {
                        // 1=LBPH | 2=Fisher | 3=Eigen
                        recognitionAlgorithm: 1,
                        // Threshold for the confidence of a recognized face before it's considered a
                        // positive match.  Confidence values below this threshold will be considered
                        // a positive match because the lower the confidence value, or distance, the
                        // more confident the algorithm is that the face was correctly detected.
                        lbphThreshold: 50,
                        fisherThreshold: 250,
                        eigenThreshold: 3000,
                        // force the use of a usb webcam on raspberry pi (on other platforms this is always true automatically)
                        useUSBCam: true,
                        // Path to your training xml
                        trainingFile: '/home/pi/MagicMirror/modules/MMM-Facial-Recognition/training.xml',
                        // recognition intervall in seconds (smaller number = faster but CPU intens!)
                        interval: 1,
                        // Logout delay after last recognition so that a user does not get instantly logged out if he turns away from the mirror for a f$
                        logoutDelay: 5,
                        // Array with usernames (copy and paste from training script)
                        users: ['johannes'],
                        //Module set used for strangers and if no user is detected
                        defaultClass: "default",
                        //Set of modules which should be shown for every user
                        everyoneClass: "everyone"
                                }
                },

[PointPubMedia]

@paviro Do you think it can be possible to have a “CURL” call when a user log in and log out ?

[bhepler]

@YourhighnessLeender Check your capitalization. Your training script output was ‘Johannes’ and your config.js has ‘johannes’.

[YourhighnessLeender]

@bhepler thanks! Tried that but still no luck. Started over from scratch, still undefined user. The. Lowercase was me testing if it made any difference.

Cound it be that the webcam captures in too low res when running MM compare to the test script? And in that case, how can I check or change that?

Im a noob with linux and the terminal.

[nuckinfutz]

@YourhighnessLeender You spelled your name as Johannes in the training file and in config.js you spelled it johannes. config.js is a lower case J.

Been there done that. lol…

[nuckinfutz]

@nuckinfutz behelper beat me to it.

[benkej]

Hi guys,

I have the same problem, tried with picam and normal webcam too.
Capture working, train working, facerecognition_tester working, MMM-Facial-Recognition doesn’t work.

Anyone sitting in front of the mirror, I get the message in terminal “User undefined with confidence null logged in”

[nuckinfutz]

@YourhighnessLeender Webcam is fine. If it worked in training it will work in the module.

[YourhighnessLeender]

@nuckinfutz that is whats so strange. It does work in training but not in the module. Did a new install of the module and new training.xml but no luck. Very very wierd.

Maybe I should buy a picam and try with that.

[YourhighnessLeender]

@benkej question: did you change any of the capture settings in config.js? Like threshold etc? I was thinking of trying a different algorithm, did you try that?

[benkej]

@YourhighnessLeender only for trial but I changed everything back to the default. I’m using raspberry pi 3 model b, here is part of my config:

{
    module: 'MMM-Facial-Recognition',
    config: {
        // 1=LBPH | 2=Fisher | 3=Eigen
        recognitionAlgorithm: 1,
        // Threshold for the confidence of a recognized face before it's considered a
        // positive match.  Confidence values below this threshold will be considered
        // a positive match because the lower the confidence value, or distance, the
        // more confident the algorithm is that the face was correctly detected.
        lbphThreshold: 50,
        fisherThreshold: 250,
        eigenThreshold: 3000,
        // force the use of a usb webcam on raspberry pi (on other platforms this is always true automatically)
        useUSBCam: true,
        // Path to your training xml
        trainingFile: 'modules/MMM-Facial-Recognition/training.xml',
        // recognition intervall in seconds (smaller number = faster but CPU intens!)
        interval: 3,
        // Logout delay after last recognition so that a user does not get instantly logged out if he turns away from the mirror for a few seconds
        logoutDelay: 15,
        // Array with usernames (copy and paste from training script)
        users: ["Jani"],
        //Module set used for strangers and if no user is detected
        defaultClass: "default",
        //Set of modules which should be shown for every user
        everyoneClass: "everyone"
    }
}

and part of console log:

[MMM-Facial-Recognition] Facerecognition started...
[MMM-Facial-Recognition] Loading training data...
[MMM-Facial-Recognition] ALGORITHM: LBPH
[MMM-Facial-Recognition] Training data loaded!
[MMM-Facial-Recognition] --------------------
[MMM-Facial-Recognition] Webcam ausgewählt...
[MMM-Facial-Recognition] User undefined with confidence null logged in.
[MMM-Facial-Recognition] User undefined logged out.
[MMM-Facial-Recognition] User undefined with confidence null logged in.
[MMM-Facial-Recognition] User undefined logged out.
[MMM-Facial-Recognition] User undefined with confidence null logged in.
[MMM-Facial-Recognition] User undefined logged out.
^C[MMM-Facial-Recognition] Shutdown: Cleaning up camera...
[MMM-Facial-Recognition] Terminating..

@YourhighnessLeender and the output of train.py:

Which algorithm do you want to use?
[1] LBPHF (recommended)
[2] Fisherfaces
[3] Eigenfaces
--> 1

Reading training images...
--------------------
Assign label 1 to Jani
--------------------

Read 3 positive images and 400 negative images.

3 images from subject Jani
--------------------

Training model...
Training data saved to training.xml

Please add or update (if you added new people not just new images) ['Jani'] inside config.js (mirror module) or config.py (model tester). You can change the names to whatever you want, just keep the same order and you'll be fine.
Please add 1 as your choosen algorithm inside config.js (mirror module) or config.py (model tester).

---

Note from admin: Please use Markdown on code snippets for easier reading!

[YourhighnessLeender]

@benkej same as me, but no luck :-(