MagicMirror With Face Recognition

mchan

This is my first Magic Mirror project. Here’s a video of how it looks when it’s running:
https://youtube.com/shorts/tneDVz6mku8

It utilizes the following existing modules with slight modifications and styling

Clock
Used as is with some CSS styling

Weather
Adjusted the layout and styling of the module and added the hourly forecast section

Calendar
Adjusted the layout and styling of the module to highlight the first item in the calendar.

MMM-Videoplayer
Used this module to display a new ASL video each day from a library of videos stored locally. The playing of the video is controlled through the gesture sensor.

MMM-GroveGestures
Uses the GroveGesture Sensor(PAJ7620u2) to register a swipe which activates the ASL sign of the day module. Currently this is the only swipe gesture being used.

MMM-Face-Recognition-SMAI
Uses a Camera Module 3 and Open CV to recognize faces and then sends an HDMI CEC command to turn the screen on or off.

The face recognition was one of the most difficult parts because, while the module is fairly simply, it assumes that you’ve installed OpenCV and trained a face recognition model which took me a bit of research and few tries to figure out and get right. Overall I’m pretty happy with the outcome.

Hardware
(updated since I forgot to post it originally)

Raspberry Pi 4
Raspberry Pi Camera Module 3 (used for face recognition)
GroveGesture Sensor (Used for swipe commands)
I think the mirror was originally from IKEA. I swapped out the mirror with a piece of MirrorView glass

sdetweil

@mchan Do you use reco-SMAI to provide different modules to different users like reco-dnn?

mchan

@sdetweil Not currently. Right now it is just used to turn the screen on when it detects a recognized user and then turn the screen off when no recognized users are present. It can definitely be used to display different modules per user but I’ve not had the time to put additional modules in place.

sdetweil

@mchan cool.

mariosgouros

Really great and unique idea!

OliWer

This looks pretty cool. Nice work with the styling.
Can you let me know which hardware you are using? Like the sensors and where is MM running on?

Snille

Nicely done!
What computer hardware are you using? RPi5?

mchan

@Snille @OliWer Here is the hardware for the project:

Raspberry Pi 4
Raspberry Pi Camera Module 3 (used for face recognition)
GroveGesture Sensor (Used for swipe commands)
I think the mirror was originally from IKEA. I swapped out the mirror with a piece of MirrorView glass

monark

@mchan hi man, is awesome mirror.
Can you explain how you did it with opencv?
i get to the point of installing that and then i stop and it messes up the system and i have to do it all over again every time. i use an rpi4 and now i have a v3 camera, before i had a v2 camera.
thank you for answer me

cyberphox

Get a GitHub and share that config! Wow!