Smart Mirror

Smart mirror with a virtual assistant like Jarvis in the iron man movie based on Raspberry Pi 2

Sathish Kumar

Following Follow project

Liked Like project

Become a Hackaday.io member

Just one more thing

To make the experience fit your profile, pick a username and tell us what interests you.

OK, I'm done! Skip

Similar projects worth following

13.4k views

6 comments

153 followers

88 likes

The 2016 Hackaday Prize

View Gallery

Description

I had this idea for a long time. Now i have started developing it. This is a mirror which will have an personal assistant which can do natural language processing. Face,voice & emotion recognition. Also i am going to integrate it with a weigh scale and LIDAR so it can tell your weight and BMI easily . Also it can suggest you the diet plans. Also i am going to integrate it with the the home appliance so you can control your devices by voice. Also i am planning on to implement lot of features like voice search example if you need to buy a smart phone you can ask it .. will tell you and show you which smart phone you can buy with reviews and cost comparisons.

Details

How it works?

It basically a two way mirror. In which a display or an old monitor is being connected to the back. To make it simple and cheap we can use raspberry pi. This is entirely developed with help of python and qml. I will opensource the entire code once the work is done.

Features:

Natural language processing
Face recognition
voice recognition
emotion recognition
BMI calculator
Diet plan suggester
user profile
can help you buy products online.
Weather forecast
Network Security functions like Nmap, Mass scanner, Metasploit etc..
Voice controll of appliances
Notifications

Phase one:

Note*: As of now i have used the Cortana animation. Later i will redesign the ui

Project Logs

Collapse logs

Status Update
Sathish Kumar • 03/27/2016 at 06:42 • 0 comments

Face recognition has been done with the help of the opencv. Now its capable to tell who you are . And also it can enroll unknown face by voice command.
Do you know me ?
if face found it will say your name and some greetings
if unknown face found. It says, We have never met before, may i know your sweet name please.
Then it enrolls the face to the user given name..
To Do
Emotion Recognition and pulling similar photos of that person from facebook and google.

View project log

Discussions

rcanpolat wrote 02/21/2017 at 00:53

Are you still working on this project?

Are you sure? yes | no

ReapeRum wrote 02/04/2017 at 23:52

this would be a great a integration into homes also i would like a look at my project and could you give me tips or any advice on it?

Are you sure? yes | no

mightymouseiii wrote 05/20/2016 at 16:20

Could you use a light sensor for activation? Or to wake it up? I want to make a smart mirror for my bedroom, but I wouldn't want it waking me up or turning on in the night. I figured a light sensor or an alarm that could wake me up might be easiest.

Are you sure? yes | no