Close

Does this project spark your interest?

Become a member to follow this project and don't miss any updates

Project Jarvis - A.I Home Automation & Assistant

Intelligent home automation hardware and software on a budget which utilizes a full home personal digital assistant and electricity savings

25 574 316
Enjoy this project?
Share on twitter   Share on Facebook

This project was created on 05/22/2014 and last updated a day ago.

Description
We have smart cars, smart phones and even smart T.V's. It's time to bring smart homes to the future.

Project Jarvis is designed with Artificial Intelligence (A.I) in both software and hardware which allows the computer system to make smart decisions based on environmental factors. This means the system can help save energy in your home, reducing your monthly bills exponentially and saving the Earth! That's not all though, Jarvis is a personal assistant found throughout your home and Android device. He can make you coffee in the morning, wake you up with weather and you can even speak to him. You can even tell him to switch off all the lights in your room before you go to bed and it will be done instantly. Do you have a complex maths equation or assignment? Not to worry, Jarvis can answer all your questions and even complete full research reports for you.

It's all driven by sophisticated hardware and software to help make your life, and the life of others, much better.
Details

Key Features (At a Glance)

- A.I Home Automation

- Energy Savings Efficiency

- Voice Recognition and Speech Synthesis

- Enhanced Security and Safety

- Entire House Wide Virtual Assistant

- Sleep Pattern Tracking

- World Wide Web Enabled Home Automation

- Custom Android Application and Computer Software

- Low Cost (Under $200)

- Research Report Compilation, Question Answering (Including mathematical equations)

- Any hacked appliance or device can work with this system


Jarvis In-Depth


Intelligent Automation

Jarvis is the name of Iron Man's computer system which manages his home, hence the name of this project. The main aspect of Project Jarvis is to help save electricity in your home which then helps save the Earth and of course, helps save a bit more money each month. The electricity usage is logged per room into an SD card on an open source micro controller such as an Arduino or Raspberry Pi, I chose Arduino. The code on the MCU then interacts with a larger more complex network known as a neural network which has been programmed in a separate application. This software then makes intelligent decisions using the environment and its sensors to help beat the current months data which is still on the SD card. Jarvis will attempt to save more energy than the previous month without getting in the way of your usual living style.

Who is Jarvis?

Jarvis is a virtual assistant, similar to Siri but with a lot more power. Jarvis is the brains behind all operations, he makes the choices and decisions for home automation and much more. Jarvis is based off Artificial Intelligence and is capable of answering complex questions, maths equations, reading social network messages, conversing, being a top class assistant and much more. Jarvis speaks back through speakers located in the rooms and you can speak to him! That's right, if you have a question, simply ask it wherever you are in your home. You don't need to pull out your phone and ask Jarvis to do something, he is always there. Jarvis is wherever you are, in the home, office and in your pocket if you use our Android mobile app.

Energy Efficiency

Every home has lights, appliances and other electronic or electrical gadgets. These all consume energy even if you aren't present in the room. Jarvis is smart enough to switch off lights and unused appliances when you walk out the room. If you turn on a light in your room, Jarvis will compare that specific lights consumption in real time and compare it to data from other lights. If it detects that the light you have on is less efficient, Jarvis will automatically switch that light off and turn on a more efficient light instead. How about automatically switching off cell phone chargers when your phone is disconnected? All these small things in human error or laziness add up in energy consumption and on your monthly bill. Jarvis is here to help make energy savings available to everyone without the owners even noticing. He logs data periodically and that data can be used to help reduce more electricity where possible each month. This way Jarvis will always strive to exponentially increase energy savings and decrease your bill.

Ease of Living

With Project Jarvis is your home, you no longer need to remember if your T.V or stove was left on. Simply login to the web app and switch them off manually or let Jarvis do it automatically. You can always check in on your home and turn appliances and lights on or off from anywhere in the world off any internet connected device. If you have kids, you can always check up on them. Are they doing their homework? No? Well simply turn off the T.V or their gaming console from your fingertips. Whether its by voice, gesture recognition, web app, computer app or mobile app, Jarvis has you covered.

Notifications

Jarvis is capable of reading notifications, cellular messages, social network news feeds and so much more. He can even reply to those messages for you if you tell him what to say. Jarvis converts all...

Read more »

Components
  • 8 × 5 Volt 10 Amp Relays Look for G5L Relays in EagleCad for pin layout
  • 1 × 74HC595 SMD Latch enabled shift register
  • 8 × EL357N-C Opto-Isolators. Any 4 pin, transistor output isolator will work
  • 8 × 2N2222 Transistors Discrete Semiconductors / Transistors, MOSFETs, FETs, IGBTs
  • 8 × 1N4007 Rectifier Diodes Rectifier Diodes
  • 20 × 560 Ohm Resistors +-5% Resistors
  • 20 × 220 Ohm Resistors +-5% Resistors
  • 20 × 660 Ohm Resistors +-5% Resistors
  • 8 × Blue LED's 5mm Blue LED's. Any will work but adjust your resistor value
  • 10 × Pin Headers 3mm Spaced Headers. Same as Arduino. Use what suits you

See all components

Project logs
  • Build Details for Motorized Door Lock

    a day ago • 0 comments

    I've finalized my door lock and it's ready for the community to build. You will need a 3D printer unfortunately, however if you would like one, I can sell it to you for the price it took to make, a few dollars. 

    Anyway head on over to thingiverse and download the model. All instructions are posted there to help build the gadget. The model works very well and its very strong once you've locked your door with it. 

    This door lock was also featured on the official Makerbot website! You can read the short story here.

  • Wall Mounted Tablet Update

    a day ago • 0 comments

    Here's an update on our Jarvis wall panel tablet. I have mounted it on one of my bedroom walls and wired it for power however I still have an Ethernet cable to route for internet access on the tablet. I have a few more things left like building a power button and maybe putting some LED's. You can see how the tablet looks in the two images below. I have also made an application specifically for use with this tablet which can also be seen below.

    Here is the software I have built for it. I am going to incorporate Amazon shopping along with the grocery service they offer. Of course music for those early morning wake up tracks :D, but it will be a fully featured media centre that can stream from other devices. I'm going to do that later down the time line. I also have a space left for weather. From there you can see very detailed stats, a bit more information than what your iPhone provides and this will be able to display the info on screen, push to your phone(Maybe) and obviously tell you the info when you wake up via voice. The "Home Layout" tab will be replaced with "Home Essentials" and that's where weather and all the extra stuff can be found. I might also replace "Notes" with something more essential once I can find something I need. If I do, notes will be moved over to "Home Essentials". Notes basically stores all your notes, ideas, calendar events, etc. So far the home automation works, Music and Notes. Weather does also work however I didn't build a GUI for it yet. Next week I expect this software to be completely done and you'll be able to download the source. Our artist is also working on the home screen graphics which is why some are missing.

    NOTE: The app is built to run on the Beaglebone's LCD 7" Cape. The resolution is 800*480 and this app is designed to run in full screen. 

  • Jarvis Security Update

    a day ago • 0 comments

    To add to our security functions I've decided to incorporate RFID. To save space and time, I've fitted it inside out fingerprint scanner just below the actual scanner. I had just enough space to fit the coil and so it helped save on wall space and time in terms of designing and printing another case. I've decided to use an Atmega 328 to add functionality for the RFID reader. I did this because someone might want to use 50 cards and we are short on memory due on our other MC unit used to control the scanner. It requires a 2 step process, you want to scan and get the code first then hardcode it into the program. In 2 weeks I will incorporate this with the keypad so you can register cards without having to upload new code every time. Unfortunately I have no images at this time but I'll have a short demo hopefully later today which shows the fingerprint scanner as well.

View all 27 project logs

Build instructions
  • 1

    The most important instruction, be very cautious! We are working with AC and you can easily shock yourself. Here are some steps to take when altering or modifying AC light / plug connections:

    1) Wear rubber soled, fully closed work or electricians boots.

    2) Switch off power to the room you are working in via the main distribution board.

    3) Use at least 1000v rated electrician screwdrivers. Do NOT use motor driven or other types of screwdrivers.

    4) Test the voltage in the socket using a well rated multimeter. Only proceed if you see 0v. If not, switch off the power from your D.B.

    5) If you remove wires, make sure you cover the uninsulated ends with electrical tape just to be extra safe.

    6) Once you have finished your modifications, make sure everything is well secured. You do not want wires popping out the next time you open the socket. Double check all your connections and then close up the socket.

    7) Switch the mains on and you can now test out your circuit.

    (Pictures coming soon)

  • 2

    The first thing to build is our relay board controller. These are simple to build because I've already created (Not yet tested) all CAD files which includes complete schematics and boards. You can find all downloads which are open source under the featured images of this project, look for the link to my Dropbox folder where everything can be downloaded and imported into EagleCAD.

    Pick your favourite relay controller! We have 4, some are cheap, some are safe, some are huge, some are tiny and one is a complete motherboard. The choice is yours but to help you choose the one for you, read below about more detailed specifications.

    Single Relay Module:

    This board is small and can fit inside a light/plug socket to be well hidden. There is no DC-AC isolation. This board is very cheap to produce due to its small square inch form factor. There is no shift register so you will need to make your own breakout board.

    8 Way Relay Board:

    This board is medium sized and has 8 relays on it. There is a shift register and you can make more boards and bridge them to get more outputs off the same 3 pins. There is no DC-AC isolation.

    Opto-Isolated 8 Way Relay Board:

    This board is slightly larger than the 8 Way Relay Board and has 8 relays on it. There is a shift register and you can make more boards and bridge them to get more outputs off the same 3 pins. There is DC-AC isolation. This board costs around $20 per board to make from OSH Park. This price only includes the board and no components.

    Jarvis Motherboard:

    This board is huge with 8 opto isolated relays and support for expansion. We have all the components and connections on this single board. This includes temp, humidity, current, voltage sensors and a whole bunch more. This is basically the complete package, less wires and its a nice single board. Coming Soon!

  • 3

    Once you have the board you like, send it off to OSH Park or your favourite PCB manufacturer. 

    While you wait, get the parts ready. You can find a parts list for every board inside an Excel file as well as a text file and that file only corresponds to that specific board. 

    The Excel document is well layed out but if you don't have Microsoft Office then just use the text file.

Discussions

VPugliese323 wrote 12 minutes ago null point

While I did not go through your entire project page, I was not able to find any documentation on the theory behind the individual sub-sections of your project. If it does not exist, I suggest adding it. If it does exist, then I suggest you make it more prominent. Perhaps its just the computer scientist in me, as the first thing I look for in a project is project objectives followed by project theory in an abstract form. You have excellent descriptions of what the different modules do, I just don't see any of the theory behind them clearly laid out.

On a different note, I could not find any means of diagnosing faults as a part of this project. I suggest you add a diagnostics engine (of some sort) to the project. Having any kind of diagnostics engine (even a rudimentary one) will aid you significantly in error handling. Something is bound to break. If you do not want to code one up from scratch yourself, I believe there is one that you can modify from the robotic operating system (ROS) found here: http://www.ros.org/

On a final note, as I scan through your project logs, I see a lot of good progress. This looks like a nifty project. I look forward to seeing the end result.

Are you sure? [yes] / [no]

Big Country wrote 3 days ago 3 points

Are you ever going to release your code? It looks like you are trying to enter a closed source project into an open source competition.

The competition is supposed to spread ideas and spark an open forum to discuss and open up tools that people may not have been inclined to share before. Thus, flooding the hacker community with helpful information on tools that people have been developing behind the scenes. So far, the things you have shared can be readily found on HAD prior to your posts.

Your initiative part of your project is without a doubt the code that makes Jarvis tick, if your claims are true, it rivals many other commercial products created by large companies. However, nobody can substantiate your claims because nobody has seen your code or even ran your program. Your website still looks like you are trying to sell this program as a commercial product, which contradicts your replies below that you will release the code "soon" over the past 3 months. I don't think the readers will be distracted by your reiterations of other projects to hide the fact that you are hiding your code. If you don't want to release your code, that's OK, but please don't market it as open source or string people along with false promises.

Please prove me wrong, I sincerely hope that I have the wrong impression of this project.

Are you sure? [yes] / [no]

IamTeknik wrote 3 days ago -2 points

Ok to address the smaller things first. Yes this will be a commercial product eventually but what is wrong with that? Arduino is a product but still open source, it is exactly the same thing.

Secondly, a lot of my builds are relatively new. Yes the basic automation is pretty standard but i have a lot of other things in the works. The door lock, fingerprint scanner, wall mounted tablet etc. thats just what ive done. I have a bunch more stuff which have never been done before. All of which will be posted once my designs are finalized and working well.

My project is marked as an incomplete project which is very evident. Im one person working on this which is by far the biggest project compared to anything else in the semifinalist list and I'm still a university student so i apologize if it takes longer than you would hope to have a fully functional bugless A.I. Its a lot of work for one person in the time span I have and unfortunately I do have other priorities which I cannot neglect.

The code is not yet released because it is simply not at the level i want it to be however i will be releasing some code next week which will not be the A.I but rather a substitute that people can use in the mean time. I will not release bugless, broken code for a community to use. There are companies with billions of dollars, 1000 man teams and quantum computers trying to write a great A.I so 3 months to write a decent A.I is a really short amount of time. It may not be the overnight solution you want but thats how things work, it takes time to develop something new.

I think you are out of place to say its a "fact" I'm hiding code just because you haven't seen anything in 3 months. I don't build reiterations of anything to hide anything. I build because I want to build and i will continue to do so.

Are you sure? [yes] / [no]

zakqwy wrote 3 days ago 2 points

I have to concur with Big Country's point. Please don't take it personally, but we need to see your code. No one will fault you for showing off a program that isn't polished; just include a few good caveats in the comments (many open source licenses include an 'As-Is clause either way). I think the point being made here is that while your electrical parts are useful, they aren't revolutionary; Arduino-controlled relay modules, fingerprint interfaces, tablet wall-mounts, and various rapid prototyped enclosures are great, but they aren't that different than existing hardware.

The real magic of Jarvis was shown at the beginning of your Hackaday Project Phase 1 video--your AI clearly interpreted a statement based on an understanding of your intention, not just a translation of your vocabulary. Even in its state when you produced that video, the code that produces that functionality really could be revolutionary. That is what we are all dying to see. Show us how Jarvis thinks.

If you're committed to making this project truly open source, I challenge you to properly license your code and release it in its current form, with any caveats you feel are necessary to communicate the fact that it is currently a work in progress. You should be able to do this in a few minutes--call out the specific license per its requirements in your comments and copy everything to a Github or Dropbox repo, then share the link on the project site.

Are you sure? [yes] / [no]

leocoins93 wrote 5 days ago null point

I need help on how to get started PLEASEEEEEEE HELP ME . I have a Mac is it compatible ? where is the software? Please help me.

My email is leocoins93@gmail.com I am very interested in knowing about this project.

Are you sure? [yes] / [no]

Bruce Cushman wrote 13 days ago null point

I love your concept and will be following your work closely. I am currently retrofitting my 1909 Craftsman home into a "Jetson, home of the future", and would love having a Jarvis system to control all of it's features. One question I have is, why didn't you just use Arduino relay boards that are available, very cheaply, on eBay. They typically cost about $1 per relay and come in 1, 2, 4, 8 & 16 relay boards with opto isolation? Also, an electric door lock ( 12v, made of metal) can be had for about $25 that installs into a standard door jamb.... although I do really like the look of your rack & pinion lock. I don't have access to a 3D printer at this time so I need to be able to buy "cheap" off the shelf parts for my Jarvis home.

Are you sure? [yes] / [no]

dklight wrote 20 days ago null point

Grate work! A while ago i tried to build some home automation system. A very interesting side is the feedback. Take a look on http://openenergymonitor.org/emon/emontx since it's an open source project, and everything is very well documented.

Are you sure? [yes] / [no]

zakqwy wrote a month ago null point

Can you put up a link to your code (or point me in the direction of the firmware if I missed it)? I'd love to get a better understanding of the software that backs up the functionality demonstrated in your 2-minute video. I don't know much about voice recognition but it's definitely cool!

Are you sure? [yes] / [no]

IamTeknik wrote a month ago 1 point

I am going to upload the code soon, im just working out a few bugs and adding more functionality so someone can get using it without too much problem

Are you sure? [yes] / [no]

zakqwy wrote 12 days ago null point

Any update on sharing the code demoed in the video?

Are you sure? [yes] / [no]

ZaidPirwani wrote 2 months ago null point

well great, but if I want to replicate it, what to do....??

Are you sure? [yes] / [no]

IamTeknik wrote 2 months ago 2 points

It's not a completed project just yet. I add more details and instructions as I finish up stuff on my end. The majority of it will be ready by the end of the month so you'll be able to start building by then

Are you sure? [yes] / [no]

jambel wrote 2 months ago null point

This is my approach and contribution to home automation -and not only- enthusiasts
jubito.org
jubitoblog.blogspot.com
I started a project called project jaNET back in 2010 to imitate a jarvis system, but then, it takes the jubito form that is more close to real life.

Are you sure? [yes] / [no]

Jibmo wrote 2 months ago null point

I'm an electrician for the past 10 years and have worked on a few different lutron and crestron smart home systems, which are usually only affordable by those which are building 10 million dollar homes. It's nice to see something so advanced come to open source in this field. Hats off to you!

Are you sure? [yes] / [no]

davedarko wrote 3 months ago null point

I really like the door lock, since i've seen that many lights switched on and off over the internet..

Are you sure? [yes] / [no]

Ron wrote 3 months ago null point

Very nice project,I to want a alarm system what I wireless monitor my garage and shop.

Are you sure? [yes] / [no]

TheNorminator wrote 3 months ago null point

I love this project, I have been wanting to make something just like this for myself when I finally have my own house

Are you sure? [yes] / [no]

samsalt824 wrote 3 months ago null point

This.. I want this..

Are you sure? [yes] / [no]

Adam Fabio wrote 3 months ago null point

Thanks for entering Project Jarvis in The Hackaday Prize! Thanks for opening up the source to the Arduino side of the project. Do you have the android side open as well? The more open, the better the chance of winning a trip to space!

Are you sure? [yes] / [no]

IamTeknik wrote 3 months ago null point

Hi Adam.
Yes I do but im currently doing a few updates before I post the source code here. I will be posting every bit of source including the Arduino, Android and computer programs. I'm just trying to make it easy to use for those who don't have much programming knowledge.

Are you sure? [yes] / [no]

Lightning Phil wrote 4 months ago null point

Cool! Just named a robot at work Jarvis. Perhaps they could join forces and make a flying suit!

Are you sure? [yes] / [no]

IamTeknik wrote 4 months ago 1 point

Haha definitely. I would love to see your bot so if you have any logs on it please share them :)

Are you sure? [yes] / [no]

hchatura wrote 4 months ago null point

wow cool

Are you sure? [yes] / [no]

OfficialMMSJ wrote 4 months ago null point

I Like Your Work Bro (y) When Will You Release Jarvis, i Look Forward For it...

Are you sure? [yes] / [no]