Close

Does this project spark your interest?

Become a member to follow this project and don't miss any updates

Project Jarvis - A.I Home Automation & Assistant

Intelligent home automation hardware and software on a budget which utilizes a full home personal digital assistant and electricity savings

This project was created on 05/22/2014 and last updated 2 months ago.

Description
We have smart cars, smart phones and even smart T.V's. It's time to bring smart homes to the future.

Project Jarvis is designed with Artificial Intelligence (A.I) in both software and hardware which allows the computer system to make smart decisions based on environmental factors. This means the system can help save energy in your home, reducing your monthly bills exponentially and saving the Earth! That's not all though, Jarvis is a personal assistant found throughout your home and Android device. He can make you coffee in the morning, wake you up with weather and you can even speak to him. You can even tell him to switch off all the lights in your room before you go to bed and it will be done instantly. Do you have a complex maths equation or assignment? Not to worry, Jarvis can answer all your questions and even complete full research reports for you.

It's all driven by sophisticated hardware and software to help make your life, and the life of others, much better.
Details

Key Features (At a Glance)

- A.I Home Automation

- Energy Savings Efficiency

- Voice Recognition and Speech Synthesis

- Enhanced Security and Safety

- Entire House Wide Virtual Assistant

- Sleep Pattern Tracking

- World Wide Web Enabled Home Automation

- Custom Android Application and Computer Software

- Low Cost (Under $200)

- Research Report Compilation, Question Answering (Including mathematical equations)

- Any hacked appliance or device can work with this system


Jarvis In-Depth


Intelligent Automation

Jarvis is the name of Iron Man's computer system which manages his home, hence the name of this project. The main aspect of Project Jarvis is to help save electricity in your home which then helps save the Earth and of course, helps save a bit more money each month. The electricity usage is logged per room into an SD card on an open source micro controller such as an Arduino or Raspberry Pi, I chose Arduino. The code on the MCU then interacts with a larger more complex network known as a neural network which has been programmed in a separate application. This software then makes intelligent decisions using the environment and its sensors to help beat the current months data which is still on the SD card. Jarvis will attempt to save more energy than the previous month without getting in the way of your usual living style.

Who is Jarvis?

Jarvis is a virtual assistant, similar to Siri but with a lot more power. Jarvis is the brains behind all operations, he makes the choices and decisions for home automation and much more. Jarvis is based off Artificial Intelligence and is capable of answering complex questions, maths equations, reading social network messages, conversing, being a top class assistant and much more. Jarvis speaks back through speakers located in the rooms and you can speak to him! That's right, if you have a question, simply ask it wherever you are in your home. You don't need to pull out your phone and ask Jarvis to do something, he is always there. Jarvis is wherever you are, in the home, office and in your pocket if you use our Android mobile app.

Energy Efficiency

Every home has lights, appliances and other electronic or electrical gadgets. These all consume energy even if you aren't present in the room. Jarvis is smart enough to switch off lights and unused appliances when you walk out the room. If you turn on a light in your room, Jarvis will compare that specific lights consumption in real time and compare it to data from other lights. If it detects that the light you have on is less efficient, Jarvis will automatically switch that light off and turn on a more efficient light instead. How about automatically switching off cell phone chargers when your phone is disconnected? All these small things in human error or laziness add up in energy consumption and on your monthly bill. Jarvis is here to help make energy savings available to everyone without the owners even noticing. He logs data periodically and that data can be used to help reduce more electricity where possible each month. This way Jarvis will always strive to exponentially increase energy savings and decrease your bill.

Ease of Living

With Project Jarvis is your home, you no longer need to remember if your T.V or stove was left on. Simply login to the web app and switch them off manually or let Jarvis do it automatically. You can always check in on your home and turn appliances and lights on or off from anywhere in the world off any internet connected device. If you have kids, you can always check up on them. Are they doing their homework? No? Well simply turn off the T.V or their gaming console from your fingertips. Whether its by voice, gesture recognition, web app, computer app or mobile app, Jarvis has you covered.

Notifications

Jarvis is capable of reading notifications, cellular messages, social network news feeds and so much more. He can even reply to those messages for you if you tell him what to say. Jarvis converts all...

Read more »

Components
  • 8 × 5 Volt 10 Amp Relays Look for G5L Relays in EagleCad for pin layout
  • 1 × 74HC595 SMD Latch enabled shift register
  • 8 × EL357N-C Opto-Isolators. Any 4 pin, transistor output isolator will work
  • 8 × 2N2222 Transistors Discrete Semiconductors / Transistors, MOSFETs, FETs, IGBTs
  • 8 × 1N4007 Rectifier Diodes Rectifier Diodes
  • 20 × 560 Ohm Resistors +-5% Resistors
  • 20 × 220 Ohm Resistors +-5% Resistors
  • 20 × 660 Ohm Resistors +-5% Resistors
  • 8 × Blue LED's 5mm Blue LED's. Any will work but adjust your resistor value
  • 10 × Pin Headers 3mm Spaced Headers. Same as Arduino. Use what suits you

See all components

Project logs
  • Rough Artist Renders

    2 months ago • 1 comment

    Check out our rough artist renders for our new Project Jarvis "Black Box". This box will have all the wireless transceivers used for the main home automation control and also have a lot more hardware and software for everyday lifestyle. We are incorporating sensors to track sleep patterns and monitor temperature, humidity, light etc in order to give you the best possible sleep every night. That along with a few more features will be added. 

    In the above image, the logo is a button. Obviously wont look like that but itl be tinted perspex with a soft glow through it. Thats the main power button when the device is off and serve other purposes when its on. The thing above that is a continuous rotatory switch so you can scroll through stuff on screen, adjust volume etc and if you click it in, it acts as the "confirm" button. Lastly there are a few buttons on top for any extra features we may add. Our designer's software got corrupt and wasn't able to finish it. A few changes to be noted is the lighting will be a lot softer and the red will be a soft white glow instead. The box also wont be so outstanding, our designer exaggerated the design a bit so the geometry wont protrude as much as in the design. You can check out the rest of the designs here

  • Build Details for Motorized Door Lock

    2 months ago • 0 comments

    I've finalized my door lock and it's ready for the community to build. You will need a 3D printer unfortunately, however if you would like one, I can sell it to you for the price it took to make, a few dollars. 

    Anyway head on over to thingiverse and download the model. All instructions are posted there to help build the gadget. The model works very well and its very strong once you've locked your door with it. 

    This door lock was also featured on the official Makerbot website! You can read the short story here.

  • Wall Mounted Tablet Update

    2 months ago • 1 comment

    Here's an update on our Jarvis wall panel tablet. I have mounted it on one of my bedroom walls and wired it for power however I still have an Ethernet cable to route for internet access on the tablet. I have a few more things left like building a power button and maybe putting some LED's. You can see how the tablet looks in the two images below. I have also made an application specifically for use with this tablet which can also be seen below.

    Here is the software I have built for it. I am going to incorporate Amazon shopping along with the grocery service they offer. Of course music for those early morning wake up tracks :D, but it will be a fully featured media centre that can stream from other devices. I'm going to do that later down the time line. I also have a space left for weather. From there you can see very detailed stats, a bit more information than what your iPhone provides and this will be able to display the info on screen, push to your phone(Maybe) and obviously tell you the info when you wake up via voice. The "Home Layout" tab will be replaced with "Home Essentials" and that's where weather and all the extra stuff can be found. I might also replace "Notes" with something more essential once I can find something I need. If I do, notes will be moved over to "Home Essentials". Notes basically stores all your notes, ideas, calendar events, etc. So far the home automation works, Music and Notes. Weather does also work however I didn't build a GUI for it yet. Next week I expect this software to be completely done and you'll be able to download the source. Our artist is also working on the home screen graphics which is why some are missing.

    NOTE: The app is built to run on the Beaglebone's LCD 7" Cape. The resolution is 800*480 and this app is designed to run in full screen. 

View all 28 project logs

Build instructions
  • 1

    The most important instruction, be very cautious! We are working with AC and you can easily shock yourself. Here are some steps to take when altering or modifying AC light / plug connections:

    1) Wear rubber soled, fully closed work or electricians boots.

    2) Switch off power to the room you are working in via the main distribution board.

    3) Use at least 1000v rated electrician screwdrivers. Do NOT use motor driven or other types of screwdrivers.

    4) Test the voltage in the socket using a well rated multimeter. Only proceed if you see 0v. If not, switch off the power from your D.B.

    5) If you remove wires, make sure you cover the uninsulated ends with electrical tape just to be extra safe.

    6) Once you have finished your modifications, make sure everything is well secured. You do not want wires popping out the next time you open the socket. Double check all your connections and then close up the socket.

    7) Switch the mains on and you can now test out your circuit.

    (Pictures coming soon)

  • 2

    The first thing to build is our relay board controller. These are simple to build because I've already created (Not yet tested) all CAD files which includes complete schematics and boards. You can find all downloads which are open source under the featured images of this project, look for the link to my Dropbox folder where everything can be downloaded and imported into EagleCAD.

    Pick your favourite relay controller! We have 4, some are cheap, some are safe, some are huge, some are tiny and one is a complete motherboard. The choice is yours but to help you choose the one for you, read below about more detailed specifications.

    Single Relay Module:

    This board is small and can fit inside a light/plug socket to be well hidden. There is no DC-AC isolation. This board is very cheap to produce due to its small square inch form factor. There is no shift register so you will need to make your own breakout board.

    8 Way Relay Board:

    This board is medium sized and has 8 relays on it. There is a shift register and you can make more boards and bridge them to get more outputs off the same 3 pins. There is no DC-AC isolation.

    Opto-Isolated 8 Way Relay Board:

    This board is slightly larger than the 8 Way Relay Board and has 8 relays on it. There is a shift register and you can make more boards and bridge them to get more outputs off the same 3 pins. There is DC-AC isolation. This board costs around $20 per board to make from OSH Park. This price only includes the board and no components.

    Jarvis Motherboard:

    This board is huge with 8 opto isolated relays and support for expansion. We have all the components and connections on this single board. This includes temp, humidity, current, voltage sensors and a whole bunch more. This is basically the complete package, less wires and its a nice single board. Coming Soon!

  • 3

    Once you have the board you like, send it off to OSH Park or your favourite PCB manufacturer. 

    While you wait, get the parts ready. You can find a parts list for every board inside an Excel file as well as a text file and that file only corresponds to that specific board. 

    The Excel document is well layed out but if you don't have Microsoft Office then just use the text file.

See all instructions

Discussions

shan@tek wrote 2 months ago null point

Hey it very nice project but when u r going to upload whole project with codes??? I m from india I want to do same in my home

Are you sure? [yes] / [no]

seesemichaelj wrote 2 months ago null point

I'm confused why you're building all the devices for the automation? This has nothing to do with the actual home automation. There are several door lockers, tablets, tablet interfaces, etc. The only hardware you should be building should be for speech recognition, energy saving, and AI home automation features specifically. Frankly, I think the only thing you should be developing is any hardware that is not available COTS (Commercial Off The Shelf) and the AI component of the software. Home automation has been done and done again. There are several open source projects too (i.e. OpenHAB/SmartHome) that you could incorporate with the world. As a hacker, I think you're wasting a lot of your time on things that should not be high priority. This project is supposed to be open, so why haven't we seen proof of concept design on how the AI is going to work (the only original component in this project). As a business-man, your time-to-market is very slow. You should be making partnerships with other manufactures and software companies to integrate with their "smart home" systems. Instead, you're going to make an entire home automation system that has it's own configuration, devices, features, and bugs. I'm sorry to be critical, but I really see no progress as intelligent system (your videos demonstrate no AI); I only see progress towards a home automation solution.

Are you sure? [yes] / [no]

seesemichaelj wrote 2 months ago null point

I guess there's no edit feature. I meant to say "This has nothing to do with the actual project you set out to do, which was to incorporate AI into home automation." If your original goal was just home automation, then you should not have submitted to THP.

Are you sure? [yes] / [no]

VPugliese323 wrote 2 months ago null point

While I did not go through your entire project page, I was not able to find any documentation on the theory behind the individual sub-sections of your project. If it does not exist, I suggest adding it. If it does exist, then I suggest you make it more prominent. Perhaps its just the computer scientist in me, as the first thing I look for in a project is project objectives followed by project theory in an abstract form. You have excellent descriptions of what the different modules do, I just don't see any of the theory behind them clearly laid out.

On a different note, I could not find any means of diagnosing faults as a part of this project. I suggest you add a diagnostics engine (of some sort) to the project. Having any kind of diagnostics engine (even a rudimentary one) will aid you significantly in error handling. Something is bound to break. If you do not want to code one up from scratch yourself, I believe there is one that you can modify from the robotic operating system (ROS) found here: http://www.ros.org/

On a final note, as I scan through your project logs, I see a lot of good progress. This looks like a nifty project. I look forward to seeing the end result.

Are you sure? [yes] / [no]

Big Country wrote 2 months ago null point

Are you ever going to release your code? It looks like you are trying to enter a closed source project into an open source competition.

The competition is supposed to spread ideas and spark an open forum to discuss and open up tools that people may not have been inclined to share before. Thus, flooding the hacker community with helpful information on tools that people have been developing behind the scenes. So far, the things you have shared can be readily found on HAD prior to your posts.

Your initiative part of your project is without a doubt the code that makes Jarvis tick, if your claims are true, it rivals many other commercial products created by large companies. However, nobody can substantiate your claims because nobody has seen your code or even ran your program. Your website still looks like you are trying to sell this program as a commercial product, which contradicts your replies below that you will release the code "soon" over the past 3 months. I don't think the readers will be distracted by your reiterations of other projects to hide the fact that you are hiding your code. If you don't want to release your code, that's OK, but please don't market it as open source or string people along with false promises.

Please prove me wrong, I sincerely hope that I have the wrong impression of this project.

Are you sure? [yes] / [no]

IamTeknik wrote 2 months ago null point

Ok to address the smaller things first. Yes this will be a commercial product eventually but what is wrong with that? Arduino is a product but still open source, it is exactly the same thing.

Secondly, a lot of my builds are relatively new. Yes the basic automation is pretty standard but i have a lot of other things in the works. The door lock, fingerprint scanner, wall mounted tablet etc. thats just what ive done. I have a bunch more stuff which have never been done before. All of which will be posted once my designs are finalized and working well.

My project is marked as an incomplete project which is very evident. Im one person working on this which is by far the biggest project compared to anything else in the semifinalist list and I'm still a university student so i apologize if it takes longer than you would hope to have a fully functional bugless A.I. Its a lot of work for one person in the time span I have and unfortunately I do have other priorities which I cannot neglect.

The code is not yet released because it is simply not at the level i want it to be however i will be releasing some code next week which will not be the A.I but rather a substitute that people can use in the mean time. I will not release bugless, broken code for a community to use. There are companies with billions of dollars, 1000 man teams and quantum computers trying to write a great A.I so 3 months to write a decent A.I is a really short amount of time. It may not be the overnight solution you want but thats how things work, it takes time to develop something new.

I think you are out of place to say its a "fact" I'm hiding code just because you haven't seen anything in 3 months. I don't build reiterations of anything to hide anything. I build because I want to build and i will continue to do so.

Are you sure? [yes] / [no]

zakqwy wrote 2 months ago null point

I have to concur with Big Country's point. Please don't take it personally, but we need to see your code. No one will fault you for showing off a program that isn't polished; just include a few good caveats in the comments (many open source licenses include an 'As-Is clause either way). I think the point being made here is that while your electrical parts are useful, they aren't revolutionary; Arduino-controlled relay modules, fingerprint interfaces, tablet wall-mounts, and various rapid prototyped enclosures are great, but they aren't that different than existing hardware.

The real magic of Jarvis was shown at the beginning of your Hackaday Project Phase 1 video--your AI clearly interpreted a statement based on an understanding of your intention, not just a translation of your vocabulary. Even in its state when you produced that video, the code that produces that functionality really could be revolutionary. That is what we are all dying to see. Show us how Jarvis thinks.

If you're committed to making this project truly open source, I challenge you to properly license your code and release it in its current form, with any caveats you feel are necessary to communicate the fact that it is currently a work in progress. You should be able to do this in a few minutes--call out the specific license per its requirements in your comments and copy everything to a Github or Dropbox repo, then share the link on the project site.

Are you sure? [yes] / [no]

leocoins93 wrote 3 months ago null point

I need help on how to get started PLEASEEEEEEE HELP ME . I have a Mac is it compatible ? where is the software? Please help me.

My email is leocoins93@gmail.com I am very interested in knowing about this project.

Are you sure? [yes] / [no]

Bruce Cushman wrote 3 months ago null point

I love your concept and will be following your work closely. I am currently retrofitting my 1909 Craftsman home into a "Jetson, home of the future", and would love having a Jarvis system to control all of it's features. One question I have is, why didn't you just use Arduino relay boards that are available, very cheaply, on eBay. They typically cost about $1 per relay and come in 1, 2, 4, 8 & 16 relay boards with opto isolation? Also, an electric door lock ( 12v, made of metal) can be had for about $25 that installs into a standard door jamb.... although I do really like the look of your rack & pinion lock. I don't have access to a 3D printer at this time so I need to be able to buy "cheap" off the shelf parts for my Jarvis home.

Are you sure? [yes] / [no]

dklight wrote 3 months ago null point

Grate work! A while ago i tried to build some home automation system. A very interesting side is the feedback. Take a look on http://openenergymonitor.org/emon/emontx since it's an open source project, and everything is very well documented.

Are you sure? [yes] / [no]

zakqwy wrote 3 months ago null point

Can you put up a link to your code (or point me in the direction of the firmware if I missed it)? I'd love to get a better understanding of the software that backs up the functionality demonstrated in your 2-minute video. I don't know much about voice recognition but it's definitely cool!

Are you sure? [yes] / [no]

IamTeknik wrote 3 months ago null point

I am going to upload the code soon, im just working out a few bugs and adding more functionality so someone can get using it without too much problem

Are you sure? [yes] / [no]

zakqwy wrote 3 months ago null point

Any update on sharing the code demoed in the video?

Are you sure? [yes] / [no]

ZaidPirwani wrote 5 months ago null point

well great, but if I want to replicate it, what to do....??

Are you sure? [yes] / [no]

IamTeknik wrote 5 months ago null point

It's not a completed project just yet. I add more details and instructions as I finish up stuff on my end. The majority of it will be ready by the end of the month so you'll be able to start building by then

Are you sure? [yes] / [no]

jambel wrote 5 months ago null point

This is my approach and contribution to home automation -and not only- enthusiasts
jubito.org
jubitoblog.blogspot.com
I started a project called project jaNET back in 2010 to imitate a jarvis system, but then, it takes the jubito form that is more close to real life.

Are you sure? [yes] / [no]

Jibmo wrote 5 months ago null point

I'm an electrician for the past 10 years and have worked on a few different lutron and crestron smart home systems, which are usually only affordable by those which are building 10 million dollar homes. It's nice to see something so advanced come to open source in this field. Hats off to you!

Are you sure? [yes] / [no]

davedarko wrote 5 months ago null point

I really like the door lock, since i've seen that many lights switched on and off over the internet..

Are you sure? [yes] / [no]

Ron wrote 5 months ago null point

Very nice project,I to want a alarm system what I wireless monitor my garage and shop.

Are you sure? [yes] / [no]

TheNorminator wrote 6 months ago null point

I love this project, I have been wanting to make something just like this for myself when I finally have my own house

Are you sure? [yes] / [no]

samsalt824 wrote 6 months ago null point

This.. I want this..

Are you sure? [yes] / [no]

Adam Fabio wrote 6 months ago null point

Thanks for entering Project Jarvis in The Hackaday Prize! Thanks for opening up the source to the Arduino side of the project. Do you have the android side open as well? The more open, the better the chance of winning a trip to space!

Are you sure? [yes] / [no]

IamTeknik wrote 5 months ago null point

Hi Adam.
Yes I do but im currently doing a few updates before I post the source code here. I will be posting every bit of source including the Arduino, Android and computer programs. I'm just trying to make it easy to use for those who don't have much programming knowledge.

Are you sure? [yes] / [no]

Lightning Phil wrote 6 months ago null point

Cool! Just named a robot at work Jarvis. Perhaps they could join forces and make a flying suit!

Are you sure? [yes] / [no]

IamTeknik wrote 6 months ago null point

Haha definitely. I would love to see your bot so if you have any logs on it please share them :)

Are you sure? [yes] / [no]

hchatura wrote 6 months ago null point

wow cool

Are you sure? [yes] / [no]

OfficialMMSJ wrote 6 months ago null point

I Like Your Work Bro (y) When Will You Release Jarvis, i Look Forward For it...

Are you sure? [yes] / [no]

Similar projects