Practical Home Automation

We've connected our entire apartment, DIY style.

Similar projects worth following
Inspired by Jarvis - the robot butler from Iron Man - we're developing a way for our apartment room to anticipate the needs of its residents and act on those needs. Examples include:

- Turning on the lights when you're stumbling through the living room at night
- Switching the audio system, lowering the projector screen, and turning on the projector when you want to watch a movie
- Controlling room temperature to conserve energy by augmenting an existing "dumb" AC unit

We're accomplishing this with a custom language processor developed on top of the CMU Sphinx speech recognition toolkit ( along with a number of arduino-based sensors (light, temperature, motion), RF controllers, and actuators in the form of relays/FETs to control power to appliances and lighting.

Our end goal is a single-computer system that wirelessly controls a great number of small embedded systems that perform useful functions for the resident.

  • Language Lessons Learned

    Fabricate.IO08/19/2014 at 00:09 0 comments

    For a little background: we're using an active listening model to listen for voice commands. As soon as Jarvis hears a command word such as "lights" within a few words of his name, he acts on it. 

    Lately we've been combating false positives - during a talkative party, our system picks up a lot of things that sound like "Jarvis, lights" for instance. We're working on a number of possible fixes, including measuring the general room activity (judged by number of words transcribed in the last minute) to determine if a more complex command should be needed to command Jarvis (for instance requiring the user to say "please"). 

View project log

Enjoy this project?



Craig Hissett wrote 03/04/2017 at 13:47 point

This is awesome!

Where can I get that Arduino/ESP board from?

It is perfect for my #Aquariumatic project, in which I need it to control some relays and read some sensors.


  Are you sure? yes | no

Vijayenthiran Subramaniam wrote 06/19/2016 at 12:25 point

Any additional detail on the sphinx part?

  Are you sure? yes | no

littlemillerman1122 wrote 05/16/2015 at 00:38 point

Was hoping for a more elaborate description than what was shown.  Are you guys going to do a instructable for this later?  Just curious

  Are you sure? yes | no

Michael Haas wrote 10/23/2014 at 14:10 point
Hey, this is cool stuff. Are you running Sphinx on a micro controller or on a computer?

  Are you sure? yes | no

Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates