Close

Does this project spark your interest?

Become a member to follow this project and don't miss any updates

Raspberry Eye

Head-mounted computer with see-through display made from cheap or printed components

29 227 145
Enjoy this project?
Share on twitter   Share on Facebook

This project was created on 04/19/2014 and last updated 3 months ago.

Description
I wanted to do something interesting with my RPi and a 2.4" TFT LCD. Google Glass was hot in the news, so I've decided to hack something similar. The semi-transparent mirror was extracted from Eye of Horus Beamsplitter, and the projection lens is cut from a plastic 3x Fresnel magnifying lens. The box and mounting parts are 3D-printed from ABS. Head strap is for GoPro. One RPi USB port is used for WiFi, and second for 2.4Ghz small wireless keyboard/mouse combo. All together cost around 100$. I haven't figured out a good option for the power supply yet, and don't know if this thing can have a practical application. The display driver is fbtft framebuffer, so both text and (non-accelerated) graphical modes are possible, but with 320x240 resolution using X is not too exciting. Display brightness is sufficient if ambient light is not too bright.

Here is a demo video: https://www.youtube.com/watch?v=lCYnIHqwIJU
Details

A drawing of the mounting assembly: https://dl.dropboxusercontent.com/u/105504669/rpi_eye.pdf

My copy of notro/fbtft driver with modifications to product the mirror image: https://github.com/genericsoma/fbtft/tree/mirror (there only fb_s6d1121.c is modified, but it should be easy to duplicate for other controllers).

I've bought the beamsplitter here: http://amzn.com/B000NSMODK

The screen is ITDB02-2.4E from ITead Studio

The framebuffer driver for Raspbian is here: https://github.com/notro/fbtft (my version is slightly modified to produce a mirror image)

For the lens look for a "credit card size 3x fresnel magnifying glass"

Components
  • 1 × Raspberry Pi board Mine is 1st Gen B board
  • 1 × 2.4" LCD display I've bought mine from ITead Studio, other sellers have them too
  • 1 × Semi-transparent mirror Not easy to find, the one from Eye of Horus beamsplitter is unfortunately low-quality plastic
  • 1 × Fresnel lens At least 3x
  • 1 × GoPro head strap
  • 1 × IPazzport Mini Wireless keyboard Or similar (check for compatibility with the RPi)
  • 1 × Box, mirror mount 3D printed
  • 1 × Raspberry Pi camera board Connectors and Accessories / Power Entry Modules, Plugs and Sockets

Project logs
  • Raspberry Eye grows an eye

    3 months ago • 0 comments

    Played with RPi Camera Board recently to see if it can be used for simple image-recognition.

    Here is the result:

    This is produced by this python script using picamera module to capture the image, ZBar bar code reader to find qr-codes and pygame was used to draw stuff. Latency is around 1 sec using 1024x768 image size.

    I've realized there exists a problem with using see-through augmented-reality displays: if you need to draw something over a real object, you need to account for the camera offset from the display, which is important for close distances. I don't know how to calculate the correction dynamically without some kind of distance-detection hardware (the best would be to use a depth-sense camera... maybe they need to make one which is RPi-compatible).

    I'll try to make a small demo video soon.

  • Added "mirror" branch on github

    4 months ago • 0 comments

    I've added the code to produce the mirror image to "mirror" branch: https://github.com/genericsoma/fbtft/tree/mirror

    It applies only to S6D1121 controler (fb_s6d1121.c). If should be easy to use the same trick with similar controllers such as ILI9325. Basically the starting address is calculated differently and the so-called GRAM direction is set to the opposite.

  • Uploaded demo video

    5 months ago • 0 comments

    https://www.youtube.com/watch?v=lCYnIHqwIJU

View all 4 project logs

Discussions

Mis012 wrote a month ago null point

what about using two cameras above each eye? It will be like 3d camera, or not? Or maybe something to get position of your finger, so you can manipulate with virtual objects?
I'm intrested in this, I'll make my own soon.

Are you sure? [yes] / [no]

flaco wrote 3 months ago null point

Hello, awesome project here !
Have you thought about replacing the screen, miror + lens(?) by an OLED screen? :)

Are you sure? [yes] / [no]

surperdearm wrote 3 months ago null point

Do you want to sale one to me?

Are you sure? [yes] / [no]

flaco wrote 3 months ago null point

You can make one by yourself as well; that's the point of this community, I think.

Are you sure? [yes] / [no]

KBart1960 wrote 4 months ago null point

Cool and interesting project.
The link is unfortunately down!

Are you sure? [yes] / [no]

genericsoma wrote 4 months ago null point

the drawing link is fixed now

Are you sure? [yes] / [no]

snapgamesza wrote 4 months ago null point

Really exciting project! Congratulations. Is the fbtft code on your github the version that produces a mirrored image?

Are you sure? [yes] / [no]

genericsoma wrote 4 months ago null point

Not yet, I will put it shortly, but it works only with this specific display, because I've used the scan direction parameter.

Are you sure? [yes] / [no]

genericsoma wrote 4 months ago null point

I've added the code to produce the mirror image to "mirror" branch (see the link in the project details).

Are you sure? [yes] / [no]

botmayank wrote 5 months ago null point

Really great stuff!! Now how about some cool DBZ Scouter graphics :D

Are you sure? [yes] / [no]

mik3britt wrote 5 months ago null point

So cool man! Great work!

Are you sure? [yes] / [no]

fsf wrote 5 months ago -1 point

Hi,

I am brand new to your system and it keeps kicking me out or giving me errors....BUT it could very well be me as well. I have an age old challenge for you science buffs as you are obviously smarter than this 66 year old guy, as you have done it with plastic. We have found the way to remove the black sand but Is there any new and innovative way to seperate just plain old sand from gold dust other than plain old panning.

Thanks
God Bless
Freddy ...I would love to hear..!!

Are you sure? [yes] / [no]

james.dellow wrote 5 months ago 2 points

@genericsoma- would love to use this with the young people I work with. Could we chat about best ways to approach this project- my email is james.dellow@thesquad.org.uk

Are you sure? [yes] / [no]

prostheticknowledge wrote 5 months ago 2 points

@genericsoma - Is there a video demonstration of this?

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

I'm in the process of making one. Will be ready soon.

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

Here it is: https://www.youtube.com/watch?v=lCYnIHqwIJU

Are you sure? [yes] / [no]

woundedkarma wrote 5 months ago null point

Very cool :) I play with the idea in my head a lot.. I wasn't sure how to do the display. Granted I tend to avoid "spoilers" or I might have seen this somewhere else. I will have to keep an eye out for that board game :> Maybe it will show up in a thrift shop.

Isn't there any way to get the raspberry pi off of your head and into a pocket or carrying case?

For a battery pack, I'm going to try this: http://amzn.com/B009V5X1CE with my first project.

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

This pack seems pretty good deal :) The beamsplitter is actually an optional item: http://amzn.com/B000NSMODK

Are you sure? [yes] / [no]

danielmcgraw wrote 3 months ago null point

Hi woundedkarma,
Myself and Mike have been working on a project to do this.
Please see here: http://hackaday.io/project/1368-Raspberry-Pi-Smart-Glass
Dan

Are you sure? [yes] / [no]

Lutan wrote 5 months ago null point

This project looks awesome, I love it. Too bad I will use my Raspberry Pi for a custom PirateBox, I also already killed my tech budget for the next months. Is the whole thing easy and comfortable to wear?

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

It's not too bad, but I didn't try to wear it for hours.

Are you sure? [yes] / [no]

davedarko wrote 5 months ago null point

Any chance you can share some sketches or files for for this?

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

Is SolidWorks format OK?

Are you sure? [yes] / [no]

davedarko wrote 5 months ago null point

A theoretical sketch, like a drawing of the insides would be fine, since I just need to get a clue about the basics. I'm only able to afford to work with free 3D suits, so handling solidworks format could be a problem? I think I have to buy some stuff and try around a bit ;)

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

I'll put some sketches and STL files soon.

Are you sure? [yes] / [no]

Tyler Anderson wrote 5 months ago null point

I've always wanted to put something like this in my car. What is the focal distance of the projected image? That is, how far in front of you does it appear to be.

Are you sure? [yes] / [no]

genericsoma wrote 5 months ago null point

About 30cm with the current setup. It's possible to have the image "at infinity" by increasing the distance from the screen to the lens a little (to about 7cm).

Are you sure? [yes] / [no]