FEED

Description

In a world increasingly saturated with video displays and camera feeds, what is it like to channel swap at the speed of thought? FEED is a quick attempt to explore the possibility of inhabiting two physical bodies mediated through view goggles and wireless cameras. One camera sits on top of the HMD providing the user with their own POV, and another camera is attached to an autonomous Blubberbot roaming around the room. The HMD tracks motion and switches to the camera on the HMD when the user is moving. When staying still, the camera feed is switched to the blimp perspective. The result is a method for changing channels that relies on the users body language and motion. To our surprise, it only took a couple minutes to acclimate to this "interface," and the sense that we were neither the Blubberbot nor ourselves eventually took hold. This can only be described as a strange feeling that you are not a physical being, but the video feed itself.

Details

Things we are using here:

-FX Micro VTX Camera Combo x2 (one for headset, one for blimp)

-NexWave 5GZ video receiver for headset

-Eachine VR-007 headset

-Teensy Microcontroller

-AXL337 accelerometer breakout board from Sparkfun

Project Logs

Collapse

Augmented Reality
AndrewN • 07/21/2017 at 00:00 • 0 comments

Looking at the world through a video camera has one advantage: augmented reality. We attempted to mark and scan a blimp in order to turn it into an AR target. We had to route our video feed through a Unity application, and things worked reasonably well, but you have to be really close to the blimp in order for the target to function. This is still a work in progress, as we continue to think of how AR might benefit the experience. And yes, that is a giant Vuforia target marker on the ground. We had to print it in 40 tiles and stitch it together on the ground. Works quite well.

We also tried slapping some paper targets on to the blimp to improve accuracy. Unfortunately, the paper weighed too much and the blimp couldn't fly. Poor little guy...
Working Demo
AndrewN • 07/20/2017 at 23:27 • 0 comments

Jed demos the experience, shows what it's like to have another head

And this is what it looks like from inside the headset.
Headset rigged up
AndrewN • 07/20/2017 at 22:06 • 0 comments

Our latest headset rigged up and wearable.
Blubber Bots!
AndrewN • 07/20/2017 at 22:05 • 0 comments

If we attached the remote camera to a flying blimp, perhaps we could see a space from a different and unexpected perspective. We leveraged Jed's Blubber Bots to provide a nice, stable, platform.
Blubber Bots are floating DIY robotic species that navigate autonomously and intelligently. Blubber Bots float, dance, seek and sing. They are light-seeking hellium-filled balloons that graze the landscape in search of light and cellphone signals. Designed into the inflatable form is a set of light sensors enabling them to seek out the brightest light source.

They are also equipped with a phone flasher and can recognize cellphone activity. You can interact with a Blubber Bot by making a call and waving your phone near it. In response, it will go into a flocking dance or sing you a special tune.

Social and friendly in nature, Blubber Bots like to play. You can invite other Blubber Bots over for a party to watch a roomful flock and mingle. They propel themselves using helium buoyancy and two directional motors. They are a little clumsy though and bump into things. Fortunately, Blubber Bots are born with a feeler (bump switch) to help them out of tricky situations. At a flick of a “feeler”, they back up and head in a new direction.

Not only do they like to play, but they love to sing. Blubber Bots have a unique voice generated from a vibrating motor and a small piezo speaker attached to its mylar body. They bellow sounds similar to a whale’s song and serenade you with melodies. When not being played with, they rest while tooting periodic sounds in their sleep, dreaming until they once again are awakened.
What is a Blubber Bot?
Headset in use
AndrewN • 07/20/2017 at 22:01 • 0 comments

After writing a bit of firmware, we have the whole thing up and running. The motion sensing is tuned for wearing the headset, holding the unit like this causes extra motion, so there are a few false positives in there, but you get the idea...
Headset hacking
AndrewN • 07/20/2017 at 21:56 • 0 comments

Pulling apart a video headset and accessing the pins on the video receiver. The HMD is augmented with an micro controller and an accelerometer to sense head motion. We used the previous video receiver hack to connect a Teensy to the receiver. We had some issues with power connections because the screen needs a much higher voltage than the rest of the system, so we ended up using the headset power supply and voltage converting ICs.
Arduino controlled video receiver
AndrewN • 07/20/2017 at 21:52 • 0 comments

The first attempt to hack a video receiver with an Arduino. We removed the momentary switch on the receiver and routed the connection through a digital IO on the arduino. The sketch increments through the channels every couple seconds. The next goal would be to add the accelerometer and switch channels on motion or stillness, but for now, we know we can control channel selection through code.