Camera Automated by Natural Control of E-Reality

Using the interface of Virtual Reality to remotely operate a camera

Similar projects worth following
A 360 degree omni-directional camera that receives data input from a VR headset livestreaming the camera's feed.

 The teleoperation of robots has seen a massive increase in use in the last few years due to its wide scope of applications, from search and rescue to remote operations by doctors. However, as teleoperation is used for more complex jobs, the traditional control scheme of a joystick and a fixed screen display become clunkier and less intuitive. The aim of my project is to replace this traditional setup with an interface compatible with a head-mounted display, or HMD.

The implementation of HMDs in the teleoperation of robots is not a new concept. In fact, studies on the idea have been conducted since 2001, where army researchers wanted to explore the effect that introducing HMD control of a UAV had on the effectiveness of the subjects as compared to the traditional joystick and fixed screen. The results showed that subjects using HMDs were much slower at search and rescue, but this is because the technology was in its infancy, and the HMDs the subjects wore were cumbersome and harder to maneuver in. However, newer studies have showed promising results. In 2015, researches implemented HMDs to remotely control a robot. They evaluated in both 2D and 3D situations, where for 2D the subject had to read an eye chart to the lowest line they could, and for 3D the subject was tasked to find objects in a maze. The researchers found that while both control methods had relatively the same effectiveness in 2D situations, subjects using HMDs were significantly faster at identifying objects than those using the traditional method. The HMD technology has advanced to a point where it has an edge over a fixed screen display. Additionally, researchers have begun exploring the use of eye tracking to enhance the immersiveness of HMDs. In 2017, developers released a drone camera that could be controlled with a VR headset that shifted the sharpness of the image depending on where you were looking. However, the issue with this study is that the technology only works in well lit, wide open spaces. I want to take my project in the direction of developing a robot that can be maneuvered in enclosed areas that takes advantage of the HMD technology.


Isometric view sketch

JPEG Image - 705.13 kB - 11/08/2017 at 02:55



Front view sketch

JPEG Image - 707.54 kB - 11/08/2017 at 02:55


  • 2 × Continuous Servo Motors
  • 1 × Rotation Servo
  • 1 × Sheet of Acryllis for Robot Chassis
  • 1 × VR Headset Oculus Rift
  • 1 × Digital Camera

View all 7 components

  • Preliminary Timeline

    vcarter011/08/2017 at 13:50 0 comments

    11/1: Finish planning and design phase/begin construction

    11/15: Finish construction of camera

    12/1: Establish connection between camera and computer

    1/1: Finish code

    1/1-4/1: Troubleshooting and Fine Tuning

View project log

  • 1
    Step 1

View all instructions

Enjoy this project?



Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates