Close
0%
0%

Head Tracking Virtual Window

Tracks the user's head and displays the appropriate view of a virtual scene.

RoyRoy
Similar projects worth following
The goal of this project is to make a regular display work like a window into the virtual world. This is done by tracking the user's head with a camera and rendering a distorted image to account for the user's perspective of the display. The effect becomes more convincing at higher framerates, so performance is critical. This could be used for entertainment, productivity, or even as decoration.

Written in Python, using OpenCV for image manipulation, Mediapipe for face tracking, and Pygame and OpenGL for 3D rendering. Face tracking works at a wide range of distances, from a few inches to at least 6 feet away, and at angles you probably wouldn't use a display at. The effect is best for producing small amounts of inward depth; scenes that "pop out" or are very far away suffer greatly from a lack of stereo depth.

A long-term goal is for this to be a software tool that would allow any display and camera to be calibrated for use as this type of virtual window.

https://github.com/royeverett/VirtualWindow

View project log

Enjoy this project?

Share

Discussions

Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates