Close

AR Audio Application

A project log for Binaural Audio Editor

This is an audio application that produces 3D binaural audio from 2D mono audio samples and positional information given by GUI.

pablo-antonio-camacho-jrPablo Antonio Camacho Jr. 08/17/2019 at 21:590 Comments

I managed to implement the BNO055, IMU sensor by Bosch, into the program through UART, I2C, Arduino UNO.

It changes the orientation of the listener by sending out quaternion w,x,y,z data which provides the 3D rotation of the listener. The rotation quaternion is multiplied to the quaternion representing forward direction vector and multiplied to conjugate of rotation quaternion; the product is a rotated forward direction vector that is assigned as the new direction that listener is facing.

The next challenge is to implement a pedometer into the application alongside with orientation of the listener. The pedometer will be used to move the position of the listener.

It is easy to get a step from a pedometer, however the difficult part will be to figure out the direction the step was taken.

Discussions