Software Overview

A project log for Lego Music

A Tangible User Interface which allows the creation of music from an arrangement of Lego blocks

paul-wallacePaul Wallace 09/16/2018 at 14:410 Comments

Software Overview

The overview of the system is as follows:

On the left are the vision components. These are responsible for getting images of the blocks from the webcam and converting them into a set of notes to be played. Open CV is a well known library for image processing and here we use the Emgu.CV wrapper for C#/.Net

On the right are the audio components. These convert the extracted notes into sound. The NAudio library is used for MIDI sound synthesis.