Glitch Machine is an audio visual musical instrument that integrates computer vision, video mapping and music sequencing. A custom software developed with openFrameworks (Kinectif) gets data from Kinect sensor and defines regions that can trigger sounds and visuals in combination with audio and vj software, the sounds can be sequenced and the visuals can used for video mapping, all happening in real time. With all this technology mixed the results is an audio visual performance of a glitch hop song that is enterally played with the hands and feet and the visuals are mapped to a physical structure that will create the glitch instrument.

Prototype and more info: http://goo.gl/8cpOg.