Prototyping a New Audio-Visual Instrument Based on Extraction of High-Level Features on Full-Body Motion Project Proposal for the eNTERFACE 2015 International Workshop

Skeletal data acquisition generates a huge amount of high-dimensionality data. In many fields where mocap techniques are now used, practitioners would greatly benefit from high-level representations of these motion sequences. However, meaningful motion data dimensionality reduction is not a trivial task and the selection of the best set of features will largely depend on the considered use case, hence enhancing the need for a fast customization and prototyping tool. Numediart has worked this year on the first version of such a motion analysis framework: MotionMachine. The goal of this project is to build, based on MotionMachine, a new audio-visual instrument that uses full-body motion to drive sound and visuals. We will develop this new instrument as a proof of concept: the elaborate choice of higherlevel feature extraction techniques will greatly improve human/computer interaction and lead to more expressive experiences.