Controlling Real Time Sound Spatialization Using The Radiodrum

We present a real-time, multi-channel rendering system with the radiodrum controller as an intuitive, handson interface to a 3D spatialization system. The radiodrum is a virtual controller and interface that allows for very rapid tracking of two augmented drum sticks in 3D space. We have combined this interface with a real time 3D visualization system that allows a user to control the position of sound sources using an array of loudspeakers, typically setup in a cube model inside a rectangular room. To generate the auditory scene, we use a model that is a combination of an image source model and a model developed by Moore in which virtual sounds are positioned and moved using a combination of delay lines.

[1]  Sascha Spors,et al.  High-Quality Acoustic Rendering with Wave Field Synthesis , 2002, VMV.

[2]  David G. Malham,et al.  3-D Sound Spatialization using Ambisonic Techniques , 1995 .

[3]  David Hutchison,et al.  Gesture-Based Human-Computer Interaction and Simulation , 2009 .

[4]  Marcelo M. Wanderley,et al.  Gesture Control of Sound Spatialization for Live Musical Performance , 2007, Gesture Workshop.

[5]  George Tzanetakis,et al.  MARSYAS-0.2: A Case Study in Implementing Music Information Retrieval Systems , 2008 .

[6]  Koeng-Mo Sung,et al.  Artificial Reverberator with Location Control in Multi-Channel Recording , 2007 .

[7]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[8]  Alexander Refsum Jensenius,et al.  On the Development of a System for Gesture Control of Spatialization , 2006, ICMC.

[9]  Harry D. Castle,et al.  Real-Time Implementation of a General Model for Spatial Processing of Sounds , 1983, ICMC.

[10]  V. Pulkki,et al.  Multichannel audio rendering using amplitude panning [DSP Applications] , 2008, IEEE Signal Processing Magazine.

[11]  Jonas Braasch.  A Loudspeaker-based 3D Sound Projection using Virtual Microphone Control (ViMiC) , 2005 .

[12]  Jean-Marc Jot,et al.  A Real-Time Spatial Sound Processor for Music and Virtual Reality Applications , 1995, ICMC.

[13]  Yan Li,et al.  Spatial Sound Rendering Using Measured Room Impulse Responses , 2006, 2006 IEEE International Symposium on Signal Processing and Information Technology.

[14]  Robert A. Boie,et al.  The Radio Drum as a Synthesizer Controller , 1989, ICMC.