A framework for immersive spatial audio performance

Traditional uses of virtual audio environments tend to focus on perceptually accurate acoustic representations. Though spatialization of sound sources is important, it is necessary to leverage control of the sonic representation when considering musical applications. The proposed framework allows for the creation of perceptually immersive scenes that function as musical instruments. Loudspeakers and microphones are modeled within the scene along with the listener/performer, creating a navigable 3D sonic space where sound sources and sinks process audio according to user-defined spatial mappings.

[1]  Markus H. Gross,et al.  Spatialized audio rendering for immersive virtual environments , 2002, VRST '02.

[2]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[3]  Roel Vertegaal,et al.  Quarterly Progress and Status Report Towards a musician’s cockpit: Transducers, feedback and musical function , 2007 .

[4]  Tapio Lokki,et al.  Creating Interactive Virtual Acoustic Environments , 1999 .

[5]  Tapio Takala,et al.  Experiments with Virtual Reality Instruments , 2005, NIME.

[6]  W. G. Gardner,et al.  HRTF measurements of a KEMAR , 1995 .

[7]  A Lewis,et al.  THE SCIENCE OF SOUND , 1997 .

[8]  Matthew Wright,et al.  Problems and Prospects for Intimate Musical Control of Computers , 2002, Computer Music Journal.

[9]  Jeff Pressing,et al.  Some Perspectives on Performed Sound and Music in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[10]  W. G. Gardner,et al.  3-D Audio Using Loudspeakers , 1998 .

[11]  Jean-Marc Jot,et al.  Real-time spatial processing of sounds for music, multimedia and interactive human-computer interfaces , 1999, Multimedia Systems.

[12]  Michael J. Gerzon.  Periphony: With-Height Sound Reproduction , 1973 .

[13]  Sidney Fels,et al.  Mapping virtual object manipulation to sound variation , 1997 .

[14]  Thomas A. Funkhouser,et al.  Modeling acoustics in virtual environments using the uniform theory of diffraction , 2001, SIGGRAPH.

[15]  Ross Kirk,et al.  Mapping Strategies for Musical Performance , 2000 .

[16]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[17]  Gerhard Steinke.  Surround Sound-The New Phase , 1996 .

[18]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .