Marshall Digital

This paper discusses a system capable of detecting the position of the listener through a head-tracking system and rendering a 3D audio environment by binaural spatialization. Head tracking is performed through face recognition algorithms which use a standard webcam, and the result is presented over headphones, like in other typical binaural applications. With this system users can choose an audio file to play, provide a virtual position for the source in an euclidean space, and then listen to the sound as if it is coming from that position. If they move their head, the signal provided by the system changes accordingly in real-time, thus providing a realistic effect.

[1]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[2]  Tugba Tatli 3D Panner: A Compositional Tool for Binaural Sound Synthesis , 2009, ICMC.

[3]  Robert Höldrich,et al.  3D binaural sound reproduction using a virtual ambisonic approach , 2003, IEEE International Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2003. VECIMS '03. 2003.

[4]  Russell L. Martin,et al.  Construction of 3-D Audio Systems: Background, Research, and General Requirements , 2008 .

[5]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[6]  W. Yost Fundamentals of hearing: An introduction , 1977 .

[7]  Jean-Marc Jot,et al.  Spat~ : A Spatial Processor for Musicians and Sound Engineers , 1995 .

[8]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[9]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .