Auditory Virtual Environments

A virtual environment aims at creating situations in which humans have perceptions that do not correspond to their physical environment but to a virtual one. The present chapter focuses on auditory virtual environments, i. e. on the auditory component of virtual environments as seen independently from the remaining modalities. Section 11.1 introduces and discusses concepts, such as auditory event and plausibility, required to the understanding of the remaining chapter. Section 11.2 presents the various components of a typical auditory virtual environment along with the techniques and models most often employed by each of them. Section 11.3 presents specific implementations of auditory virtual environments and addresses a selection of current research issues, namely, multi-modality, presence, quality and joint reality. Section 11.4 closes the chapter with a summary of the main conclusions.

[1]  Frank Biocca,et al.  A Survey of Position Trackers , 1992, Presence: Teleoperators & Virtual Environments.

[2]  Julius O. Smith,et al.  Physical Modeling Using Digital Waveguides , 1992 .

[3]  Arild Lacroix.  Speech Production — Acoustics, Models, and Applications , 2005 .

[4]  A. Kulowski.  Algorithmic representation of the ray tracing technique , 1985 .

[5]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[6]  Miller S. Puckette,et al.  Designing Multi-Channel Reverberators , 1982 .

[7]  Matti Karjalainen,et al.  Direction-Dependent Physical Modeling of Musical Instruments , 1995 .

[8]  Vesa Välimäki,et al.  Improved discrete-time modeling of multi-dimensional wave propagation using the interpolated digital waveguide mesh , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  H. Bass,et al.  Atmospheric Absorption of Sound: Analytical Expressions , 1972 .

[10]  Nathaniel I. Durlach,et al.  On the Externalization of Auditory Images , 1992, Presence: Teleoperators & Virtual Environments.

[11]  Elizabeth M. Wenzel,et al.  A software-based system for interactive spatial sound synthesis , 2000 .

[12]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[13]  Manfred R. Schroeder,et al.  Computer simulation of sound transmission in rooms , 1963 .

[14]  Manfred R. Schroeder,et al.  Acoustic Absorbers and Diffusers, Theory, design and application , 2002 .

[15]  Jens Blauert,et al.  Principles of binaural room simulation , 1992 .

[16]  Jean-Marc Jot,et al.  Real-time spatial processing of sounds for music, multimedia and interactive human-computer interfaces , 1999, Multimedia Systems.

[17]  Ag Armin Kohlrausch,et al.  Audio—Visual Interaction in the Context of Multi-Media Applications , 2005 .

[18]  Jens Blauert,et al.  Psychoacoustic Investigations on Sound-source Occlusion , 2003 .

[19]  Henrik Møller.  Fundamentals of binaural technology , 1991 .

[20]  Vesa Välimäki,et al.  Reducing the dispersion error in the digital waveguide mesh using interpolation and frequency-warping techniques , 2000, IEEE Trans. Speech Audio Process..

[21]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[22]  Arthur H. Benade,et al.  Two‐ear correlation in the statistical sound fields of rooms , 1986 .

[23]  Davide Rocchesso,et al.  Circulant and elliptic feedback delay networks for artificial reverberation , 1997, IEEE Trans. Speech Audio Process..

[24]  Hugo Fastl,et al.  Psycho-Acoustics and Sound Quality , 2005 .

[25]  Jesper Sandvad,et al.  Dynamic aspects of auditory virtual environments , 1996 .

[26]  T Z Strybel,et al.  Aurally Aided Visual Search in the Central Visual Field: Effects of Visual Load and Visual Enhancement of the Target , 1991, Human factors.

[27]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .

[28]  Julius O. Smith,et al.  Physical Modeling Synthesis Update , 1996 .

[29]  F L Wightman,et al.  Headphone simulation of free-field listening. I: Stimulus synthesis. , 1989, The Journal of the Acoustical Society of America.

[30]  S. Carlile,et al.  Measuring the human head-related transfer functions: a novel method for the construction and calibration of a miniature "in-ear" recording system. , 1994, The Journal of the Acoustical Society of America.

[31]  Jean-Marc Jot,et al.  A Real-Time Spatial Sound Processor for Music and Virtual Reality Applications , 1995, ICMC.

[32]  J. Borish.  Extension of the image model to arbitrary polyhedra , 1984 .

[33]  Tapio Lokki,et al.  Creating Interactive Virtual Acoustic Environments , 1999 .

[34]  Robert H. Gilkey,et al.  The Sense of Presence for the Suddenly Deafened Adult:Implications for Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[35]  Renato S. Pellegrini,et al.  Quality assessment of auditory virtual environments , 2001 .

[36]  A. J. Berkhout,et al.  A Holographic Approach to Acoustic Control , 1988 .

[37]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[38]  Jens Blauert,et al.  Acoustic simulation of rooms with boundaries of partially specular reflectivity , 2001 .

[39]  Lloyd A. Jeffress,et al.  Formulas for the Coefficient of Interaural Correlation for Noise , 1962 .

[40]  Günther Theile,et al.  Design and Applications of a Data-Based Auralization System for Surround Sound , 1999 .

[41]  James A. Moorer,et al.  About This Reverberation Business , 1978 .

[42]  David A. Rabenhorst,et al.  An Architecture for Virtual Worlds , 1992, Presence: Teleoperators & Virtual Environments.

[43]  Marinus M. Boone,et al.  Spatial sound-field reproduction by wave-field synthesis , 1995 .

[44]  Wolfgang Ahnert,et al.  Head-Tracked Auralization of Acoustical Simulation , 2004 .

[45]  Mendel Kleiner,et al.  Auralization-An Overview , 1993 .

[46]  Sebastian Möller,et al.  Quality of Transmitted Speech for Humans and Machines , 2005 .

[47]  Henrik Møller,et al.  Binaural Technique: Basic Methods for Recording, Synthesis, and Reproduction , 2005 .

[48]  Michael Friis Sørensen,et al.  Head-Related Transfer Functions of Human Subjects , 1995 .

[49]  W. G. Gardner,et al.  3-D Audio Using Loudspeakers , 1998 .

[50]  Julius O. Smith.  A new approach to digital reverberation using closed waveguide networks , 1985 .

[51]  Ning Xiang,et al.  Binaural scale modelling for auralisation and prediction of acoustics in auditoria , 1993 .

[52]  Etienne Corteel,et al.  Implementation of an Auralization Scheme in a Digital Mixing Console Using Perceptual Parameters , 2000 .

[53]  Ute Jekosch,et al.  Assigning Meaning to Sounds — Semiotics in the Context of Product-Sound Design , 2005 .

[54]  J. Flanagan.  Analog Measurements of Sound Radiation from the Mouth , 1960 .

[55]  Elizabeth M. Wenzel,et al.  Localization in Virtual Acoustic Displays , 1992, Presence: Teleoperators & Virtual Environments.

[56]  M. Vorländer.  Simulation of the transient and steady‐state sound propagation in rooms using a new combined ray‐tracing/image‐source algorithm , 1989 .

[57]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[58]  Frank Joseph Pompei,et al.  The Use of Airborne Ultrasonics for Generating Audible Sound Beams , 1999 .

[59]  David G. Malham,et al.  3-D Sound Spatialization using Ambisonic Techniques , 1995 .

[60]  Barry A. Blesser.  An Interdisciplinary Synthesis of Reverberation Viewpoints , 2001 .

[61]  Thomas Funkhouser,et al.  A beam tracing method for interactive architectural acoustics. , 2004, The Journal of the Acoustical Society of America.

[62]  Matti Karjalainen,et al.  Modeling of reflections and air absorption in acoustical spaces a digital filter design approach , 1997, Proceedings of 1997 Workshop on Applications of Signal Processing to Audio and Acoustics.

[63]  Henrik Møller,et al.  Head-Related Transfer Functions; Measurements on 40 Human Subjects , 1992 .

[64]  Manfred R. Schroeder,et al.  Natural Sounding Artificial Reverberation , 1962 .

[65]  Pedro Novo,et al.  IKA-SIM: A System to Generate Auditory Virtual Environments , 2004 .

[66]  Tapio Lokki,et al.  SUBJECTIVE EVALUATION OF AURALIZATION OF PHYSICS-BASED ROOM ACOUSTICS MODELING , 2001 .

[67]  S.A. Van Duyne,et al.  The tetrahedral digital waveguide mesh , 1995, Proceedings of 1995 Workshop on Applications of Signal Processing to Audio and Accoustics.