Psychoacoustic Characterization of Propagation Effects in Virtual Environments

As sound propagation algorithms become faster and more accurate, the question arises as to whether the additional efforts to improve fidelity actually offer perceptual benefits over existing techniques. Could environmental sound effects go the way of music, where lower-fidelity compressed versions are actually favored by listeners? Here we address this issue with two acoustic phenomena that are known to have perceptual effects on humans and that, accordingly, might be expected to heighten their experience with simulated environments. We present two studies comparing listeners’ perceptual response to both accurate and approximate algorithms simulating two key acoustic effects: diffraction and reverberation. For each effect, we evaluate whether increased numerical accuracy of a propagation algorithm translates into increased perceptual differentiation in interactive virtual environments. Our results suggest that auditory perception does benefit from the increased accuracy, with subjects showing better perceptual differentiation when experiencing the more accurate rendering method: the diffraction experiment shows a more linearly decaying sound field (with respect to the diffraction angle) for the accurate diffraction method, whereas the reverberation experiment shows that more accurate reverberation, after modest user experience, results in near-logarithmic response to increasing room volume.

[1]  Mendel Kleiner,et al.  Edge Diffraction and Surface Scattering in Auralization , 2001 .

[2]  Durand R. Begault,et al.  Perceptual Effects of Synthetic Reverberation on Three-Dimensional Audio Systems , 1992 .

[3]  Dinesh Manocha,et al.  WAVE: Interactive Wave-based Sound Propagation for Virtual Environments , 2015, IEEE Transactions on Visualization and Computer Graphics.

[4]  Galster Ja The effect of room volume on speech recognition in enclosures with similar mean reverberation time. , 2007 .

[5]  Dinesh Manocha,et al.  Adaptive impulse response modeling for interactive sound propagation , 2016, I3D.

[6]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[7]  M. Vorländer Simulation of the transient and steady‐state sound propagation in rooms using a new combined ray‐tracing/image‐source algorithm , 1989 .

[8]  Dinesh Manocha,et al.  An efficient GPU-based time domain solver for the acoustic wave equation , 2012 .

[9]  A. F.,et al.  Architectural Acoustics , 1933, Nature.

[10]  Dinesh Manocha,et al.  Interactive sound rendering in complex and dynamic scenes using frustum tracing , 2007, IEEE Transactions on Visualization and Computer Graphics.

[11]  Ming C. Lin,et al.  Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition , 2009, IEEE Transactions on Visualization and Computer Graphics.

[12]  S M Abel,et al.  Sound localization: effects of reverberation time, speaker array, stimulus frequency, and stimulus rise/decay. , 1993, The Journal of the Acoustical Society of America.

[13]  Dinesh Manocha,et al.  A parallel time-domain wave simulator based on rectangular decomposition for distributed memory architectures , 2015 .

[14]  Dinesh Manocha,et al.  Psychoacoustic characterization of propagation effects in virtual environments , 2016, SAP.

[15]  Dinesh Manocha,et al.  Efficient finite-edge diffraction using conservative from-region visibility , 2012 .

[16]  Dinesh Manocha,et al.  High-order diffraction and diffuse reflections for interactive sound propagation in large environments , 2014, ACM Trans. Graph..

[17]  J. Zwislocki,et al.  Absolute scaling of sensory magnitudes: A validation , 1980, Perception & psychophysics.

[18]  K. Yee Numerical solution of initial boundary value problems involving maxwell's equations in isotropic media , 1966 .

[19]  W. Hartmann Localization of sound in rooms. , 1983, The Journal of the Acoustical Society of America.

[20]  Dinesh Manocha,et al.  Guided Multiview Ray Tracing for Fast Auralization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[21]  Thomas Funkhouser,et al.  A beam tracing method for interactive architectural acoustics. , 2004, The Journal of the Acoustical Society of America.

[22]  Raffaele Parisi,et al.  Binaural sound source localization in the presence of reverberation , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[23]  Ville Pulkki,et al.  Psychoacoustic Cues in Room Size Perception , 2004 .

[24]  Daniel Västfjäll,et al.  Better Presence and Performance in Virtual Environments by Improved Binaural Sound Rendering , 2002 .

[25]  W. Hartmann,et al.  Localization of sound in rooms, II: The effects of a single reflecting surface. , 1985, The Journal of the Acoustical Society of America.

[26]  Dezhang Chu,et al.  Higher-order acoustic diffraction by edges of finite thickness , 2007 .

[27]  Densil Cabreraa,et al.  Auditory Room Size Perception for Modeled and Measured Rooms , 2005 .

[28]  Dinesh Manocha,et al.  Wave-based sound propagation in large open scenes using an equivalent source formulation , 2013, TOGS.

[29]  Claudiu B. Pop Auditory Room Size Perception for Real Rooms , 2005 .

[30]  Dinesh Manocha,et al.  RESound: interactive sound rendering for dynamic virtual environments , 2009, ACM Multimedia.

[31]  T. Kawai Sound diffraction by a many-sided barrier or pillar , 1981 .

[32]  O. C. Zienkiewicz,et al.  The Finite Element Method for Fluid Dynamics , 2005 .

[33]  Dinesh Manocha,et al.  AD-Frustum: Adaptive Frustum Tracing for Interactive Sound Propagation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[34]  Heinrich Kuttruff,et al.  Acoustics: An Introduction , 2006 .

[35]  M. Kleiner,et al.  Audibility of edge diffraction in auralization of a stage house , 1998 .

[36]  M. Biot,et al.  Formulation of Wave Propagation in Infinite Media by Normal Coordinates with an Application to Diffraction , 1957 .

[37]  M. Kleiner,et al.  Computation of edge diffraction for more accurate room acoustics auralization. , 2001, The Journal of the Acoustical Society of America.

[38]  J. Borish Extension of the image model to arbitrary polyhedra , 1984 .

[39]  Thomas A. Funkhouser,et al.  Modeling acoustics in virtual environments using the uniform theory of diffraction , 2001, SIGGRAPH.

[40]  Manfred R. Schroeder,et al.  Natural Sounding Artificial Reverberation , 1962 .

[41]  Jean-Marc Jot,et al.  Digital Delay Networks for Designing Artificial Reverberators , 1991 .

[42]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[43]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[44]  Jean-Pierre Berenger,et al.  A perfectly matched layer for the absorption of electromagnetic waves , 1994 .

[45]  Craig J. Webb,et al.  Large-scale virtual acoustics simulation at audio rates using three dimensional finite difference time domain and multiple graphics processing units , 2013 .

[46]  R. Kouyoumjian,et al.  A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface , 1974 .

[47]  A. Cheng,et al.  Heritage and early history of the boundary element method , 2005 .

[48]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .