Interactive sound propagation for dynamic scenes using 2D wave simulation

We present a technique to model wave‐based sound propagation to complement visual animation in fully dynamic scenes. We employ 2D wave simulation that captures geometry‐based diffraction effects such as obstruction, reverberation, and directivity of perceptually‐salient initial sound at the source and listener. We show real‐time performance on a single CPU core on modestly‐sized scenes that are nevertheless topologically complex. Our key ideas are to exploit reciprocity and use a perceptual encoding and rendering framework. These allow the use of low‐frequency finite‐difference simulations on static scene snapshots. Our results show plausible audio variation that remains robust to motion and geometry changes. We suggest that wave solvers can be a practical approach to real‐time dynamic acoustics. We share the complete C++ code of our “Planeverb” system.

[1]  Ming C. Lin,et al.  Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition , 2009, IEEE Transactions on Visualization and Computer Graphics.

[2]  Dinesh Manocha,et al.  Diffraction Kernels for Interactive Sound Propagation in Dynamic Environments , 2018, IEEE Transactions on Visualization and Computer Graphics.

[3]  S. Fels,et al.  Towards real-time two-dimensional wave propagation for articulatory speech synthesis , 2016 .

[4]  Lauri Savioja,et al.  REAL-TIME 3D FINITE-DIFFERENCE TIME-DOMAIN SIMULATION OF LOW- AND MID-FREQUENCY ROOM ACOUSTICS , 2010 .

[5]  Michael Vorländer,et al.  A round robin on room acoustical simulation and auralization. , 2019, The Journal of the Acoustical Society of America.

[6]  Dirk Schröder,et al.  Physically based real-time auralization of interactive virtual environments , 2011 .

[7]  Richard L. McKinley,et al.  The Interaction Between Head-Tracker Latency, Source Duration, and Response Time in the Localization of Virtual Sound Sources , 2004, ICAD.

[8]  M. Schroeder.  New Method of Measuring Reverberation Time , 1965 .

[9]  Michael Vorländer,et al.  Interactive Real-Time Simulation and Auralization for Modifiable Rooms , 2014 .

[10]  P. W. Smith,et al.  Comments on “New Method of Measuring Reverberation Time” [M. R. Schroeder, J. Acoust. Soc. Am. 37, 409–412 (1965)] , 1965 .

[11]  H. Gaskell.  The precedence effect , 1983, Hearing Research.

[12]  Nikunj Raghuvanshi,et al.  Wave Acoustics in a Mixed Reality Shell , 2018 .

[13]  Lauri Savioja,et al.  Overview of geometrical room acoustic modeling techniques. , 2015, The Journal of the Acoustical Society of America.

[14]  Nikunj Raghuvanshi,et al.  Aesthetic Modification of Room Impulse Responses for Interactive Auralization , 2019 .

[15]  Thomas A. Funkhouser,et al.  A beam tracing approach to acoustic modeling for interactive virtual environments , 1998, SIGGRAPH.

[16]  Doug L. James,et al.  Toward wave-based sound synthesis for computer animation , 2018, ACM Trans. Graph..

[17]  H S Colburn,et al.  The precedence effect. , 1999, The Journal of the Acoustical Society of America.

[18]  Ville Pulkki,et al.  Spatial sound generation and perception by amplitude panning techniques , 2001 .

[19]  Dinesh Manocha,et al.  High-order diffraction and diffuse reflections for interactive sound propagation in large environments , 2014, ACM Trans. Graph..

[20]  Vesa Välimäki,et al.  Simulation of Room Acoustics using 2-D Digital Waveguide Meshes , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[21]  Nikunj Raghuvanshi,et al.  Parametric directional coding for precomputed sound propagation , 2018, ACM Trans. Graph..

[22]  Ravish Mehra,et al.  Challenges of Distributed Real-Time Finite-Difference Time-Domain Room Acoustic Simulation for Auralization , 2018 .

[23]  Anders Gade,et al.  Acoustics in Halls for Speech and Music , 2014 .

[24]  Damian Murphy,et al.  ACHIEVING REALISTIC AURALISATIONS USING AN EFFICIENT HYBRID 2D MULTI-PLANE FDTD ACOUSTIC MODEL , 2014 .

[25]  Nikunj Raghuvanshi,et al.  Fast acoustic obstruction with proximity cost differencing (PCD) , 2020 .

[26]  Nikunj Raghuvanshi,et al.  Parametric wave field coding for precomputed sound propagation , 2014, ACM Trans. Graph..

[27]  Derek Nowrouzezahrai,et al.  Directional sources and listeners in interactive sound propagation using reciprocal wave field coding , 2020, ACM Trans. Graph..

[28]  Nikunj Raghuvanshi,et al.  Triton: Practical pre-computed sound propagation for games and virtual reality , 2017 .

[29]  Michael Vorlnder,et al.  Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality , 2020 .