Guided Multiview Ray Tracing for Fast Auralization

We present a novel method for tuning geometric acoustic simulations based on ray tracing. Our formulation computes sound propagation paths from source to receiver and exploits the independence of visibility tests and validation tests to dynamically guide the simulation to high accuracy and performance. Our method makes no assumptions of scene layout and can account for moving sources, receivers, and geometry. We combine our guidance algorithm with a fast GPU sound propagation system for interactive simulation. Our implementation efficiently computes early specular paths and first order diffraction with a multiview tracing algorithm. We couple our propagation simulation with an audio output system supporting a high order interpolation scheme that accounts for attenuation, cross fading, and delay. The resulting system can render acoustic spaces composed of thousands of triangles interactively.

[1]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[2]  Tapio Lokki,et al.  Frequency domain acoustic radiance transfer for real-time auralization , 2009 .

[3]  H. Lehnert.  Systematic errors of the ray-tracing algorithm , 1993 .

[4]  Tapio Lokki,et al.  Auralization applying the parametric room acoustic modeling technique - The DIVA auralization system , 2002 .

[5]  Robert Bristow-Johnson,et al.  Performance of Low-Order Polynomial Interpolators in the Presence of Oversampled Input , 1999 .

[6]  Dinesh Manocha,et al.  Interactive sound propagation using compact acoustic transfer operators , 2012, TOGS.

[7]  U. Peter Svensson,et al.  Diffraction Culling for Virtual-Acoustic Simulations , 2008 .

[8]  Hans Hagen,et al.  Phonon tracing for auralization and visualization of sound , 2005, VIS 05. IEEE Visualization, 2005..

[9]  Kun Zhou,et al.  Real-time KD-tree construction on graphics hardware , 2008, SIGGRAPH Asia '08.

[10]  Thomas A. Funkhouser,et al.  Modeling acoustics in virtual environments using the uniform theory of diffraction , 2001, SIGGRAPH.

[11]  Hans-Peter Seidel,et al.  Stackless KD‐Tree Traversal for High Performance GPU Ray Tracing , 2007, Comput. Graph. Forum.

[12]  D. Alarcão,et al.  An auralization system for real time room acoustics simulation , 2009 .

[13]  George Drettakis,et al.  Progressive perceptual audio rendering of complex scenes , 2007, SI3D.

[14]  Jean-Marc Jot,et al.  Real-time spatial processing of sounds for music, multimedia and interactive human-computer interfaces , 1999, Multimedia Systems.

[15]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .

[16]  Dinesh Manocha,et al.  FastV : From-point Visibility Culling on Complex Models , 2009 .

[17]  Thomas Funkhouser,et al.  A beam tracing method for interactive architectural acoustics. , 2004, The Journal of the Acoustical Society of America.

[18]  A. Farina.  RAMSETE-A NEW PYRAMID TRACER FOR MEDIUM AND LARGE SCALE ACOUSTIC PROBLEMS , 2000 .

[19]  Timo Aila,et al.  Understanding the efficiency of ray traversal on GPUs , 2009, High Performance Graphics.

[20]  U. Svensson,et al.  An analytic secondary source model of edge diffraction impulse responses , 1999 .

[21]  Unto K. Laine,et al.  Splitting the unit delay [FIR/all pass filters design] , 1996, IEEE Signal Process. Mag..

[22]  Vesa V Alim Aki.  Discrete-Time Modeling of Acoustic Tubes Using Fractional Delay Filters , 1995 .

[23]  Dinesh Manocha,et al.  RESound: interactive sound rendering for dynamic virtual environments , 2009, ACM Multimedia.

[24]  Ramani Duraiswami,et al.  Fast Evaluation of the Room Transfer Function Using Multipole Expansion , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  Tapio Lokki,et al.  Creating Interactive Virtual Acoustic Environments , 1999 .

[26]  M. Biot,et al.  Formulation of Wave Propagation in Infinite Media by Normal Coordinates with an Application to Diffraction , 1957 .

[27]  George Drettakis,et al.  Perceptual audio rendering of complex virtual environments , 2004, ACM Trans. Graph..

[28]  R. Kouyoumjian,et al.  A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface , 1974 .

[29]  Samuli Laine,et al.  Accelerated beam tracing algorithm , 2009 .

[30]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[31]  Bengt-Inge Dalenbäck.  Room acoustic prediction based on a unified treatment of diffuse and specular reflection , 1996 .

[32]  Nicolas Tsingos,et al.  A VERSATILE SOFTWARE ARCHITECTURE FOR VIRTUAL AUDIO SIMULATIONS , 2001 .

[33]  Wolfgang Straßer,et al.  Multi-resolution sound rendering , 2004, SIGGRAPH '04.

[34]  Elizabeth M. Wenzel,et al.  A software-based system for interactive spatial sound synthesis , 2000 .

[35]  Michael Vorländer,et al.  Virtual Reality System with Integrated Sound Field Simulation and Reproduction , 2007, EURASIP J. Adv. Signal Process..

[36]  Krzysztof Marasek,et al.  Computation of Room Acoustics using Programmable Video Hardware , 2004, ICCVG.

[37]  Dinesh Manocha,et al.  Direct-to-Indirect Acoustic Radiance Transfer , 2012, IEEE Transactions on Visualization and Computer Graphics.

[38]  Ulrich J. Kurze,et al.  Noise reduction by barriers , 1973 .

[39]  Alan Chalmers,et al.  Realtime Room Acoustics Using Ambisonics , 1999 .

[40]  Dinesh Manocha,et al.  AD-Frustum: Adaptive Frustum Tracing for Interactive Sound Propagation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[41]  Dirk Schröder,et al.  Real-time processing of image sources using binary space partitioning , 2006 .

[42]  Dinesh Manocha,et al.  Fast BVH Construction on GPUs , 2009, Comput. Graph. Forum.

[43]  M. Vorländer.  Simulation of the transient and steady‐state sound propagation in rooms using a new combined ray‐tracing/image‐source algorithm , 1989 .

[44]  Bill Kapralos,et al.  GPU-based real-time acoustical occlusion modeling , 2010, Virtual Reality.

[45]  A. M. Ondet,et al.  Modeling of sound propagation in fitted workshops using ray tracing , 1989 .

[46]  Nicolas Tsingos,et al.  Precomputing Geometry-Based Reverberation Effects for Games , 2009 .

[47]  Bill Kapralos,et al.  GPU-Based Acoustical Diffraction Modeling for Complex Virtual Reality and Gaming Environments , 2011 .

[48]  Chen Ke-an,et al.  On the accuracy of the ray-tracing algorithms based on various sound receiver models , 2003 .

[49]  B. M. Shield,et al.  DEVELOPMENT OF A RAY TRACING COMPUTER MODEL FOR THE PREDICTION OF THE SOUND FIELD IN LONG ENCLOSURES , 2000 .

[50]  A. Pierce.  Diffraction of sound around corners and over wide barriers , 1974 .

[51]  Leif Kobbelt,et al.  Efficient Rasterization for Outdoor Radio Wave Propagation , 2011, IEEE Transactions on Visualization and Computer Graphics.

[52]  Maic Masuch,et al.  RAY ACOUSTICS USING COMPUTER GRAPHICS TECHNOLOGY , 2007 .

[53]  Andreas Franck,et al.  Efficient Algorithms and Structures for Fractional Delay Filtering Based on Lagrange Interpolation , 2009 .

[54]  J. Borish.  Extension of the image model to arbitrary polyhedra , 1984 .

[55]  Micah T. Taylor,et al.  Fast Geometric Sound Propagation with Finite-Edge Diffraction , 2010 .

[56]  Thomas A. Funkhouser,et al.  A beam tracing approach to acoustic modeling for interactive virtual environments , 1998, SIGGRAPH.