Efficient Hybrid Virtual Room Acoustic Modelling

This thesis investigates approaches to virtual room acoustic modelling and auralisation in order to a develop hybrid modelling solution that is capable of efficient and accurate simulation of enclosed sound propagation. Emphasis is placed on the advantages and disadvantages of state of the art numerical and geometric acoustic modelling methods. Numerical methods have been shown to preserve important sound wave characteristics such as diffraction and room modes, and are considered more accurate for low frequency acoustic modelling than geometric techniques which fail to preserve such wave effects. However, the implementation of numerical acoustic models inherently requires large computational effort compared to more efficient geometric techniques such as ray-tracing. This is particularly problematic for simulations of large-scale 3D acoustic environments and for high spatio-temporal sampling rates. A novel acoustic modelling solution is presented, which seeks to circumvent the disadvantageous computational requirements of 3D numerical models while producing a suitable approximation to low frequency sound behaviour. This modelling technique incorporates multiple planar cross-sectional 2D Finite Difference schemes that are utilised in combination to synthesise low frequency wave propagation throughout the target acoustic field. In this way a subset of prominent low frequency sound wave characteristics may be emulated with low computational cost compared to 3D numerical schemes. These low-frequency results can then be combined with the high-frequency output from efficient geometric simulations to create a hybrid model providing accurate broadband results at a relatively low computational cost. Investigation of room impulse response rendering for a series of theoretic and real spaces demonstrates advantages of this new hybrid acoustic modelling technique over purely ray-based methods in terms of low frequency accuracy, and over 3D numerical methods in terms of computational efficiency. Conclusions are drawn from objective measurements obtained from simulation results of the virtual models produced. Results demonstrate the applicability of the novel hybrid approach to the enhancement of purely ray-based room impulse response rendering by which a more realistic representation of low frequency wave phenomena may be simulated in an efficient manner, improving the theoretical accuracy of objective and audible results. This study contributes towards research and design of high-speed, interactive virtual acoustic simulations appropriate for industrial and creative virtual reality applications.

[1]  Tapio Takala,et al.  Simulation of Room Acoustics with a 3-D Finite Difference Mesh , 1994, ICMC.

[2]  Matthew G. Blevins,et al.  Quantifying the just noticeable difference of reverberation time with band-limited noise centered around 1000 Hz using a transformed up-down adaptive method , 2013 .

[3]  Maarten van Walstijn,et al.  Room Acoustics Simulation Using 3-D Compact Explicit FDTD Schemes , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  M. Schroeder,et al.  On Frequency Response Curves in Rooms. Comparison of Experimental, Theoretical, and Monte Carlo Results for the Average Frequency Spacing between Maxima , 1962 .

[5]  Damian Murphy,et al.  Methods for 2nd Order Spherical Harmonic Spatial Encoding in Digital Waveguide Mesh Virtual Acoustic Simulations , 2007, 2007 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[6]  Stefan Bilbao,et al.  Large Stencil Operations for GPU-based 3-D Acoustics Simulations , 2015 .

[7]  Allen Taflove,et al.  Computational Electrodynamics the Finite-Difference Time-Domain Method , 1995 .

[8]  Aglaia Foteinou,et al.  Perception of objective parameter variations in virtual acoustic spaces , 2013 .

[9]  Murray Hodgson,et al.  Improved algorithms and methods for room sound-field prediction by acoustical radiosity in arbitrary polyhedral rooms. , 2004, The Journal of the Acoustical Society of America.

[10]  Stefan Bilbao,et al.  Finite Volume Time Domain Room Acoustics Simulation under General Impedance Boundary Conditions , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[11]  A Lewis,et al.  THE SCIENCE OF SOUND , 1997 .

[12]  D. Blackstock Fundamentals of Physical Acoustics , 2000 .

[13]  Ming C. Lin,et al.  Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition , 2009, IEEE Transactions on Visualization and Computer Graphics.

[14]  George Kalliris,et al.  An Amphitheatric Hall Modal Analysis using the Finite Element Method Compared to in situ Measurements. , 2006 .

[15]  Pat Hanrahan,et al.  Beam tracing polygonal objects , 1984, SIGGRAPH.

[16]  D. Botteldooren Finite‐difference time‐domain simulation of low‐frequency room acoustic problems , 1995 .

[17]  Samuel Siltanen,et al.  Finite-difference time domain method source calibration for hybrid acoustics modeling , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Tapio Lokki,et al.  The perceptual effects of dispersion error on room acoustic model auralization , 2011 .

[19]  Jens Holger Rindel Computer Simulation Techniques for Acoustical Design of Rooms , 1997 .

[20]  Jonathan A. Hargreaves,et al.  Time domain boundary element method for room acoustics , 2007 .

[21]  E. Brigham,et al.  The fast Fourier transform and its applications , 1988 .

[22]  Graham F. Carey,et al.  Introduction to Finite Element Analysis: Theory and Application , 1973 .

[23]  I. A. Drumm The application of adaptive beam tracing and managed DirectX for the visualisation and auralisation of virtual environments , 2005, Ninth International Conference on Information Visualisation (IV'05).

[24]  Stefan Bilbao,et al.  Computing room acoustics with CUDA - 3D FDTD schemes with boundary losses and viscosity , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Rudolf Rabenstein Discrete Simulation Models For Multidimensional Systems Based On Functional Transformations , 1998 .

[26]  H. Kuttruff A simple iteration scheme for the computation of decay constants in enclosures with diffusely reflecting boundaries , 1995 .

[27]  David M. Howard,et al.  2-D DIGITAL WAVEGUIDE MESH TOPOLOGIES IN ROOM ACOUSTICS MODELLING , 2000 .

[28]  Graham Naylor,et al.  ODEON—Another hybrid room acoustical model , 1993 .

[29]  Jyri Huopaniemi,et al.  DIVA Virtual Audio Reality System , 1996 .

[30]  Rudolf Rabenstein,et al.  Solution of vector partial differential equations by transfer function models , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[31]  Brian Hamilton,et al.  Audibility of dispersion error in room acoustic finite-difference time-domain simulation as a function of simulation distance. , 2016, The Journal of the Acoustical Society of America.

[32]  Tapio Lokki,et al.  A distributed real-time virtual acoustic rendering system for dynamic geometries , 2007 .

[33]  Michael A. Gerzon,et al.  The Design of Precisely Coincident Microphone Arrays for Stereo and Surround Sound , 1975 .

[34]  Philip A. Nelson,et al.  Boundary element simulations of the transfer function of human heads and baffled pinnae using accurate geometric models , 2007 .

[35]  Rudolf Rabenstein,et al.  Efficient 3D Simulation of Wave Propagation with the Functional Transformation Method , 2005 .

[37]  Angelo Farina,et al.  Advancements in Impulse Response Measurements by Sine Sweeps , 2007 .

[38]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[39]  Damian Murphy,et al.  Room impulse response synthesis based on a 2D multi-plane FDTD hybrid acoustic model , 2013, 2013 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[40]  Marc-Laurent Aird Musical instrument modelling using digital waveguides , 2002 .

[41]  A. Kulowski Algorithmic representation of the ray tracing technique , 1985 .

[42]  Damian T. Murphy,et al.  Rendering walk-through auralisations using wave-based acoustical models , 2009, 2009 17th European Signal Processing Conference.

[43]  Rudolf Rabenstein,et al.  Wave Field Simulation with the Functional Transformation Method , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[44]  Banu Gunel,et al.  Simulation of Directional Microphones in Digital Waveguide Mesh-Based Models of Room Acoustics , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[45]  C. Harris Absorption of Sound in Air versus Humidity and Temperature , 1966 .

[46]  I. Bork Report on the 3rd round robin on room acoustical computer simulation - : Part I: Measurements , 2005 .

[47]  Mendel Kleiner,et al.  Auralization-An Overview , 1993 .

[48]  Kadi Bouatouch,et al.  Real Time Acoustic Rendering of Complex Environments Including Diffraction and Curved Surfaces , 2006 .

[49]  Bruno Fazenda,et al.  Physical and numerical constraints in source modeling for finite difference simulation of room acoustics. , 2014, The Journal of the Acoustical Society of America.

[50]  Y. W. Lam,et al.  A comparison of three diffuse reflection modeling methods used in room acoustics computer models , 1996 .

[51]  Kihong Shin An alternative approach to measure similarity between two deterministic transient signals , 2016 .

[52]  M. Schroeder New Method of Measuring Reverberation Time , 1965 .

[53]  Ming C. Lin,et al.  Efficient GPU-Based Solver for Acoustic Wave Equation , 2010 .

[54]  Lawrence E. Kinsler,et al.  Fundamentals of acoustics , 1950 .

[55]  B. Postma CALIBRATED AURALIZATION SIMULATION OF THE ABBEY OF SAINT-GERMAIN-DES-PRÉS FOR , 2015 .

[56]  Angelo Farina,et al.  Simultaneous Measurement of Impulse Response and Distortion with a Swept-Sine Technique , 2000 .

[57]  Samuel Siltanen,et al.  Spatial Room Impulse Responses with a Hybrid Modeling Method , 2011 .

[58]  Michael Vorländer,et al.  A REAL-TIME AURALIZATION PLUGIN FOR ARCHITECTURAL DESIGN AND EDUCATION , 2014 .

[59]  Thomas A. Funkhouser,et al.  A beam tracing approach to acoustic modeling for interactive virtual environments , 1998, SIGGRAPH.

[60]  Carl F. Eyring,et al.  Reverberation Time in “Dead” Rooms , 1930 .

[61]  Eva-Marie Nosal Room sound field prediction by acoustical radiosity , 2002 .

[62]  José Escolano,et al.  Compensation of the Afterglow Phenomenon in 2-D Discrete-Time Simulations , 2010, IEEE Signal Processing Letters.

[63]  Damian Murphy,et al.  Frequency-Dependent Absorbing Boundary Implementations in 3D Finite Difference Time Domain Room Acoustics Simulations , 2015 .

[64]  Michael J. Gerzon Periphony: With-Height Sound Reproduction , 1973 .

[65]  Jeremy J. Wells,et al.  Temporal Matching of 2-D and 3-D Wave-Based Acoustic Modeling for Efficient and Realistic Simulation of Rooms , 2009 .

[66]  Lauri Savioja,et al.  Overview of geometrical room acoustic modeling techniques. , 2015, The Journal of the Acoustical Society of America.

[67]  Bruno Fazenda,et al.  A simple multiband approach for solving frequency dependent problems in numerical time domain methods , 2011 .

[68]  M. Hodgson On the prediction of sound fields in large empty rooms , 1988 .

[69]  B F Katz,et al.  Boundary element method calculation of individual head-related transfer function. I. Rigid model calculation. , 2001, The Journal of the Acoustical Society of America.

[70]  Robert B. Newman,et al.  Collected Papers on Acoustics , 1927 .

[71]  G. Barton Elements of Green's Functions and Propagation: Potentials, Diffusion, and Waves , 1989 .

[72]  Damian Murphy,et al.  Explicit Higher-Order FDTD Schemes for 3D Room Acoustic Simulation , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[73]  Dirk Schröder,et al.  Real-time processing of image sources using binary space partitioning , 2006 .

[74]  Perry R. Cook,et al.  A Meta-Wind-Instrument Physical Model, and a Meta-Controller for Real-Time Performance Control , 1992, ICMC.

[75]  David M. Howard,et al.  Real-Time Dynamic Articulations in the 2-D Waveguide Mesh Vocal Tract Model , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[76]  Stefan Bilbao Numerical Sound Synthesis: Finite Difference Schemes and Simulation in Musical Acoustics , 2009 .

[77]  Damian Murphy,et al.  HYBRID ROOM IMPULSE RESPONSE SYNTHESIS IN DIGITAL WAVEGUIDE MESH BASED ROOM ACOUSTICS SIMULATION , 2008 .

[78]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .

[79]  Damian T. Murphy,et al.  Room Impulse Response Synthesis and Validation Using a Hybrid Acoustic Model , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[80]  Sorrel Harriet,et al.  Application of Auralisation and Soundscape Methodologies to Environmental Noise , 2013 .

[81]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[82]  H. Lehnert Systematic errors of the ray-tracing algorithm , 1993 .

[83]  L. Thompson A review of finite-element methods for time-harmonic acoustics , 2006 .

[84]  Lauri Savioja,et al.  Spectral and Pseudospectral Properties of Finite Difference Models Used in Audio and Room Acoustics , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[85]  Damian T. Murphy,et al.  ROOMWEAVER: A DIGITAL WAVEGUIDE MESH BASED ROOM ACOUSTICS RESEARCH TOOL , 2004 .

[86]  Vesa Välimäki,et al.  Simulation of Room Acoustics using 2-D Digital Waveguide Meshes , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[87]  Maarten van Walstijn,et al.  Formulation of a locally reacting wall in finite difference modelling of acoustic spaces , 2008 .

[88]  P. Morse Vibration and Sound , 1949, Nature.

[89]  J. Borish Extension of the image model to arbitrary polyhedra , 1984 .

[90]  Heinrich Kuttruff,et al.  Room acoustics , 1973 .

[91]  Randall J. Allemang,et al.  THE MODAL ASSURANCE CRITERION–TWENTY YEARS OF USE AND ABUSE , 2003 .

[92]  Julius O. Smith,et al.  Physical Modeling with the 2-D Digital Waveguide Mesh , 1993, ICMC.

[93]  Naga K. Govindaraju,et al.  Efficient Numerical Acoustic Simulation on Graphics Processors Using Adaptive Rectangular Decomposition , 2016 .

[94]  Craig J. Webb,et al.  Large-scale Virtual Acoustics Simulation at Audio Rates Using Three Dimensional Finite Difference Time Domain and Multiple GPUs , 2013 .

[95]  Davide Rocchesso,et al.  Generalized digital waveguide networks , 2003, IEEE Trans. Speech Audio Process..

[96]  Damian Murphy,et al.  Source excitation strategies for obtaining impulse responses in finite difference time domain room acoustics simulation , 2014 .

[97]  Drumm,et al.  The adaptive beam-tracing algorithm , 2000, The Journal of the Acoustical Society of America.

[98]  Unto K. Laine,et al.  A real-time DSP implementation of a flute model , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[99]  Alex Southern,et al.  A Second Order Differential Microphone Technique for Spatially Encoding Virtual Room Acoustics , 2008 .

[100]  Rudolf Rabenstein Transfer function models for continuous and discrete multidimensional systems , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[101]  Michael Vorländer,et al.  Integrating Real-Time Room Acoustics Simulation into a CAD Modeling Software to Enhance the Architectural Design Process , 2014 .

[102]  Dinesh Manocha,et al.  Use of GPUs in room acoustic modeling and auralization , 2010 .

[103]  Rudolf Rabenstein,et al.  Physical modeling of drums by transfer function methods , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[104]  A. Southern,et al.  Methods for 2nd Order Spherical Harmonic Spatial Encoding in Digital Waveguide Mesh Virtual Acoustic Simulations , 2007, 2007 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[105]  M. Kleiner,et al.  Computation of edge diffraction for more accurate room acoustics auralization. , 2001, The Journal of the Acoustical Society of America.

[106]  Julian R. Wright An Exact Model of Acoustic Radiation in Enclosed Spaces , 1995 .

[107]  Stefan Bilbao,et al.  Physical Modeling of Timpani Drums in 3D on GPGPUs , 2013 .

[108]  Damian Murphy,et al.  Hybrid Acoustic Modelling of Historic Spaces Using Blender , 2014 .

[109]  M. Hodgson Evidence of diffuse surface reflections in rooms , 1990 .

[110]  D. Murphy,et al.  Auralisation of Finite Difference Time Domain Simulations of Sonic Crystal Noise Barriers in an Urban Environment , 2015 .

[111]  George Kalliris,et al.  Analysis Tool Development for the Investigation of Low Frequency Room Acoustics by Means of Finite Element Method , 2010 .

[112]  Craig J. Webb,et al.  Modeling binaural receivers in finite difference simulation of room acoustics , 2013 .

[113]  David M. Howard,et al.  Acoustics and Psychoacoustics , 2006 .

[114]  Tapio Lokki,et al.  Virtual Environment Simulation - Advances in the DIVA project , 1997 .

[115]  Zihou Meng,et al.  The Just Noticeable Difference of Noise Length and Reverberation Perception , 2006, 2006 International Symposium on Communications and Information Technologies.

[116]  Damian Murphy,et al.  RenderAIR – Room Acoustics Simulation Using a Hybrid Digital Waveguide Mesh Approach , 2008 .

[117]  Mendel Kleiner,et al.  The Application of the Finite-Element Method to the Prediction of Soundfields of Small Rooms at Low Frequencies , 1997 .

[118]  Vesa Välimäki,et al.  An Improved Digital Waveguide Model of a Flute with Fractional Delay Filters , 1996 .

[119]  José Escolano,et al.  Removal of afterglow effects in 2-D discrete-time room acoustics simulations , 2013 .

[120]  D A Nethercot,et al.  The Finite element method;: A basic introduction , 1974 .

[121]  B. Katz,et al.  Framework for Real-Time Auralization in Architectural Acoustics , 2008 .

[122]  Maarten van Walstijn,et al.  Formulation of Locally Reacting Surfaces in FDTD/K-DWM Modelling of Acoustic Spaces , 2008 .

[123]  K. Yee Numerical solution of initial boundary value problems involving maxwell's equations in isotropic media , 1966 .

[124]  Thomas Funkhouser,et al.  A beam tracing method for interactive architectural acoustics. , 2004, The Journal of the Acoustical Society of America.

[125]  A. Farina RAMSETE-A NEW PYRAMID TRACER FOR MEDIUM AND LARGE SCALE ACOUSTIC PROBLEMS , 2000 .

[126]  T. Lokki,et al.  Geometry reduction in room acoustics modeling , 2008 .

[127]  L. Savioja,et al.  Extension of a spectral time-stepping domain decomposition method for dispersive and dissipative wave propagation. , 2015, The Journal of the Acoustical Society of America.

[128]  Damian T. Murphy,et al.  Spatial Encoding of Finite Difference Time Domain Acoustic Models for Auralization , 2012, IEEE Transactions on Audio, Speech, and Language Processing.