Computationally Efficient Spatial Rendering of Late Reverberation in Virtual Acoustic Environments

For 6-DOF (degrees of freedom) interactive virtual acoustic environments (VAEs), the spatial rendering of diffuse late reverberation in addition to early (specular) reflections is important. In the interest of computational efficiency, the acoustic simulation of the late reverberation can be simplified by using a limited number of spatially distributed virtual reverb sources (VRS) each radiating incoherent signals. A sufficient number of VRS is required to approximate spatially anisotropic late reverberation, e.g., in a room with inhomogeneous distribution of absorption at the boundaries. Here, a highly efficient and perceptually plausible method to generate and spatially render late reverberation is suggested, extending the room acoustics simulator RAZR [Wendt et al., J. Audio Eng. Soc., 62, 11 (2014)]. The room dimensions and frequency-dependent absorption coefficients at the wall boundaries are used to determine the parameters of a physically-based feedback delay network (FDN) to generate the incoherent VRS signals. The VRS are spatially distributed around the listener with weighting factors representing the spatially subsampled distribution of absorption coefficients on the wall boundaries. The minimum number of VRS required to be perceptually distinguishable from the maximum (reference) number of 96 VRS was assessed in a listening test conducted with a spherical loudspeaker array within an anechoic room. For the resulting low numbers of VRS suited for spatial rendering, physically-based parameter choices for the FDN are discussed.

[1]  J. Zwislocki,et al.  Just Noticeable Differences in Dichotic Phase , 1956 .

[2]  W. Hartmann,et al.  Human interaural time difference thresholds for sine tones: the high-frequency limit. , 2013, The Journal of the Acoustical Society of America.

[3]  Mikko-Ville Laitinen,et al.  Gain Normalization in Amplitude Panning as a Function of Frequency and Room Reverberance , 2014 .

[4]  C. Faller,et al.  Source localization in complex listening situations: selection of binaural cues based on interaural coherence. , 2004, The Journal of the Acoustical Society of America.

[5]  Tapio Lokki,et al.  The room acoustic rendering equation. , 2007, The Journal of the Acoustical Society of America.

[6]  Steven van de Par,et al.  The FABIAN head-related transfer function data base , 2017 .

[7]  Emanuel A. P. Habets,et al.  Feedback Delay Networks: Echo Density and Mixing Time , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[8]  Jean-Marc Jot,et al.  Digital Delay Networks for Designing Artificial Reverberators , 1991 .

[9]  Catherine Guastavino,et al.  Perceptual thresholds for realistic double-slope decay reverberation in large coupled spaces. , 2015, The Journal of the Acoustical Society of America.

[10]  Nikunj Raghuvanshi,et al.  Parametric directional coding for precomputed sound propagation , 2018, ACM Trans. Graph..

[11]  Steven van de Par,et al.  A Computationally-Efficient and Perceptually-Plausible Algorithm for Binaural Room Impulse Response Simulation , 2014 .

[12]  Sebastian J. Schlecht,et al.  Scattering in Feedback Delay Networks , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[13]  Michael Vorländer,et al.  An Extended Binaural Real-Time Auralization System With an Interface to Research Hearing Aids for Experiments on Subjects With Hearing Loss , 2018, Trends in hearing.

[14]  Lutz Wiegrebe,et al.  The percept of reverberation is not affected by visual room impression in virtual environments. , 2019, The Journal of the Acoustical Society of America.

[15]  J. Borish Extension of the image model to arbitrary polyhedra , 1984 .

[16]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[17]  Davide Rocchesso,et al.  Circulant and elliptic feedback delay networks for artificial reverberation , 1997, IEEE Trans. Speech Audio Process..

[18]  J. Buchholz,et al.  Development of the Everyday Conversational Sentences in Noise test. , 2020, The Journal of the Acoustical Society of America.

[19]  J. H. Rindel,et al.  The Use of Computer Modeling in Room Acoustics , 2000 .

[20]  Brian C. J. Moore,et al.  Disparity between clinical assessment and real-world performance of hearing aids , 2007 .

[21]  Michael Vorländer,et al.  A round robin on room acoustical simulation and auralization. , 2019, The Journal of the Acoustical Society of America.

[22]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .

[23]  Sebastian J. Schlecht,et al.  Time-varying feedback matrices in feedback delay networks and their application in artificial reverberation. , 2015, The Journal of the Acoustical Society of America.

[24]  Bernhard U. Seeber,et al.  A system to simulate and reproduce audio–visual environments for spatial hearing research , 2010, Hearing Research.

[25]  M. Vorländer Simulation of the transient and steady‐state sound propagation in rooms using a new combined ray‐tracing/image‐source algorithm , 1989 .

[26]  H. Wadell,et al.  Volume, Shape, and Roundness of Quartz Particles , 1935, The Journal of Geology.

[27]  Philippe Depalle,et al.  Perceptual thresholds for non-ideal diffuse field reverberation. , 2016, The Journal of the Acoustical Society of America.

[28]  P. B. Fellgett,et al.  Ambisonic reproduction of directionality in surround-sound systems , 1974, Nature.

[29]  Koichiro Hiyama,et al.  The Minimum Number of Loudspeakers and its Arrangement for Reproducing the Spatial Impression of Diffuse Sound Field , 2002 .

[30]  Tapio Lokki,et al.  Direction of Late Reverberation and Envelopment in Two Reproduced Berlin Concert Halls , 2016 .

[31]  Vesa Välimäki,et al.  Assessing the anisotropic features of spatial impulse responses , 2019 .

[32]  R. G. Klumpp,et al.  Some Measurements of Interaural Time Difference Thresholds , 1956 .

[33]  Christof Faller,et al.  Assessing Diffuse Sound Field Reproduction Capabilities of Multichannel Playback Systems , 2011 .

[34]  Dirk Schröder,et al.  Physically based real-time auralization of interactive virtual environments , 2011 .

[35]  Murray Hodgson,et al.  Experimental evaluation of radiosity for room sound-field prediction. , 2006, The Journal of the Acoustical Society of America.

[36]  Gaël Richard,et al.  Late Reverberation Synthesis: From Radiance Transfer to Feedback Delay Networks , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[37]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[38]  F. Jacobsen,et al.  The coherence of reverberant sound fields. , 2000, The Journal of the Acoustical Society of America.

[39]  Giso Grimm,et al.  A toolbox for rendering virtual acoustic environments in the context of audiology , 2018, Acta Acustica united with Acustica.

[40]  J. Jerger,et al.  Ecologically Valid MEasurEs of HEaring aid PErforMancE , 2009 .