Distance in audio for VR: constraints and opportunities

Spatial audio is enjoying a surge in attention in both scene and object based paradigms, due to the trend for, and accessibility of, immersive experience. This has been enabled through convergence in computing enhancements, component size reduction, and associated price reductions. For the first time, applications such as virtual reality (VR) are technologies for the consumer. Audio for VR is captured to provide a counterpart to the video or animated image, and can be rendered to combine elements of physical and psychoacoustic modelling, as well as artistic design. Given that distance is an inherent property of spatial audio, that it can augment sound's efficacy in cueing user attention (a problem which practitioners are seeking to solve), and that conventional film sound practices have intentionally exploited its use, the absence of research on its implementation and effects in immersive environments is notable. This paper sets out the case for its importance, from a perspective of research and practice. It focuses on cinematic VR, whose challenges for spatialized audio are clear, and at times stretches beyond the restrictions specific to distance in audio for VR, into more general audio constraints.

[1]  Rui Penha.  Distance Encoding In Ambisonics Using Three Angular Coordinates , 2008 .

[2]  P Zahorik,et al.  Estimating Sound Source Distance with and without Vision , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[3]  Michael A. Gerzon,et al.  The Design of Distance Panpots , 1992 .

[4]  Gavin Kearney,et al.  Auditory Distance Perception with Static and Dynamic Binaural Rendering , 2015 .

[5]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[6]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[7]  Frank Melchior,et al.  Object-Based 3D Audio Production for Virtual Reality Using the Audio Definition Model , 2016 .

[8]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[9]  M. Gardner.  Proximity image effect in sound localization. , 1968, The Journal of the Acoustical Society of America.

[10]  Jerome Daniel,et al.  Spatial Sound Encoding Including Near Field Effect: Introducing Distance Coding Filters and a Viable, New Ambisonic Format , 2003 .

[11]  Michael N. Geuss,et al.  Fear influences perceived reaching to targets in audition, but not vision , 2013 .

[12]  Atsushi Marui,et al.  The Influence of Camera Focal Length in the Direct-To-Reverb Ratio Suitability and Its Effect in the Perception of Distance for a Motion Picture , 2011 .

[13]  A. Bronkhorst,et al.  Auditory distance perception in humans : A summary of past and present research , 2005 .

[14]  Pavel Zahorik,et al.  Assessing auditory distance perception using virtual acoustics. , 2002, The Journal of the Acoustical Society of America.

[15]  Jeffrey Riedmiller,et al.  Immersive and Personalized Audio: A Practical System for Enabling Interchange, Distribution, and Delivery of Next-Generation Audio Experiences , 2014 .

[16]  Ola Björling,et al.  Crafting Cinematic High End VR Audio for Etihad Airways , 2016 .

[17]  Catarina Mendonça,et al.  Modeling the Perception of Audiovisual Distance: Bayesian Causal Inference and Other Models , 2016, PloS one.

[18]  Fons ADRIAENSEN.  Near Field filters for Higher Order Ambisonics , 2007 .

[19]  P. Coleman.  An analysis of cues to auditory depth perception in free space. , 1963, Psychological bulletin.

[20]  D H Mershon,et al.  Visual capture in auditory distance perception: proximity image effect reconsidered. , 1980, The Journal of auditory research.

[21]  Austen Clark,et al.  Cross-modal cuing and selective attention , 2006 .

[22]  Nicolas Tsingos,et al.  Immersive and Personalized Audio: A Practical System for Enabling Interchange, Distribution, and Delivery of Next-Generation Audio Experiences , 2014 .

[23]  A. D. Little,et al.  Effects of Room Reflectance and Background Noise on Perceived Auditory Distance , 1989, Perception.

[24]  Angela McArthur,et al.  Disparity in Horizontal Correspondence of Sound and Source Positioning: The Impact on Spatial Presence for Cinematic VR , 2016 .

[25]  D. Ja,et al.  Scales for perceived egocentric distance in a large open field: comparison of three psychophysical methods. , 1985 .

[26]  Pavel Zahorik,et al.  Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory loss , 2015, Attention, perception & psychophysics.

[27]  P. Coleman.  Failure to Localize the Source Distance of an Unfamiliar Sound , 1962 .

[28]  C. Spence,et al.  Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism , 2000, Neuroreport.

[29]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.