Parametric time-frequency representation of spatial sound in virtual worlds

Directional audio coding (DirAC) is a parametric time-frequency domain method for processing spatial audio based on psychophysical assumptions and on energetic analysis of the sound field. Methods to use DirAC in spatial sound synthesis for virtual worlds are presented in this article. Formal listening tests are used to show that DirAC can be used to position and to control the spatial extent of virtual sound sources with good audio quality. It is also shown that DirAC can be used to generate reverberation for N-channel horizontal listening with only two monophonic reverberators without a prominent loss in quality when compared with quality obtained with N-channel reverberators.

[1]  George Drettakis,et al.  Perceptual audio rendering of complex virtual environments , 2004, SIGGRAPH 2004.

[2]  Karlheinz Blankenbach.  Spatial Effects , 2012, Handbook of Visual Display Technology.

[3]  Richard Kronland-Martinet,et al.  A 3-D Immersive Synthesizer for Environmental Sounds , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  Ian Burnett,et al.  DECORRELATION TECHNIQUES FOR THE RENDERING OF APPARENT SOUND SOURCE WIDTH IN 3D AUDIO DISPLAYS , 2004 .

[5]  ErkutCumhur,et al.  Parametric time-frequency representation of spatial sound in virtual worlds , 2012, TAP 2012.

[6]  Jürgen Herre,et al.  MPEG Surround – the ISO/MPEG Standard for Efficient and Compatible Multi-Channel Audio Coding , 2007 .

[7]  Tapio Lokki,et al.  Creating Interactive Virtual Acoustic Environments , 1999 .

[8]  George Drettakis,et al.  Perceptual audio rendering of complex virtual environments , 2004, ACM Trans. Graph..

[9]  Michael M. Goodwin,et al.  A Frequency-domain Framework for Spatial Audio Coding Based on Universal Spatial Cues , 2006 .

[10]  Cumhur Erkut,et al.  Efficient Spatial Sound Synthesis for Virtual Worlds , 2009 .

[11]  Dinesh Manocha,et al.  Interactive sound rendering , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[12]  B. Moore.  An Introduction to the Psychology of Hearing , 1977 .

[13]  Keith Barker,et al.  A New Approach to the Assessment of Stereophonic Sound System Performance , 1985 .

[14]  Michael Friis Sørensen,et al.  Head-Related Transfer Functions of Human Subjects , 1995 .

[15]  Tapio Lokki,et al.  Directional Audio Coding: Virtual Microphone-Based Synthesis and Subjective Evaluation , 2009 .

[16]  Bernhard E. Riecke,et al.  Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality , 2009, TAP.

[17]  Ville Pulkki,et al.  Directional perception of distributed sound sources. , 2011, The Journal of the Acoustical Society of America.

[18]  Methods for the subjective assessment of small impairments in audio systems , 2015 .

[19]  Roger K. Furness,et al.  Ambisonics-An Overview , 1990 .

[20]  Mikko-Ville Laitinen,et al.  Binaural reproduction for Directional Audio Coding , 2009, 2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[21]  Giovanni Del Galdo,et al.  Efficient Methods for High Quality Merging of Spatial Audio Streams in Directional Audio Coding , 2009 .

[22]  Alan D. Blumlein,et al.  British Patent Specification 394,325 (Improvements in and relating to Sound-transmission, Sound-recording and Sound-reproducing Systems) , 1958 .

[23]  Mikko-Ville Laitinen,et al.  Converting 5.1 audio recordings to B-format for directional audio coding reproduction , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Jean-Pierre Gagné,et al.  The effects of blurred vision on auditory-visual speech perception in younger and older adults , 2010, International journal of audiology.

[25]  Michael Vorländer,et al.  Virtual Reality System with Integrated Sound Field Simulation and Reproduction , 2007, EURASIP J. Adv. Signal Process..

[26]  Ville Pulkki,et al.  Perceptual Compression Methods for Metadata in Directional Audio Coding Applied to Audiovisual Teleconference , 2009 .

[27]  Bernhard U. Seeber,et al.  A system to simulate and reproduce audio–visual environments for spatial hearing research , 2010, Hearing Research.

[28]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[29]  J. Kirszenstein,et al.  An image source computer model for room acoustics analysis and electroacoustic simulation , 1984 .

[30]  Thomas Gold,et al.  Hearing , 1953, Trans. IRE Prof. Group Inf. Theory.

[31]  Mark R. Anderson,et al.  Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source. , 2001, Journal of the Audio Engineering Society. Audio Engineering Society.

[32]  Jean-Marc Jot,et al.  Binaural Simulation of Complex Acoustic Scenes for Interactive Audio , 2006 .

[33]  Toni Hirvonen,et al.  Perceptual and modeling studies on spatial sound , 2007 .

[34]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[35]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[36]  Ville Pulkki,et al.  Spatial sound generation and perception by amplitude panning techniques , 2001 .

[37]  Ville Pulkki,et al.  Spatial Sound Reproduction with Directional Audio Coding , 2007 .

[38]  Christof Faller,et al.  Binaural cue coding-Part I: psychoacoustic fundamentals and design principles , 2003, IEEE Trans. Speech Audio Process..

[39]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .