A model for spatial sound systems comprising sound field recording, spatial editing, and binaural reproduction

We present a mathematical model to combine and edit spatial sound information defined on the sphere. Such model aim to enable the development of binaural systems capable of recording far sounds in all directions. Recorded far sounds can subsequently be discriminated along directions, and independently brought closer to the listener. During binaural reproduction, sounds can be heard as if they were closer than their original distance. Illustrative examples based on spherical arrays are provided by means of simulations.

[1]  Larry S. Davis,et al.  High Order Spatial Audio Capture and Its Binaural Head-Tracked Playback Over Headphones with HRTF Cues , 2005 .

[2]  Shuichi Sakamoto,et al.  3D Sound-Space Sensing Method Based on Numerous Symmetrically Arranged Microphones , 2014, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[3]  Henrik Møller.  Fundamentals of binaural technology , 1991 .

[4]  Thushara D. Abhayapala,et al.  Personal Sound Zones: Delivering interface-free audio to multiple listeners , 2015, IEEE Signal Processing Magazine.

[5]  Shuichi Sakamoto,et al.  Spatial accuracy of binaural synthesis from rigid spherical microphone array recordings , 2017 .

[6]  W. Marsden.  I and J , 2012 .

[7]  César D. Salvador,et al.  EMBEDDING DISTANCE INFORMATION IN BINAURAL RENDERINGS OF FAR FIELD RECORDINGS , 2014 .

[8]  Yukio Iwaya,et al.  3D Spatial Sound Systems Compatible with Human's Active Listening to Realize Rich High-Level kansei Information , 2012 .

[9]  Ralph Schroeder,et al.  Collaboration in Immersive and Non-immersive Virtual Environments , 2015, Immersed in Media, Telepresence Theory, Measurement & Technology.

[10]  V. Ralph Algazi,et al.  Headphone-Based Spatial Sound , 2011, IEEE Signal Processing Magazine.

[11]  D. Healy,et al.  Computing Fourier Transforms and Convolutions on the 2-Sphere , 1994 .

[12]  César D. Salvador,et al.  Editing distance information in compact microphone array recordings for its binaural rendering (応用音響) , 2014 .

[13]  V. Ralph Algazi,et al.  Motion-Tracked Binaural Sound for Personal Music Players , 2005 .

[14]  Shuichi Sakamoto,et al.  Design theory for binaural synthesis: Combining microphone array recordings and head-related transfer function datasets , 2017 .

[15]  Noam R. Shabtai,et al.  Optimization of the directivity in binaural sound reproduction beamforming. , 2015, The Journal of the Acoustical Society of America.

[16]  Yoichi Ando,et al.  On the simulation of sound localization , 1980 .

[17]  Shuichi Sakamoto,et al.  Sound-space recording and binaural presentation system based on a 252-channel microphone array , 2015 .

[18]  Holography Book,et al.  Fourier Acoustics Sound Radiation And Nearfield Acoustical Holography , 2016 .

[19]  J. B. Fahnline,et al.  A method for computing acoustic fields based on the principle of wave superposition , 1989 .

[20]  Boaz Rafaely,et al.  Generalized Spherical Array Beamforming for Binaural Speech Reproduction , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[21]  Shuichi Sakamoto,et al.  Numerical Evaluation of Binaural Synthesis from Rigid Spherical Microphone Array Recordings , 2016 .

[22]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[23]  B. C. Carlson,et al.  On the expansion of a Coulomb potential in spherical harmonics , 1950, Mathematical Proceedings of the Cambridge Philosophical Society.