Sound-space recording and binaural presentation system based on a 252-channel microphone array

Sensing of high-definition three-dimensional (3D) sound-space information is of crucial importance for realizing total 3D spatial sound technology. We have proposed a sensing method for 3D sound-space information using symmetrically and densely arranged microphones. This method is called SENZI (Symmetrical object with ENchased Zillion microphones). In the SENZI method, signals recorded by the microphones are simply weighted and summed to synthesize a listener’s headrelated transfer functions (HRTFs), reflecting the direction in which the listener is facing even after recording. The SENZI method is being developed as a real-time system using a spherical microphone array and field-programmable gate arrays (FPGAs). In the SENZI system, 252 electric condenser microphones (ECMs) were almost uniformly distributed on a rigid sphere. The deviations of the microphone frequency responses were compensated for using the transfer function of the rigid sphere. To avoid the degradation of the accuracy of the synthesized sound space by microphone internal noise, particularly in the low-frequency region, we analyzed the effect of the signal-to-noise ratio (SNR) of microphones on the accuracy of synthesized sound-space information by controlling condition numbers of matrix constructed from transfer functions. On the basis of the results of these analyses, a compact SENZI system was implemented. Results of experiments indicated that 3D sound-space information was well expressed using the system.

[1]  R. Duda,et al.  Range dependence of the response of a spherical head model , 1998 .

[2]  Yukio Iwaya,et al.  Dataset of head-related transfer functions measured with a circular loudspeaker array , 2014 .

[3]  Makoto Otani,et al.  Fast calculation system specialized for head-related transfer function based on boundary element method. , 2006, The Journal of the Acoustical Society of America.

[4]  Larry S. Davis,et al.  High Order Spatial Audio Capture and Its Binaural Head-Tracked Playback Over Headphones with HRTF Cues , 2005 .

[5]  Shuichi Sakamoto,et al.  3D Sound-Space Sensing Method Based on Numerous Symmetrically Arranged Microphones , 2014, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[6]  W R Thurlow,et al.  Effect of induced head movements on localization of direction of sounds. , 1967, The Journal of the Acoustical Society of America.

[7]  Robert Höldrich,et al.  A 3D Ambisonic Based Binaural Sound Reproduction System , 2003 .

[8]  V. Ralph Algazi,et al.  Customization for Personalized Rendering of Motion-Tracked Binaural Sound , 2004 .

[9]  Yôiti Suzuki,et al.  Sound localization in headphone reproduction by simulating transfer functions from the sound source to the external ear , 1991 .

[10]  O. Kirkeby,et al.  Reproduction of plane wave sound fields , 1993 .

[11]  Jerome Daniel,et al.  Spatial Sound Encoding Including Near Field Effect: Introducing Distance Coding Filters and a Viable, New Ambisonic Format , 2003 .

[12]  Willard R. Thurlow Erratum: Effect of Induced Head Movements on Localization of Direction of Sounds [J. Acoust. Soc. Am. 42, 480–488 (1967)] , 1967 .

[13]  Craig T. Jin,et al.  Design, Optimization and Evaluation of a Dual-Radius Spherical Microphone Array , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[14]  V. Ralph Algazi,et al.  Motion-Tracked Binaural Sound , 2004 .

[15]  Stephanie Bertet,et al.  3D Sound Field Recording with Higher Order Ambisonics – Objective Measurements and Validation of a 4th order Spherical Microphone , 2006 .

[16]  J. C. Middlebrooks Sound localization. , 2015, Handbook of clinical neurology.

[17]  Simon Doclo,et al.  Robustness of virtual artifcial head topologies with respect to microphone positioning , 2011 .

[18]  Ramani Duraiswami,et al.  Plane-Wave Decomposition of Acoustical Scenes Via Spherical and Cylindrical Microphone Arrays , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Michael J. Gerzon Periphony: With-Height Sound Reproduction , 1973 .

[20]  Steven van de Par,et al.  The Impact of the White Noise Gain (WNG) of a Virtual Artificial Head on the Appraisal of Binaural Sound Reproduction , 2014 .

[21]  Yukio Iwaya,et al.  Effects of head movement on front-back error in sound localization , 2003 .

[22]  Shuichi Sakamoto,et al.  SENZI and ASURA: New High-Precision Sound-Space Sensing Systems based on Symmetrically Arranged Numerous Microphones , 2008, 2008 Second International Symposium on Universal Communication.