Enhancing stereophonic teleconferencing with microphone arrays through sound field warping

It has been proven that spatial audio enhances the realism of sound for teleconferencing. Previously, solutions have been proposed for multiparty conferencing where each remote participant is assumed to have his/her own microphone, and for conferencing between two rooms where the microphones in one room are connected to the equal number of loudspeakers in the other room. Either approach has its limitations. Hence, we propose a new scheme to improve stereophonic conferencing experience through an innovative use of microphone arrays. Instead of operating in the default mode where a single channel is produced using spatial filtering, we propose to transmit all channels forming a collection of spatial samples of the sound field. Those samples are warped appropriately at the remote site, and are spatialized together with audio streams from other remote sites if any, to produce the perception of a virtual sound field. Real-world audio samples are provided to showcase the proposed technique. The informal listening test shows that majority of the users prefer the new experience.

[1]  Michael A. Gerzon,et al.  Ambisonics in Multichannel Broadcasting and Video , 1985 .

[2]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[3]  Jessica J. Baldis Effects of spatial audio on memory, comprehension, and preference during desktop conferences , 2001, CHI.

[4]  Zhengyou Zhang,et al.  Maximum Likelihood Sound Source Localization and Beamforming for Directional Microphone Arrays in Distributed Meetings , 2008, IEEE Transactions on Multimedia.

[5]  E. Hänsler,et al.  Acoustic Echo and Noise Control: A Practical Approach , 2004 .

[6]  Jacob Benesty,et al.  A better understanding and an improved solution to the specific problems of stereophonic acoustic echo cancellation , 1998, IEEE Trans. Speech Audio Process..

[7]  James David Johnston,et al.  Perceptual Soundfield Reconstruction , 2000 .

[8]  Jacob Benesty,et al.  A better understanding and an improved solution to the problems of stereophonic acoustic echo cancellation , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Zhengyou Zhang,et al.  Highly realistic audio spatialization for multiparty conferencing using headphones , 2009, 2009 IEEE International Workshop on Multimedia Signal Processing.

[10]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[11]  Zhengyou Zhang,et al.  Multichannel Acoustic Echo Cancellation in Multiparty Spatial Audio Conferencing with Constrained Kalman Filtering , 2008 .

[12]  Jacob Benesty,et al.  Audio Signal Processing for Next-Generation Multimedia Communication Systems , 2004 .

[13]  Bobby Owsinski The Recording Engineer's Handbook , 2004 .