Acoustic Echo Cancellation for Multiple Reproduction Channels: From First Principles to Real-Time Solutions

Multichannel acoustic echo cancellation (MCAEC) is a key technology whenever hands-free and full-duplex communication in modern systems with multichannel sound reproduction is desired. Although the basic principle of echo cancellation has been well known for several decades, the multichannel case poses some additional and fundamentally different challenges. Moreover, there are even some notable differences between the two-channel case and the general multichannel case which has been addressed bit by bit only in recent years. The aim of this paper is twofold. On the one hand, after a brief review of the problem of multichannel acoustic echo cancellation, this paper gives an outline of how the problem may be tackled based on some fundamental principles. In this sense, the presentation in this paper brings together for the first time ideas from system theory, information theory, psychoacoustics, and also wave physics. Based on this framework, and as the other main contribution, we present in this paper some recent advances in the field of MCAEC. Thereby, important issues in the case of more than two channels are emphasized. Finally, as an outlook, we touch on our ongoing work towards MCAEC for massive multichannel sound reproduction, such as wave field synthesis.

[1]  Tomas Gänsler,et al.  Influence of audio coding on stereophonic acoustic echo cancellation , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[2]  William A. Yost,et al.  Spatial hearing: The psychophysics of human sound localization, revised edition , 1998 .

[3]  Jacob Benesty,et al.  Stereophonic acoustic echo cancellation and two‐channel adaptive filtering: an overview , 2000 .

[4]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[5]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[6]  Jacob Benesty,et al.  A better understanding and an improved solution to the specific problems of stereophonic acoustic echo cancellation , 1998, IEEE Trans. Speech Audio Process..

[7]  Walter Kellermann,et al.  Blind Source Separation for Convolutive Mixtures: A Unified Treatment , 2004 .

[8]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[9]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[10]  Walter Kellermann,et al.  The TRINICON framework for adaptive MIMO signal processing with focus on the generic Sylvester constraint , 2011 .

[11]  Shoji Makino,et al.  Stereo projection echo canceller with true echo path estimation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[12]  Murtaza Ali,et al.  Stereophonic acoustic echo cancellation system using time-varying all-pass filtering for signal decorrelation , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[13]  J. Benesty,et al.  Double-talk robust fast converging algorithms for network echo cancellation , 1999, Proceedings of the 1999 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. WASPAA'99 (Cat. No.99TH8452).

[14]  Walter Kellermann,et al.  TRINICON-based Blind System Identification with Application to Multiple-Source Localization and Separation , 2007, Blind Speech Separation.

[15]  Christof Faller,et al.  Binaural cue coding-Part II: Schemes and applications , 2003, IEEE Trans. Speech Audio Process..

[16]  Sascha Spors,et al.  Active listening room compensation for massive multichannel sound reproduction systems using wave-domain adaptive filtering. , 2007, The Journal of the Acoustical Society of America.

[17]  Jacob Benesty,et al.  Audio Signal Processing for Next-Generation Multimedia Communication Systems , 2004 .

[18]  Walter Kellermann,et al.  BLIND SOURCE SEPARATION FOR CONVOLUTIVE MIXTURES EXPLOITI NG NONGAUSSIANITY, NONWHITENESS, AND NONSTATIONARITY , 2003 .

[19]  Walter Kellermann,et al.  Acoustic Echo Cancellation for Surround Sound using Perceptually Motivated Convergence Enhancement , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[20]  W. Kellermann,et al.  A Fundamental Relation Between Blind and Supervised Adaptive Filtering Illustrated for Blind Source Separation and Acoustic Echo Cancellation , 2008, 2008 Hands-Free Speech Communication and Microphone Arrays.

[21]  Yann Joncour,et al.  A stereo echo canceler with correct echo-path identification based on an input-sliding technique , 1997, IEEE Trans. Signal Process..

[22]  Henrique S. Malvar.  A modulated complex lapped transform and its applications to audio processing , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[23]  Jacob Benesty,et al.  Investigation of several types of nonlinearities for use in stereo acoustic echo cancellation , 2001, IEEE Trans. Speech Audio Process..

[24]  Walter Kellermann,et al.  RELATION BETWEEN BLIND SYSTEM IDENTIFICATION AND CONVOLUTIVE BLIND SOURCE SEPARATION , 2005 .

[25]  Walter Kellermann,et al.  A FUNDAMENTAL RELATIONBETWEEN BLINDAND SUPERVISEDADAPTIVE FILTERINGILLUSTRATEDFORBLINDSOURCESEPARATIONAND ACOUSTICECHO CANCELLATION , 2008 .

[26]  Jacob Benesty,et al.  Robust extended multidelay filter and double-talk detector for acoustic echo cancellation , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[27]  Walter Kellermann,et al.  TRINICON: a versatile framework for multichannel blind signal processing , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  Jacob Benesty,et al.  Generalized multichannel frequency-domain adaptive filtering: efficient realization and application to hands-free speech communication , 2005, Signal Process..

[29]  Walter Kellermann,et al.  Wave-domain adaptive filtering for acoustic human-machine interfaces based onwavefield analysis and synthesis , 2004, 2004 12th European Signal Processing Conference.

[30]  Jonathon A. Chambers,et al.  LOW COMPLEXITY -NLMS ALGORITHMS AND SUBBAND STRUCTURES FOR STEREOPHONIC ACOUSTIC ECHO CANCELLATION , 1999 .

[31]  J. L. Hall,et al.  Stereophonic acoustic echo cancellation-an overview of the fundamental problem , 1995, IEEE Signal Processing Letters.