Optimally regularized adaptive filtering algorithms for room acoustic signal enhancement

In many room acoustic signal processing applications, a room impulse response identification is needed to eliminate undesired effects such as echo, feedback, or reverberation. This is typically done using an adaptive filter driven by a speech or audio input signal. However, such signals exhibit poor excitation properties, which cause standard adaptive filtering algorithms to be very sensitive to disturbing signals, especially in the underdetermined case. A popular remedy is regularization, which is usually implemented with a scaled identity regularization matrix. This type of regularization is governed by a single regularization parameter, the value of which is often chosen in an arbitrary way. We propose to regularize the adaptive filter using a non-identity regularization matrix, in which prior knowledge on the unknown room impulse response may be incorporated. When knowledge of the disturbing signal is also used to add prefiltering and weighting in the adaptation, a new family of regularized adaptive filtering algorithms is obtained, which is shown to be optimal in a mean square error sense. Existing regularized algorithms can then be obtained as special cases, assuming limited or no prior knowledge is available. When combined with a recently proposed method of extracting prior knowledge from the acoustic setup, our algorithms exhibit superior convergence behaviour compared to existing algorithms in different simulation scenarios, while the additional computational cost is small.

[1]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[2]  Young-Seok Choi,et al.  Robust Regularization for Normalized LMS Algorithms , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[4]  Marc Moonen,et al.  Towards optimal regularization by incorporating prior knowledge in an acoustic echo canceller , 2005 .

[5]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[6]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[7]  Gerhard Schmidt,et al.  Pseudo-optimal regularization for affine projection algorithms , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Richard J. Mammone Fast projection algorithms with application to voice echo cancellation , 1994 .

[9]  P. Hansen Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion , 1987 .

[10]  M. Bodson An adaptive algorithm with information-dependent data forgetting , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[11]  R. D. Poltmann Stochastic gradient algorithm for system identification using adaptive FIR-filters with too low number of coefficients , 1988 .

[12]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[13]  Steven L. Grant Dynamically Regularized Fast RLS with Application to Echo Cancellation , 1996 .

[14]  Eisuke Horita,et al.  A leaky RLS algorithm: its optimality and implementation , 2004, IEEE Transactions on Signal Processing.

[15]  Marc Moonen,et al.  Double-Talk-Robust Prediction Error Identification Algorithms for Acoustic Echo Cancellation , 2007, IEEE Transactions on Signal Processing.

[16]  Marc Moonen,et al.  Identification of undermodelled room impulse responses , 2005 .

[17]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[18]  S.J. Elliott,et al.  Active noise control , 1993, IEEE Signal Processing Magazine.

[19]  Per Christian Hansen,et al.  Truncated Singular Value Decomposition Solutions to Discrete Ill-Posed Problems with Ill-Determined Numerical Rank , 1990, SIAM J. Sci. Comput..

[20]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..

[21]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[22]  Daniel D. Lee,et al.  Bayesian regularization and nonnegative deconvolution for room impulse response estimation , 2006, IEEE Transactions on Signal Processing.

[23]  Steven L. Gay,et al.  The fast affine projection algorithm , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[24]  Tareq Y. Al-Naffouri,et al.  An adaptive filter robust to data uncertainties , 2000 .

[25]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[26]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[27]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[28]  Ali H. Sayed,et al.  A fast iterative solution for worst-case parameter estimation with bounded model uncertainties , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[29]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[30]  Anthony G. Constantinides,et al.  Underdetermined-order recursive least-squares adaptive filtering: the concept and algorithms , 1997, IEEE Trans. Signal Process..

[31]  Jacob Benesty,et al.  Advances in Network and Acoustic Echo Cancellation , 2001 .

[32]  Dennis R. Morgan,et al.  On a class of computationally efficient, rapidly converging, generalized NLMS algorithms , 1996, IEEE Signal Processing Letters.

[33]  Simon Haykin,et al.  Proportionate Adaptation: New Paradigms in Adaptive Filters , 2005 .

[34]  A. Houacine Regularized fast recursive least squares algorithms , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[35]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[36]  Robert J. Piechocki,et al.  A bootstrap multi-user detector for CDMA based on Tikhonov regularization , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[37]  Stefan Bilbao,et al.  Proceedings of the European Signal Processing Conference , 2005 .

[38]  E. Somersalo,et al.  Inverse problems with structural prior information , 1999 .

[39]  Tyseer Aboulnasr,et al.  Leaky LMS algorithm: MSE analysis for Gaussian data , 1997, IEEE Trans. Signal Process..

[40]  Hamid Sheikhzadeh,et al.  Complexity reduction and regularization of a fast affine projection algorithm for oversampled subband adaptive filters , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[41]  Marc Moonen,et al.  Double-talk robust acoustic echo cancellation with continuous near-end activity , 2005, 2005 13th European Signal Processing Conference.

[42]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[43]  Xian-Wei Yu,et al.  The minimum mean square error linear estimator and ridge regression , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[44]  Robert B. Newman,et al.  Collected Papers on Acoustics , 1927 .

[45]  Danilo P. Mandic,et al.  A generalized normalized gradient descent algorithm , 2004, IEEE Signal Processing Letters.

[46]  J. Varah A Practical Examination of Some Numerical Methods for Linear Discrete Ill-Posed Problems , 1979 .