Variable Explicit Regularization in Affine Projection Algorithm: Robustness Issues and Optimal Choice

A variable regularized affine projection algorithm (VR-APA) is introduced, without requiring the classical step size. Its use is supported from different points of view. First, it has the property of being Hinfin optimal and it satisfies certain error energy bounds. Second, the time-varying regularization parameter is obtained by maximizing the speed of convergence of the algorithm. Although we first derive the VR-APA for a linear time invariant (LTI) system, we show that the same expression holds if we consider a time-varying system following a first-order Markov model. We also find expressions for the power of the steady-state error vector for the VR-APA and the standard APA with no regularization parameter. Particularly, we obtain quite different results with and without using the independence assumption between the a priori error vector and the measurement noise vector. Simulation results are presented to test the performance of the proposed algorithm and to compare it with other schemes under different situations. An important conclusion is that the former independence assumption can lead to very inaccurate steady-state results, especially when high values of the projection order are used

[1]  Jacob Benesty,et al.  A New Robust Variable Step-Size NLMS Algorithm , 2008, IEEE Transactions on Signal Processing.

[2]  Steven L. Gay,et al.  The fast affine projection algorithm , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[3]  Jacob Benesty,et al.  Optimum Variable Explicit Regularized Affine Projection Algorithm , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[4]  Ali H. Sayed,et al.  Variable step-size NLMS and affine projection algorithms , 2004, IEEE Signal Processing Letters.

[5]  A. A. Beex,et al.  Tracking analysis results for NLMS and APA , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Teresa H. Y. Meng,et al.  Normalized data nonlinearities for LMS adaptation , 1994, IEEE Trans. Signal Process..

[7]  Kwok Hung Li,et al.  Delay Coefficients Based Variable Regularization Subband Affine Projection Algorithms in Acoustic Echo Cancellation Applications , 2009, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[8]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[9]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[10]  Tyseer Aboulnasr,et al.  A fast weighted subband adaptive algorithm , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[11]  Gerhard Schmidt,et al.  Pseudo-optimal regularization for affine projection algorithms , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Odile Macchi,et al.  Tracking capability of the least mean square algorithm: Application to an asynchronous echo canceller , 1987, IEEE Trans. Acoust. Speech Signal Process..

[13]  Henning Puder,et al.  Step-size control for acoustic echo cancellation filters - an overview , 2000, Signal Process..

[14]  Ali H. Sayed,et al.  A time-domain feedback analysis of filtered-error adaptive gradient algorithms , 1996, IEEE Trans. Signal Process..

[15]  T. Kailath,et al.  Linear estimation in Krein spaces. I. Theory , 1996, IEEE Trans. Autom. Control..

[16]  Jacob Benesty,et al.  A new class of doubletalk detectors based on cross-correlation , 2000, IEEE Trans. Speech Audio Process..

[17]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[18]  Laurent El Ghaoui,et al.  Robust Solutions to Least-Squares Problems with Uncertain Data , 1997, SIAM J. Matrix Anal. Appl..

[19]  Ali H. Sayed,et al.  H∞ optimality of the LMS algorithm , 1996, IEEE Trans. Signal Process..

[20]  Steven L. Grant,et al.  Novel variable step size nlms algorithms for echo cancellation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Leonardo Rey Vega,et al.  Analysis of explicit regularization in affine projection algorithms: Robustness and optimal choice , 2004, 2004 12th European Signal Processing Conference.

[22]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[23]  Isao Yamada,et al.  An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques , 2002, IEEE Trans. Signal Process..

[24]  A. A. Beex,et al.  Convergence behavior of affine projection algorithms , 2000, IEEE Trans. Signal Process..