Mean-Square Performance of Adaptive Filter Algorithms in Nonstationary Environments

Employing a recently introduced unified adaptive filter theory, we show how the performance of a large number of important adaptive filter algorithms can be predicted within a general framework in nonstationary environment. This approach is based on energy conservation arguments and does not need to assume a Gaussian or white distribution for the regressors. This general performance analysis can be used to evaluate the mean square performance of the Least Mean Square (LMS) algorithm, its normalized version (NLMS), the family of Affine Projection Algorithms (APA), the Recursive Least Squares (RLS), the Data-Reusing LMS (DR-LMS), its normalized version (NDR-LMS), the Block Least Mean Squares (BLMS), the Block Normalized LMS (BNLMS), the Transform Domain Adaptive Filters (TDAF) and the Subband Adaptive Filters (SAF) in nonstationary environment. Also, we establish the general expressions for the steady-state excess mean square in this environment for all these adaptive algorithms. Finally, we demonstrate through simulations that these results are useful in predicting the adaptive filter performance. Keywords—Adaptive filter, general framework, energy conservation, mean-square performance, nonstationary environment.

[1]  Ali H. Sayed,et al.  Mean-square performance of data-reusing adaptive algorithms , 2005, IEEE Signal Processing Letters.

[2]  E. Eweda,et al.  Analysis and design of a signed regressor LMS algorithm for stationary and nonstationary adaptive filtering with correlated Gaussian data , 1990 .

[3]  V. U. Reddy,et al.  A new approach to subband adaptive filtering , 1999, IEEE Trans. Signal Process..

[4]  Ali Mahlooji Far,et al.  A unified approach to steady-state performance analysis of adaptive filters without using the independence assumptions , 2007, Signal Process..

[5]  Kong-Aik Lee,et al.  Improving convergence of the NLMS algorithm using constrained subband updates , 2004, IEEE Signal Processing Letters.

[6]  W. K. Jenkins,et al.  Acceleration of normalized adaptive filtering data-reusing methods using the Tchebyshev and conjugate gradient methods , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[7]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[8]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[9]  Pierre Duhamel,et al.  Adaptive filtering in subbands using a weighted criterion , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[10]  Ali H. Sayed,et al.  Time-domain feedback analysis of adaptive gradient algorithms via the small gain theorem , 1995, Optics & Photonics.

[11]  Odile Macchi,et al.  Tracking capability of the least mean square algorithm: Application to an asynchronous echo canceller , 1987, IEEE Trans. Acoust. Speech Signal Process..

[12]  John Håkon Husøy.  A streamlined approach to adaptive filters , 2006, 2006 14th European Signal Processing Conference.

[13]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[14]  Ali H. Sayed,et al.  A unified approach to the steady-state and tracking analyses of adaptive filters , 2001, IEEE Trans. Signal Process..

[15]  Ali H. Sayed,et al.  A time-domain feedback analysis of filtered-error adaptive gradient algorithms , 1996, IEEE Trans. Signal Process..

[16]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[17]  W. K. Jenkins,et al.  New data-reusing LMS algorithms for improved convergence , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[18]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[19]  José Antonio Apolinário,et al.  Convergence analysis of the binormalized data-reusing LMS algorithm , 2000, IEEE Trans. Signal Process..

[20]  John Hakon Husoy,et al.  Transient Analysis of Adaptive Filters Using a General Framework , 2004 .

[21]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[22]  T. Moon,et al.  Mathematical Methods and Algorithms for Signal Processing , 1999 .

[23]  A.A. Beex,et al.  Normalized LMS algorithm with orthogonal correction factors , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[24]  Jacob Benesty,et al.  Acoustic signal processing for telecommunication , 2000 .

[25]  Henrique S. Malvar,et al.  Signal processing with lapped transforms , 1992 .

[26]  Eweda Eweda.  Optimum step size of sign algorithm for nonstationary adaptive filtering , 1990, IEEE Trans. Acoust. Speech Signal Process..

[27]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[28]  A. Sayed,et al.  Steady-state and tracking analyses of the sign algorithm without the explicit use of the independence assumption , 2000, IEEE Signal Processing Letters.

[29]  J. H. Husøy,et al.  A common framework for transient analysis of adaptive filters , 2004, Proceedings of the 12th IEEE Mediterranean Electrotechnical Conference (IEEE Cat. No.04CH37521).