On the LMS algorithm with constant and variable leakage factor in a nonlinear environment

This paper studies the application of the linear least-mean-square (LMS) algorithm with leakage to a system having a memoryless saturation-type nonlinearity. This approach represents an interesting alternative to the nonlinear LMS (NLLMS) algorithm. The major drawback to implement the latter is that the model parameters of the system nonlinearity must be known. In contrast, the linear LMS algorithm with leakage does not require such knowledge. It permits to approximate the performance of the NLLMS by properly selecting a constant leakage factor value. To cope with an eventual change of the environment, a strategy for a variable leakage is also proposed. Several numerical simulations are presented with the aim of ratifying the feasibility of the proposed approach

[1]  Scott C. Douglas,et al.  Performance comparison of two implementations of the leaky LMS adaptive filter , 1997, IEEE Trans. Signal Process..

[2]  C. Johnson,et al.  Theory and design of adaptive filters , 1987 .

[3]  Rui Seara,et al.  Performance comparison of the FXLMS, nonlinear FXLMS and leaky FXLMS algorithms in nonlinear active control applications , 2002, 2002 11th European Signal Processing Conference.

[4]  Laura R Ray,et al.  Experimental evaluation of leaky least-mean-square algorithms for active noise reduction in communication headsets. , 2002, The Journal of the Acoustical Society of America.

[5]  C. Richard Johnson,et al.  Parameter drift in LMS adaptive filters , 1986, IEEE Trans. Acoust. Speech Signal Process..

[6]  José Carlos M. Bermudez,et al.  Optimum leakage factor for the MOV-LMS algorithm in nonlinear modeling and control systems , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  José Carlos M. Bermudez,et al.  Stochastic analysis of the LMS algorithm with a saturation nonlinearity following the adaptive filter output , 2001, IEEE Trans. Signal Process..

[8]  P. Darlington,et al.  Performance surfaces of minimum effort estimators and controllers , 1995, IEEE Trans. Signal Process..

[9]  Rui Seara,et al.  Second moment analysis of the filtered-X LMS algorithm , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[10]  David A. Cartes,et al.  Lyapunov tuning of the leaky LMS algorithm for single-source, single-point noise cancellation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[11]  José Carlos M. Bermudez,et al.  A true stochastic gradient adaptive algorithm for applications using nonlinear actuators , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[12]  M. O. Tokhi,et al.  Active noise control systems , 1987 .

[13]  John M. Cioffi,et al.  Limited-precision effects in adaptive filtering , 1987 .

[14]  John J. Shynk,et al.  Statistical analysis of the single-layer backpropagation algorithm. I. mean weight behavior , 1993, IEEE Trans. Signal Process..

[15]  C H Hansen,et al.  A study of time-domain FXLMS algorithms with control output constraint. , 2001, The Journal of the Acoustical Society of America.

[16]  John J. Shynk,et al.  Statistical analysis of the single-layer backpropagation algorithm. II. MSE and classification performance , 1993, IEEE Trans. Signal Process..

[17]  P. Darlington,et al.  Equivalent transfer functions of minimum output variance mean-square estimators , 1991, IEEE Trans. Signal Process..

[18]  N. Bershad.  On weight update saturation nonlinearities in LMS adaptation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[19]  Stephen J. Elliott,et al.  Signal Processing for Active Control , 2000 .

[20]  D. Cartes,et al.  LYAPUNOV TUNING OF THE LEAKY LMS ALGORITHM FOR SINGLE-SOURCE, SINGLE-POINT NOISE CANCELLATION , 2003 .

[21]  Rui Seara,et al.  Leaky delayed LMS algorithm: stochastic analysis for Gaussian data and delay modeling error , 2004, IEEE Transactions on Signal Processing.

[22]  S. Elliott,et al.  Effort constraints in adaptive feedforward control , 1996, IEEE Signal Processing Letters.

[23]  José Carlos M. Bermudez,et al.  Mean weight behavior of the filtered-X LMS algorithm , 2000, IEEE Trans. Signal Process..