A variable step size LMS algorithm

A least-mean-square (LMS) adaptive filter with a variable step size is introduced. The step size increases or decreases as the mean-square error increases or decreases, allowing the adaptive filter to track changes in the system as well as produce a small steady state error. The convergence and steady-state behavior of the algorithm are analyzed. The results reduce to well-known results when specialized to the constant-step-size case. Simulation results are presented to support the analysis and to compare the performance of the algorithm with the usual LMS algorithm and another variable-step-size algorithm. They show that its performance compares favorably with these existing algorithms. >

[1]  Neil J. Bershad.  On the optimum gain parameter in LMS adaptation , 1987, IEEE Trans. Acoust. Speech Signal Process..

[2]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[3]  Odile Macchi,et al.  Tracking capability of the least mean square algorithm: Application to an asynchronous echo canceller , 1987, IEEE Trans. Acoust. Speech Signal Process..

[4]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[5]  Eweda Eweda,et al.  Tracking error bounds of adaptive nonstationary filtering , 1985, Autom..

[6]  M.M. Sondhi,et al.  Silencing echoes on the telephone network , 1980, Proceedings of the IEEE.

[7]  Richard W. Harris,et al.  A variable step (VS) adaptive filter algorithm , 1986, IEEE Trans. Acoust. Speech Signal Process..

[8]  Ehud Weinstein,et al.  Convergence analysis of LMS filters with uncorrelated Gaussian data , 1985, IEEE Trans. Acoust. Speech Signal Process..

[9]  Neil J. Bershad,et al.  On the probability density function of the LMS adaptive filter weights , 1989, IEEE Trans. Acoust. Speech Signal Process..

[10]  E. Eweda,et al.  Second-order convergence analysis of stochastic adaptive linear filtering , 1983 .

[11]  G. Goodwin,et al.  Stochastic adaptive control for exponentially convergent time-varying systems , 1986, The 23rd IEEE Conference on Decision and Control.

[12]  K. Senne,et al.  Performance advantage of complex LMS for controlling narrow-band adaptive arrays , 1981 .