Analysis of LMS-Newton adaptive filtering algorithms with variable convergence factor

An analysis of two LMS-Newton adaptive filtering algorithms with variable convergence factor is presented. The relations of these algorithms with the conventional recursive least-squares algorithm are first addressed. Their performance in stationary and nonstationary environments is then studied and closed-form formulas for the excess mean-square error (MSE) are derived. The paper deals, in addition, with the effects of roundoff errors for the case of fixed-point arithmetic. Specifically, closed-form formulas for the excess MSE caused by quantization are obtained. The paper concludes with experimental results that demonstrate the validity of the analysis presented. >

[1]  A. Antoniou,et al.  A QR-decomposition LMS-Newton adaptive filtering algorithm with variable convergence factor , 1993, Proceedings of IEEE Pacific Rim Conference on Communications Computers and Signal Processing.

[2]  Andreas Antoniou,et al.  Digital Filters: Analysis, Design and Applications , 1979 .

[3]  W. Kenneth Jenkins,et al.  A fast quasi-Newton adaptive filtering algorithm , 1992, IEEE Trans. Signal Process..

[4]  Joseph B. Evans.  A new variable step size method suitable for efficient VLSI implementation , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[5]  V. Umapathi Reddy,et al.  Fixed point error analysis of the normalized ladder algorithm , 1982, ICASSP.

[6]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[7]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[8]  Steve Rogers,et al.  Adaptive Filter Theory , 1996 .

[9]  V. J. Mathews,et al.  Stochastic gradient adaptive filters with gradient adaptive step sizes , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[10]  S. Karni,et al.  Comments, with reply, on "Adaptive algorithms with an automatic gain control feature" by T.J. Shan and T. Kailath , 1990 .

[11]  David D. Falconer,et al.  Tracking properties and steady-state performance of RLS adaptive filter algorithms , 1986, IEEE Trans. Acoust. Speech Signal Process..

[12]  S. Karni,et al.  A new convergence factor for adaptive filters , 1989 .

[13]  Bernard Widrow,et al.  On the statistical efficiency of the LMS algorithm with nonstationary inputs , 1984, IEEE Trans. Inf. Theory.

[14]  T. R. Fortescue,et al.  Implementation of self-tuning regulators with variable forgetting factors , 1981, Autom..

[15]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[16]  Gregory E. Bottomley,et al.  A novel approach for stabilizing recursive least squares filters , 1991, IEEE Trans. Signal Process..

[17]  Thomas Kailath,et al.  Adaptive algorithms with an automatic gain control feature , 1988 .

[18]  Luiz W. P. Biscainho,et al.  Optimal variable step size for the LMS/Newton algorithm with application to subband adaptive filtering , 1992, IEEE Trans. Signal Process..

[19]  Paulo S. R. Diniz,et al.  Optimal convergence factor for the LMS/Newton algorithm , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[20]  Subbarayan Pasupathy,et al.  Tracking improvements in fast RLS algorithms using a variable forgetting factor , 1988, IEEE Trans. Acoust. Speech Signal Process..

[21]  FATHY F. YASSA,et al.  Optimality in the choice of the convergence factor for gradient-based adaptive algorithms , 1987, IEEE Trans. Acoust. Speech Signal Process..

[22]  J. Mazo.  On the independence theory of equalizer convergence , 1979, The Bell System Technical Journal.

[23]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .