Analysis and implementation of variable step size adaptive algorithms

Stochastic gradient adaptive filtering algorithms using variable step sizes are investigated. The variable-step-size algorithm improves the convergence rate while sacrificing little in steady-state error. Expressions describing the convergence of the mean and mean-squared values of the coefficients are developed and used to calculate the mean-square-error evolution. The initial convergence rate and the steady-state error are also investigated. The performance of the algorithm is studied when a power-of-two quantizer algorithm is used, and finite-word-length effects are considered. The analytical results are verified with simulations encompassing variable applications. Two CMOS implementations of the variable-step-size, power-of-two quantizer algorithm are presented to demonstrate that the performance gains are attainable with only a modest increase in circuit complexity. >

[1]  V. J. Mathews,et al.  Improved convergence analysis of stochastic gradient adaptive filters using the sign algorithm , 1987, IEEE Trans. Acoust. Speech Signal Process..

[2]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[3]  Robert Price,et al.  A useful theorem for nonlinear devices having Gaussian inputs , 1958, IRE Trans. Inf. Theory.

[4]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[5]  S. T. Alexander,et al.  Adaptive Signal Processing: Theory and Applications , 1986 .

[6]  Maurice G. Bellanger,et al.  Digital processing of signals: Theory and practice , 1984 .

[7]  H. R. Rudin,et al.  An automatic equalizer for general-purpose communication channels , 1967 .

[8]  C. Caraiscos,et al.  A roundoff error analysis of the LMS adaptive algorithm , 1984 .

[9]  D. Duttweiler.  Adaptive filter performance with nonlinearities in the correlation multiplier , 1982 .

[10]  Bede Liu,et al.  Adaptive equalizer using finite-bit power-of-two quantizer , 1984, IEEE Trans. Acoust. Speech Signal Process..

[11]  Maurice Bellanger,et al.  Adaptive digital filters and signal analysis , 1987 .

[12]  J. Mazo.  On the independence theory of equalizer convergence , 1979, The Bell System Technical Journal.

[13]  Richard W. Harris,et al.  A variable step (VS) adaptive filter algorithm , 1986, IEEE Trans. Acoust. Speech Signal Process..

[14]  David G. Messerschmitt,et al.  Adaptive Filters: Structures, Algorithms and Applications , 1984 .

[15]  E. Satorius,et al.  Application of Least Squares Lattice Algorithms to Adaptive Equalization , 1981, IEEE Trans. Commun..

[16]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[17]  B. Liu,et al.  A CMOS implementation of a variable step size digital adaptive filter , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[18]  V. John Mathews,et al.  Performance analysis of adaptive filters equipped with the dual sign algorithm , 1991, IEEE Trans. Signal Process..

[19]  G. Ungerboeck.  Theory on the speed of convergence in adaptive equalizers for digital communication , 1972 .

[20]  J. Gillis,et al.  Integrals of Bessel Functions , 1963 .

[21]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[22]  John G. Proakis,et al.  Digital Communications , 1983 .

[23]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[24]  Samuel D. Stearns,et al.  Signal processing algorithms , 1988 .