Tracking properties of adaptive signal processing algorithms

Adaptive signal processing algorithms are often used in order to "track" an unknown time-varying parameter vector. This work develops an upper bound on the mean of the norm-squared error between the unknown parameter vector being tracked and the value obtained by the algorithm. The results require very mild covariance decay rate conditions on the training data and a bounded algorithm. The upper bound illustrates the relationship between the algorithm step size and the maximum rate of variation in the parameter vector being tracked.

[1]  J. Glover.  Adaptive noise canceling applied to sinusoidal interferences , 1977 .

[2]  A. Gersho.  Adaptive equalization of highly dispersive channels for data transmission , 1969 .

[3]  Khalid Sayood,et al.  On the "Desired behavior" of adaptive signal processing algorithms , 1979, ICASSP.

[4]  R. Bitmead,et al.  Exponentially convergent behaviour of simple stochastic adaptive estimation algorithms , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[5]  B. Anderson,et al.  Performance of adaptive estimation algorithms in dependent random environments , 1980 .

[6]  Alan Weiss,et al.  Digital adaptive filters: Conditions for convergence, rates of convergence, effects of noise and errors arising from the implementation , 1979, IEEE Trans. Inf. Theory.

[7]  L. Griffiths.  Rapid measurement of digital instantaneous frequency , 1975 .

[8]  B. Widrow,et al.  Adaptive antenna systems , 1967 .

[9]  David C. Farden.  Stochastic approximation with correlated data , 1981, IEEE Trans. Inf. Theory.

[10]  THOMAS P. DANIELL.  Adaptive Estimation with Mutually Correlated Training Sequences , 1970, IEEE Trans. Syst. Sci. Cybern..

[11]  L. J. Griffiths,et al.  A simple adaptive algorithm for real-time processing in antenna arrays , 1969 .

[12]  D. Farden,et al.  Tracking properties of adaptive signal processing algorithms , 1980, ICASSP.

[13]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[14]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[15]  Jae-Kyoon Kim,et al.  Adaptive linear estimation for stationary M-dependent processes , 1975, IEEE Trans. Inf. Theory.

[16]  Lennart Ljung,et al.  Analysis of recursive stochastic algorithms , 1977 .

[17]  J. Mazo.  On the independence theory of equalizer convergence , 1979, The Bell System Technical Journal.

[18]  B. Anderson,et al.  Lyapunov techniques for the exponential stability of linear difference equations with random coefficients , 1980 .