Adaptive filtering with averaging

Adaptive filtering algorithms are considered in this work. The main effort is devoted to improve the performance of such algorithms. Two classes of algorithms are given. The first one uses averaging in the approximation sequence obtained via slowly varying gains, and the second one utilizes averages in both the approximation sequence and the observed signals. Asymptotic properties-convergence and rate of convergence are developed. Analysis to one of the algorithms is presented. It is shown that the averaging approach gives rise to asymptotically optimal performance and results in asymptotically efficient procedures.

[1]  Boris Polyak,et al.  Acceleration of stochastic approximation by averaging , 1992 .

[2]  H. Kushner,et al.  Stochastic approximation with averaging of the iterates: Optimal asymptotic rate of convergence for , 1993 .

[3]  G. Yin.  On extensions of Polyak's averaging approach to stochastic approximation , 1991 .

[4]  W. Grassman.  Approximation and Weak Convergence Methods for Random Processes with Applications to Stochastic Systems Theory (Harold J. Kushner) , 1986 .

[5]  H. Kushner,et al.  Stochastic approximation with averaging and feedback: rapidly convergent "on-line" algorithms , 1995, IEEE Trans. Autom. Control..

[6]  F. Downton.  Stochastic Approximation , 1969, Nature.

[7]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[8]  A. Gersho.  Adaptive equalization of highly dispersive channels for data transmission , 1969 .

[9]  H. Kushner,et al.  Asymptotic properties of distributed and communication stochastic approximation algorithms , 1987 .

[10]  G. Yin,et al.  Asymptotically optimal rate of convergence of smoothed stochastic recursive algorithms , 1994 .

[11]  Harold J. Kushner,et al.  Weak Convergence and Properties of Adaptive Asymptotic F ilters w ith 177 Constant Gains , 1998 .

[12]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[13]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[14]  Kumpati S. Narendra,et al.  Adaptation and learning in automatic systems , 1974 .

[15]  G. Yin,et al.  Asymptotic optimal rate of convergence for an adaptive estimation procedure , 1992 .

[16]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[17]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[18]  M. T. Wasan.  Stochastic Approximation , 1969 .

[19]  D. Sworder,et al.  Introduction to stochastic control , 1972 .

[20]  E. Eweda,et al.  Quadratic mean and almost-sure convergence of unbounded stochastic approximation algorithms with correlated observations , 1983 .

[21]  H. Kushner.  Introduction to stochastic control , 1971 .

[22]  Rainer Schwabe.  Stability results for smoothed stochastic approximation procedures , 1993 .

[23]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[24]  M. Metivier,et al.  Applications of a Kushner and Clark lemma to general classes of stochastic algorithms , 1984, IEEE Trans. Inf. Theory.

[25]  Gang George Yin.  Asymptotic properties of an adaptive beam former algorithm , 1989, IEEE Trans. Inf. Theory.