Necessary and sufficient conditions for stability of LMS

Guo and Ljung (1995) established some general results on exponential stability of random linear equations, which can be applied directly to the performance analysis of a wide class of adaptive algorithms, including the basic LMS ones, without requiring stationarity, independency, and boundedness assumptions of the system signals. The current paper attempts to give a complete characterization of the exponential stability of the LMS algorithms by providing a necessary and sufficient condition for such a stability in the case of possibly unbounded, nonstationary, and non-/spl phi/-mixing signals. The results of this paper can be applied to a very large class of signals, including those generated from, e.g., a Gaussian process via a time-varying linear filter. As an application, several novel and extended results on convergence and the tracking performance of LMS are derived under various assumptions. Neither stationarity nor Markov-chain assumptions are necessarily required in the paper.

[1]  J. Doob Stochastic processes , 1953 .

[2]  Robert Serfling,et al.  Contributions to Central Limit Theory for Dependent Variables , 1968 .

[3]  P. Hall,et al.  Martingale Limit Theory and Its Application , 1980 .

[4]  Eweda Eweda,et al.  Tracking error bounds of adaptive nonstationary filtering , 1985, Autom..

[5]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[6]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[7]  Lennart Ljung,et al.  Adaptation and tracking in system identification - A survey , 1990, Autom..

[8]  P. Priouret,et al.  A result on the mean square error obtained using general tracking algorithms , 1991 .

[9]  Peter M. Clarkson,et al.  Optimal and Adaptive Signal Processing , 1993 .

[10]  H. Kushner,et al.  Stochastic approximation with averaging of the iterates: Optimal asymptotic rate of convergence for , 1993 .

[11]  P. Priouret,et al.  Performance analysis of the forgetting factor RLS algorithm , 1993 .

[12]  Lei Guo Stability of recursive stochastic tracking algorithms , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[13]  Ali H. Sayed,et al.  LMS is H/sup /spl infin// optimal , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[14]  Xuan Kong,et al.  Adaptive Signal Processing Algorithms: Stability and Performance , 1994 .

[15]  Lei Guo,et al.  Stability of Recursive Stochastic Tracking Algorithms , 1994 .

[16]  H. Kushner,et al.  Analysis of adaptive step-size SA algorithms for parameter tracking , 1995, IEEE Trans. Autom. Control..

[17]  L. Ljung,et al.  Exponential stability of general tracking algorithms , 1995, IEEE Trans. Autom. Control..

[18]  Lennart Ljung,et al.  Performance analysis of general tracking algorithms , 1995 .

[19]  P. Priouret,et al.  A remark on the stability of the L.M.S. tracking algorithm , 1998 .

[20]  R. Lyapunov Techniques for the Exponential Stability of Linear Difference Equations with Random Coefficients , 2022 .