论文信息 - Stochastic adaptive control and Martingale limit theory

Stochastic adaptive control and Martingale limit theory

Recently, S.P. Meyn and P.E. Caines (ibid., vol.AC-32, p.220-6, 1987) have used ergodic theory for Markov processes to give the first asymptotic stability analysis of a nontrivial stochastic adaptive control problem. By nontrivial is meant a stochastic adaptive control problem whose parameter variation has finite nonzero power. They correctly observed that the stochastic Lyapunov function methods fail here, because there is no almost sure parameter convergence. It is shown here how Martingale asymptotics can be used to produce many results close to those of Meyn and Caines, as well as to supply some new observations. Strengths and weaknesses of both approaches are discussed. >

V. Solo

[1] David Q. Mayne,et al. Optimal Non-stationary Estimation of the Parameters of a Linear System with Gaussian Inputs † , 1963 .

[2] K. Åström,et al. Problems of Identification and Control , 1971 .

[3] B. Widrow,et al. Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[4] G. Kitagawa,et al. A smoothness priors time-varying AR coefficient modeling of nonstationary covariance time series , 1985, IEEE Transactions on Automatic Control.

[5] P. Caines,et al. A new approach to stochastic adaptive control , 1987, 1986 25th IEEE Conference on Decision and Control.