Adaptive control for jump parameter systems via nonlinear filtering

The authors first present an error analysis for the process of estimates generated by the Wonham filter when it is used for the estimation of the jump-Markov parameters of a linear stochastic system and further give bounds on certain functions of these estimates. Then, a stochastic Lyapunov analysis establishes that a certainty equivalence adaptive LQG (linear-quadratic-Guassian) feedback control law using the estimates generated by the nonlinear filter stabilizes the Markov jump parameter linear system in the mean square average sense. The conditions for this result are that certain products of the parameter process jump rate and the solution of the control Riccati equation and its second derivatives should be less than certain given bounds. An example is given where the controlled linear system has state dimension two.<<ETX>>

[1]  D. Sworder,et al.  A survey of some design methods for random parameter systems , 1985, 1985 24th IEEE Conference on Decision and Control.

[2]  Raymond Rishel,et al.  The solution of a partially observed stochastic optimal control problem in terms of predicted miss , 1992 .

[3]  P. Caines,et al.  Optimal adaptive LQG control for systems with finite state process parameters , 1985, The 23rd IEEE Conference on Decision and Control.

[4]  L. Schwartz,et al.  Semimartingales and Their Stochastic Calculus on Manifolds , 1985 .

[5]  W. Wonham.  Some applications of stochastic difierential equations to optimal nonlinear ltering , 1964 .

[6]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[7]  M. Mariton,et al.  On controlability of linear systems with stochastic jump parameters , 1986 .

[8]  Raymond Rishel.  A comment on a dual control problem , 1980 .

[9]  P. E. Caines,et al.  On the adaptive stabilization of linear stochastic systems with jump process parameters , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[10]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[11]  Jelel Ezzine,et al.  On Largest Lyapunov Exponent Assignment and Almost Sure Stabilization of Hybrid Systems , 1989, 1989 American Control Conference.

[12]  M. Mariton,et al.  Output feedback for a class of linear systems with stochastic jump parameters , 1985 .

[13]  P.E. Caines,et al.  On the adaptive stabilization and ergodic behaviour of stochastic jump-Markov systems via nonlinear filtering , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.