On the Adaptive Control for Jump Parameter Systems viaNonlinear Filtering

In this paper we first present an error analysis for the process of estimates generated by the Wonham filter when it is used for the estimation of the (finite set-valued) jump-Markov parameters of a random parameter linear stochastic system and further give bounds on certain functions of these estimates. We then consider a certainty equivalence adaptive linear-quadratic Gaussian feedback control law using the estimates generated by the nonlinear filter and demonstrate the global existence of solutions to the resulting closed-loop system. A stochastic Lyapunov analysis establishes that the certainty equivalence law stabilizes the Markov jump parameter linear system in the mean square average sense. The conditions for this result are that certain products of (i) the parameter process jump rate and (ii) the solution of the control Riccati equation and its second derivatives should be less than certain given bounds. An example is given where the controlled linear system has state dimension 2. Finally, the stabilizing properties of certainty equivalence laws which depend on (i) the maximum likelihood estimate of the parameter value and (ii) a modified version of this estimate are established under certain conditions.

[1]  W. Wonham.  Some applications of stochastic difierential equations to optimal nonlinear ltering , 1964 .

[2]  K. Mrtensson.  On the matrix riccati equation , 1971 .

[3]  C. Desoer,et al.  Feedback Systems: Input-Output Properties , 1975 .

[4]  Raymond Rishel.  A comment on a dual control problem , 1980 .

[5]  M. Mariton,et al.  Output feedback for a class of linear systems with stochastic jump parameters , 1985 .

[6]  D. Sworder,et al.  A survey of some design methods for random parameter systems , 1985, 1985 24th IEEE Conference on Decision and Control.

[7]  M. Mariton,et al.  On controlability of linear systems with stochastic jump parameters , 1986 .

[8]  Norbert Christopeit.  Quasi-least-squares estimation in semimartingale regression models , 1986 .

[9]  P. E. Caines,et al.  On the adaptive stabilization of linear stochastic systems with jump process parameters , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[10]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[11]  D. D. Sworder,et al.  Hybrid adaptive control , 1991 .

[12]  Peter E. Caines,et al.  On the Adaptive Stabilization and Ergodic Behaviour of Stochastic Systems with Jump-Markov Parameters Via Nonlinear Filtering , 1992 .

[13]  P.E. Caines,et al.  On the adaptive stabilization and ergodic behaviour of stochastic jump-Markov systems via nonlinear filtering , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[14]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[15]  A note on continuous-time ELS , 1994 .

[16]  F. Dufour,et al.  Stabilizing control law for hybrid models , 1994, IEEE Trans. Autom. Control..