H2-Control and the Separation Principle for Discrete-Time Markovian Jump Linear Systems

AbstractIn this paper we consider the H2-control problem of discrete-time Markovian jump linear systems. We assume that only an output and the jump parameters are available to the controller. It is desired to design a dynamic Markovian jump controller such that the closed-loop system is mean square stable and minimizes the H2-norm of the system. As in the case with no jumps, we show that an optimal controller can be obtained from two sets of coupled algebraic Riccati equations, one associated with the optimal control problem when the state variable is available, and the other associated with the optimal filtering problem. This is the principle of separation for discrete-time Markovian jump linear systems. When there is only one mode of operation our results coincide with the traditional separation principle for the H2-control of discrete-time linear systems.

[1]  Paul M. Frank,et al.  Fault Diagnosis in Dynamic Systems , 1993, Robotics, Mechatronics and Manufacturing Systems.

[2]  Hisham Abou-Kandil,et al.  On the solution of discrete-time Markovian jump linear quadratic control problems , 1995, Autom..

[3]  J. Geromel,et al.  A Convex Programming Approach to the H2-Control of Discrete-Time Markovian Jump Linear Systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[4]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[5]  D. Sworder,et al.  Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria , 1975 .

[6]  L. Ghaoui,et al.  LMI optimization for nonstandard Riccati equations arising in stochastic control , 1996, IEEE Trans. Autom. Control..

[7]  M. Fragoso,et al.  Discrete-time LQ-optimal control problems for infinite Markov jump parameter systems , 1995, IEEE Trans. Autom. Control..

[8]  R. Hartley.  Stochastic Modelling and Control , 1985 .

[9]  H. Chizeck,et al.  Controllability, observability and discrete-time markovian jump linear quadratic control , 1988 .

[10]  WILLIAM P. BLAIR,et al.  Continuous-Time Regulation of a Class of Econometric Models , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[12]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[13]  Toader Morozan,et al.  Stability and control for linear systems with jump Markov perturbations , 1995 .

[14]  R. P. Marques,et al.  Robust H 2-control for discrete-time Markovian jump linear systems , 2000 .

[15]  M. Fragoso,et al.  Stability Results for Discrete-Time Linear Systems with Markovian Jumping Parameters , 1993 .

[16]  Oswaldo Luiz V. Costa,et al.  Maximal and Stabilizing Hermitian Solutions for Discrete-Time Coupled Algebraic Riccati Equations , 1999, Math. Control. Signals Syst..

[17]  Michel Mariton,et al.  Almost sure and moments stability of jump linear systems , 1988 .

[18]  Oswaldo Luiz do Valle Costa,et al.  Discrete-Time Coupled Riccati Equations for Systems with Markov Switching Parameters , 1995 .

[19]  El Kebir Boukas,et al.  Stability of discrete-time linear systems with Markovian jumping parameters , 1995, Math. Control. Signals Syst..

[20]  T. Morozan,et al.  Optimal stationary control for dynamic systems with Markov perturbations , 1983 .

[21]  S. Bittanti,et al.  The Riccati equation , 1991 .