Finite horizon quadratic optimal control and a separation principle for Markovian jump linear systems

In this note, we consider the finite-horizon quadratic optimal control problem of discrete-time Markovian jump linear systems driven by a wide sense white noise sequence. We assume that the output variable and the jump parameters are available to the controller. It is desired to design a dynamic Markovian jump controller such that the closed-loop system minimizes the quadratic functional cost of the system over a finite horizon period of time. As in the case with no jumps, we show that an optimal controller can be obtained from two coupled Riccati difference equations, one associated to the optimal control problem when the state variable is available, and the other one associated to the optimal filtering problem. This is a principle of separation for the finite horizon quadratic optimal control problem for discrete-time Markovian jump linear systems. When there is only one mode of operation our results coincide with the traditional separation principle for the linear quadratic Gaussian control of discrete-time linear systems.

[1]  Oswaldo Luiz do Valle Costa,et al.  Discrete-Time Coupled Riccati Equations for Systems with Markov Switching Parameters , 1995 .

[2]  T. Morozan,et al.  Optimal stationary control for dynamic systems with Markov perturbations , 1983 .

[3]  J. Walrand,et al.  The cμ rule revisited , 1985, Advances in Applied Probability.

[4]  Hisham Abou-Kandil,et al.  On the solution of discrete-time Markovian jump linear quadratic control problems , 1995, Autom..

[5]  M. Fragoso,et al.  Discrete-time LQ-optimal control problems for infinite Markov jump parameter systems , 1995, IEEE Trans. Autom. Control..

[6]  Michel Mariton,et al.  Almost sure and moments stability of jump linear systems , 1988 .

[7]  El Kebir Boukas,et al.  Stability of discrete-time linear systems with Markovian jumping parameters , 1995, Math. Control. Signals Syst..

[8]  A. V. Balakrishnan,et al.  Kalman Filtering Theory , 1984 .

[9]  J. Geromel,et al.  A Convex Programming Approach to the H2-Control of Discrete-Time Markovian Jump Linear Systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[10]  M. D. Fragoso.  Discrete-time jump LQG problem , 1989 .

[11]  H. Chizeck,et al.  Controllability, observability and discrete-time markovian jump linear quadratic control , 1988 .

[12]  K. Loparo,et al.  Stability and control of discrete-time jump linear systems , 1991 .

[13]  M. Fragoso,et al.  Stability Results for Discrete-Time Linear Systems with Markovian Jumping Parameters , 1993 .

[14]  Toader Morozan,et al.  Stability and control for linear systems with jump Markov perturbations , 1995 .

[15]  A. Cohn,et al.  The Stochastic Knapsack Problem with Random Weights : A Heuristic Approach to Robust Transportation Planning , 1998 .

[16]  H. Chizeck,et al.  Optimal quadratic control of jump linear systems with Gaussian noise in discrete-time , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.