Stabilization of Markovian Systems via Probability Rate Synthesis and Output Feedback

This technical note is concerned with the stabilization problem of Markovian jump linear systems via designing switching probability rate matrices and static output-feedback gains. A novel necessary and sufficient condition is established to characterize the switching probability rate matrices that guarantee the mean square stability of Markovian jump linear systems. Based on this, a necessary and sufficient condition is provided for the existence of desired controller gains and probability rate matrices. Extensions to the polytopic uncertain case are also provided. All the conditions are formulated in terms of linear matrix inequalities with some equality constraints, which can be solved by two modified cone complementarity linearization algorithms. Examples are given to show the effectiveness of the proposed method.

[1]  A. Willsky,et al.  Discrete-time Markovian-jump linear quadratic optimal control , 1986 .

[2]  Peng Shi,et al.  Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters , 1999, IEEE Trans. Autom. Control..

[3]  W. Marsden.  I and J , 2012 .

[4]  W. L. Koning,et al.  Discrete-time Markovian jump linear systems , 1993 .

[5]  Kou Yi-min,et al.  Fault Detection Filter Design for Networked Control Systems , 2009 .

[6]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[7]  José Claudio Geromel,et al.  Continuous-time state-feedback H2-control of Markovian jump linear systems via convex analysis , 1999, Autom..

[8]  Dragoslav D. Šiljak,et al.  Decentralized control of complex systems , 2012 .

[9]  Huijun Gao,et al.  Stabilization and H∞ control of two-dimensional Markovian jump systems , 2004, IMA J. Math. Control. Inf..

[10]  J. Lam,et al.  Stochastic stabilizability and H∞ control for discrete-time jump linear systems with time delay ☆ , 1999 .

[11]  Patrizio Colaneri,et al.  Stability and Stabilization of Continuous-Time Switched Linear Systems , 2006, SIAM J. Control. Optim..

[12]  Shengyuan Xu,et al.  Robust H∞ control for uncertain discrete‐time stochastic bilinear systems with Markovian switching , 2005 .

[13]  L. Ghaoui,et al.  A cone complementarity linearization algorithm for static output-feedback and related problems , 1997, IEEE Trans. Autom. Control..

[14]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[15]  Shuzhi Sam Ge,et al.  Robust Output Feedback H∞ Control of Uncertain Markovian Jump Systems with Mode-Dependent Time-Delays , 2006, 2006 Chinese Control Conference.

[16]  Shengyuan Xu,et al.  Robust control of descriptor discrete-time Markovian jump systems , 2007, Int. J. Control.

[17]  James Lam,et al.  Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities , 2008, IEEE Transactions on Automatic Control.

[18]  Patrizio Colaneri,et al.  Dynamic Output Feedback Control of Switched Linear Systems , 2008, IEEE Transactions on Automatic Control.

[19]  James Lam,et al.  On robust stabilization of Markovian jump systems with uncertain switching probabilities , 2005, Autom..

[20]  Shengyuan Xu,et al.  Delay-Dependent $H_{\infty }$ Control and Filtering for Uncertain Markovian Jump Systems With Time-Varying Delays , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[21]  Zehui Mao,et al.  H/sub /spl infin// fault detection filter design for networked control systems modelled by discrete Markovian jump systems , 2007 .

[22]  Ching-Chih Tsai,et al.  Averaging, aggregation and optimal control of singularly perturbed stochastic hybrid systems , 1997 .

[23]  Uri Shaked,et al.  Improved LMI representations for the analysis and the design of continuous-time systems with polytopic type uncertainty , 2001, IEEE Trans. Autom. Control..

[24]  X. Mao.  Stability of stochastic differential equations with Markovian switching , 1999 .

[25]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[26]  A. Morse,et al.  Basic problems in stability and design of switched systems , 1999 .

[27]  Gopal K. Basak,et al.  Stability of a Random diffusion with linear drift , 1996 .