On Almost Sure Stabilization of Continuous-Time Markov Jump Linear Systems

In this work we derive an easily testable sufficient condition for assessing almost sure (AS) stability of a continuous-time Markov jump linear system (MJLS) with a finite state Markov form process. Such a condition is used to design a feedback stabilization strategy under the hypothesis that at least one mode is controllable. The proposed condition relies on some bounds on the 2-norm of the transition matrix over the time interval to the first jump. Such bounds are computed from the eigenvalues of the solutions of a set of associated Lyapunov equations, one for each mode. An algorithm is also given for designing the stabilizing feedback, based on a formulation of the sufficient condition in terms of an equivalent LMI problem

[1]  J. H. Wilkinson.  The algebraic eigenvalue problem , 1966 .

[2]  A. Willsky,et al.  Discrete-time Markovian-jump linear quadratic optimal control , 1986 .

[3]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[4]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[5]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[6]  K. Loparo,et al.  Almost sure and δmoment stability of jump linear systems , 1994 .

[7]  Yuguang Fang.  Stability analysis of linear control systems with uncertain parameters , 1994 .

[8]  Arturo Locatelli,et al.  Control theory and design , 1997 .

[9]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[10]  E. Boukas,et al.  On stabilization of uncertain linear systems with jump parameters , 1999 .

[11]  José Claudio Geromel,et al.  Continuous-time state-feedback H2-control of Markovian jump linear systems via convex analysis , 1999, Autom..

[12]  E. Plischke,et al.  Liapunov and Riccati equations for practical stability , 2001, 2001 European Control Conference (ECC).

[13]  Yuguang Fang,et al.  Stabilization of continuous-time jump linear systems , 2002, IEEE Trans. Autom. Control..

[14]  Yuguang Fang,et al.  On the relationship between the sample path and moment lyapunov exponents for jump linear systems , 2002, IEEE Trans. Autom. Control..

[15]  G. Hu,et al.  The weighted logarithmic matrix norm and bounds of the matrix exponential , 2004 .

[16]  G. Nicolao,et al.  On almost sure stability of discrete-time Markov jump linear systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[17]  G. Nicolao,et al.  ALMOST SURE STABILITY OF CONTINUOUS-TIME MARKOV JUMP LINEAR SYSTEMS: A RANDOMIZED APPROACH , 2005 .

[18]  Patrizio Colaneri,et al.  On almost sure stability of continuous-time Markov jump linear systems , 2006, Autom..