H∞ Control for Discrete-Time Markov Jump Systems With Uncertain Transition Probabilities

In this technical note, the H∞ control problem for a class of discrete-time Markov jump systems (MJSs) with uncertain transition probabilities (TPs) is investigated. The uncertain information of transition probabilities is quantized by Gaussian transition probability density function (pdf). In light of the proposed descriptions, the MJSs with Gaussian PDF of TPs cover the systems with precisely known and partially known TPs as two special cases. Sufficient conditions for the existence of H∞ controller of the underlying systems are derived in term of linear matrix inequalities. A numerical example is presented to illustrate the effectiveness and potential of the developed theoretical results.

[1]  James Lam,et al.  Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities , 2008, IEEE Transactions on Automatic Control.

[2]  John Monahan,et al.  Stochastic Integration Rules for Infinite Regions , 1998, SIAM J. Sci. Comput..

[3]  Lixian Zhang,et al.  Mode-dependent Hinfinity filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities , 2009, Autom..

[4]  Huijun Gao,et al.  State Estimation and Sliding-Mode Control of Markovian Jump Singular Systems , 2010, IEEE Transactions on Automatic Control.

[5]  Fei Liu,et al.  Finite-Time Stabilization of Stochastic Systems With Partially Known Transition Probabilities , 2011 .

[6]  Lixian Zhang,et al.  Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities , 2009, Autom..

[7]  Yang Cheng,et al.  Sparse Gauss-Hermite Quadrature Filter with Application to Spacecraft Attitude Estimation , 2011 .

[8]  E. Boukas,et al.  Mode-dependent Hºº filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities. , 2007 .

[9]  Jinliang Liu,et al.  H∞ filtering for Markovian jump systems with time-varying delays , 2010, 2010 Chinese Control and Decision Conference.

[10]  André Longtin,et al.  Stochastic dynamical systems , 2010, Scholarpedia.

[11]  Nan Xiao,et al.  Stabilization of Markov jump linear systems using quantized state feedback , 2010, Autom..

[12]  A. Gupta,et al.  Model reduction for discrete time systems , 1990 .

[13]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[14]  Fei Liu,et al.  Finite-time filtering for non-linear stochastic systems with partially known transition jump rates , 2010 .

[15]  James Lam,et al.  On robust stabilization of Markovian jump systems with uncertain switching probabilities , 2005, Autom..

[16]  Alim P. C. Gonçalves,et al.  Filtering of discrete‐time Markov jump linear systems with uncertain transition probabilities , 2011 .

[17]  Niels Kjølstad Poulsen,et al.  New developments in state estimation for nonlinear systems , 2000, Autom..

[18]  Tor Steinar Schei,et al.  A finite-difference method for linearization in nonlinear estimation algorithms , 1997, Autom..

[19]  Peng Shi,et al.  Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters , 1999, IEEE Trans. Autom. Control..

[20]  Fei Liu,et al.  Neural network based stochastic optimal control for nonlinear Markov jump systems , 2010 .

[21]  Li Sheng,et al.  Stabilization for Markovian jump nonlinear systems with partly unknown transition probabilities via fuzzy control , 2010, Fuzzy Sets Syst..

[22]  Hamid Reza Karimi,et al.  Fault detection for discrete-time Markov jump linear systems with partially known transition probabilities , 2010, Int. J. Control.

[23]  Yuanqing Xia,et al.  On designing of sliding-mode control for stochastic jump systems , 2006, IEEE Transactions on Automatic Control.

[24]  James Lam,et al.  Necessary and Sufficient Conditions for Analysis and Synthesis of Markov Jump Linear Systems With Incomplete Transition Descriptions , 2010, IEEE Transactions on Automatic Control.

[25]  Jindrich Duník,et al.  Derivative-free estimation methods: New results and performance analysis , 2009, Autom..

[26]  Jeffrey K. Uhlmann,et al.  Corrections to "Unscented Filtering and Nonlinear Estimation" , 2004, Proc. IEEE.

[27]  James D. Meiss,et al.  Stochastic dynamical systems , 1994 .

[28]  Peng Shi,et al.  Transition probability bounds for the stochastic stability robustness of continuous- and discrete-time Markovian jump linear systems , 2006, Autom..

[29]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[30]  E. Boukas,et al.  H∞ control for discrete‐time Markovian jump linear systems with partly unknown transition probabilities , 2009 .

[31]  Peter X.-K. Song,et al.  Monte Carlo Kalman filter and smoothing for multivariate discrete state space models , 2000 .

[32]  Harold W. Sorenson,et al.  On the development of practical nonlinear filters , 1974, Inf. Sci..

[33]  H. Wabnitz,et al.  Dependence of transition probabilities for non-linear photo-ionization of He atoms on the structure of the exciting radiation pulses , 2005 .

[34]  Peng Shi,et al.  Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay , 1999, IEEE Trans. Autom. Control..

[35]  D. Sworder,et al.  Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria , 1975 .

[36]  Hugh F. Durrant-Whyte,et al.  A new method for the nonlinear transformation of means and covariances in filters and estimators , 2000, IEEE Trans. Autom. Control..

[37]  Torsten Söderström,et al.  Anticipative grid design in point-mass approach to nonlinear state estimation , 2002, IEEE Trans. Autom. Control..