Robust H ∞ control of discrete-time Markovian jump systems in the presence of incomplete knowledge of transition probabilities and saturating actuator

SUMMARY This paper deals with the problem of robust H ∞  control for a class of discrete-time Markovian jump systems subject to both actuator saturation and incomplete knowledge of transition probability. Different from the previous results where the transition probability is completely known, a more general situation where only partial information on the exact values of elements in transition probability matrix is considered. By introducing some free parameters to express the relationship for the known and the unknown elements of transition probability matrix in stability analysis, a criterion is established to guarantee the stochastic stability of the closed-loop system as well as an H ∞  performance index. The concept of domain of attraction in mean square sense is used to analyze the closed-loop stability, and the mode-dependent H ∞  state-feedback controller is designed. It is shown that, even in the absence of actuator saturation, the obtained result is less conservative than the existing one. A numerical example is provided to illustrate the effectiveness of the proposed method. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  Daniel W. C. Ho,et al.  Fault tolerant control for singular systems with actuator saturation and nonlinear perturbation , 2010, Autom..

[2]  Oswaldo Luiz do Valle Costa,et al.  Constrained quadratic state feedback control of discrete-time Markovian jump linear systems , 1999, Autom..

[3]  James Lam,et al.  Robust H∞ control of uncertain Markovian jump systems with time-delay , 2000, IEEE Trans. Autom. Control..

[4]  Peng Shi,et al.  Transition probability bounds for the stochastic stability robustness of continuous- and discrete-time Markovian jump linear systems , 2006, Autom..

[5]  Jie Zhang,et al.  Stabilization for Markovian jump systems with partial information on transition probability based on free-connection weighting matrices , 2011, Autom..

[6]  James Lam,et al.  Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities , 2008, IEEE Transactions on Automatic Control.

[7]  Peng Shi,et al.  Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay , 1999, IEEE Trans. Autom. Control..

[8]  Tingshu Hu,et al.  Control Systems with Actuator Saturation: Analysis and Design , 2001 .

[9]  Lixian Zhang,et al.  Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities , 2009, Autom..

[10]  E. Boukas,et al.  Robust control of uncertain discrete-time Markovian jump systems with actuator saturation , 2006 .

[11]  El-Kébir Boukas,et al.  Stochastic stability and guaranteed cost control of discrete-time uncertain systems with Markovian jumping parameters , 1997 .

[12]  E. Boukas Stochastic Output Feedback of Uncertain Time-Delay Systems with Saturating Actuators , 2003, 2003 4th International Conference on Control and Automation Proceedings.

[13]  Fuchun Sun,et al.  Controller design for Markov jumping systems subject to actuator saturation , 2006, Autom..

[14]  D. Bernstein,et al.  A chronological bibliography on saturating actuators , 1995 .

[15]  James Lam,et al.  On robust stabilization of Markovian jump systems with uncertain switching probabilities , 2005, Autom..

[16]  Zongli Lin,et al.  Stability analysis of discrete-time systems with actuator saturation by a saturation-dependent Lyapunov function , 2003, Autom..

[17]  E. Boukas,et al.  H∞ control for discrete‐time Markovian jump linear systems with partly unknown transition probabilities , 2009 .