Stochastic Stability and Stabilization of Semi-Markov Jump Linear Systems with Uncertain Transition Rates

This paper investigates the problems of robust stochastic stability and stabilization for a general class of continuous-time semi-Markovian jump linear systems (S-MJLSs). The main contribution of the research is to eliminate the limitations of the traditional S-MJLSs with precisely available information by introducing a system with uncertain, time-varying transition rates (TRs) of the jump process, in addition to the imperfect information on the system dynamic matrices. The new system is called the general uncertain semi-Markov jump linear system (GUS-MJLS); it does not contain certain values of the transition rates, but includes nominal time-dependent values in addition to bounded deviations. It is suitable to describe a broader class of dynamical systems with estimated information and modeling errors and also covers the concepts of Markov jump linear system (MJLSs) with time-constant and certain TRs. For this system, the stability is firstly analyzed through the multiple stochastic Lyapunov function approach. Then, based on the stability results, a robust state-feedback controller is formulated. To deal with the time-dependent TRs, a sojourn-time fractionizing technique is used and numerically testable conditions are developed. Finally, discussions on reducing the conservativeness of the robust theorems are provided. The theoretical results are successfully tested on an industrial continuous stirred tank reactor (CSTR) subject to stochastically varying environmental conditions. Comparative simulations are also provided to show the superiority of the presented framework and design method to the existing ones.DOI: http://dx.doi.org/10.5755/j01.itc.46.1.13881

[1]  Li Qiu,et al.  H∞ control of networked control systems based on Markov jump unified model , 2015 .

[2]  Andrew R. Teel,et al.  Stability analysis for stochastic hybrid systems: A survey , 2014, Autom..

[3]  R. Ramaswami,et al.  Book Review: Design and Analysis of Fault-Tolerant Digital Systems , 1990 .

[4]  Wenhai Qi,et al.  State feedback controller design for singular positive Markovian jump systems with partly known transition rates , 2015, Appl. Math. Lett..

[5]  Ju H. Park,et al.  Reliable mixed passive and ℋ∞ filtering for semi‐Markov jump systems with randomly occurring uncertainties and sensor failures , 2015 .

[6]  Yang Shi,et al.  Stochastic stability and robust stabilization of semi‐Markov jump linear systems , 2013 .

[7]  Efraim Shmerling,et al.  Stability and Optimal Control for Semi-Markov Jump Parameter Linear Systems , 2005 .

[8]  A. Haddad,et al.  Control of jump linear systems having semi-Markov sojourn times , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[9]  N. Welton,et al.  Estimation of Markov Chain Transition Probabilities and Rates from Fully and Partially Observed Data: Uncertainty Propagation, Evidence Synthesis, and Model Calibration , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  A. Deshpande.  Sufficient Stochastic Maximum Principle for the Optimal Control of Semi-Markov Modulated Jump-Diffusion with Application to Financial Optimization , 2014, 1407.3256.

[11]  Boris Harlamov,et al.  Continuous Semi-Markov Processes , 2008 .

[12]  Min Xie,et al.  Reliability analysis using an additive Weibull model with bathtub-shaped failure rate function , 1996 .

[13]  Jianbin Qiu,et al.  A singular system approach to robust and non-fragile filtering design for continuous-time semi-Markovian jump systems , 2014, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE).

[14]  L. Ghaoui,et al.  A cone complementarity linearization algorithm for static output-feedback and related problems , 1996, Proceedings of Joint Conference on Control Applications Intelligent Control and Computer Aided Control System Design.

[15]  E. Mathieu,et al.  Parametric and Non Homogeneous Semi-Markov Process for HIV Control , 2007 .

[16]  Y. Chu,et al.  H∞ mode-dependent fault detection filter design for stochastic Markovian jump systems with time-varying delays and parameter uncertainties. , 2014, ISA transactions.

[17]  Ligang Wu,et al.  State estimation and sliding mode control for semi-Markovian jump systems with mismatched uncertainties , 2015, Autom..

[18]  Fei Liu,et al.  Robust control on saturated Markov jump systems with missing information , 2014, Inf. Sci..

[19]  Hailing Dong,et al.  Asymptotic stability in the distribution of nonlinear stochastic systems with semi-Markovian switching , 2007, The ANZIAM Journal.

[20]  Maksym Spiryagin,et al.  Control and decision strategy for a class of Markovian jump systems in failure prone manufacturing process , 2012 .

[21]  Efraim Shmerling,et al.  Stability of stochastic jump-parameter semi-Markov linear systems of differential equations , 2008 .

[22]  Jianbin Qiu,et al.  Mode-dependent nonrational output feedback control for continuous-time semi-Markovian jump systems with time-varying delay , 2015 .

[23]  M. Mariton,et al.  On systems with non-Markovian regime changes , 1989 .

[24]  Sheldon M. Ross,et al.  Introduction to probability models , 1975 .

[25]  Nikolaos Limnios,et al.  Empirical estimation for discrete-time semi-Markov processes with applications in reliability , 2006 .

[26]  Hao Shen,et al.  Finite-time H∞ synchronization for complex networks with semi-Markov jump topology , 2015, Commun. Nonlinear Sci. Numer. Simul..

[27]  Ji Huang,et al.  Stochastic stability of semi-Markov jump linear systems: An LMI approach , 2011, IEEE Conference on Decision and Control and European Control Conference.

[28]  Ligang Wu,et al.  Quantized Control Design for Cognitive Radio Networks Modeled as Nonlinear Semi-Markovian Jump Systems , 2015, IEEE Transactions on Industrial Electronics.

[29]  João Pedro Hespanha,et al.  Quadratic control of stochastic hybrid systems with renewal transitions , 2014, Autom..

[30]  P. Kiessler.  Stochastic Switching Systems: Analysis and Design , 2008 .

[31]  Zhiqiang Zuo,et al.  Finite-time stochastic stabilization for uncertain Markov jump systems subject to input constraint , 2014 .

[32]  M. Fragoso,et al.  Continuous-Time Markov Jump Linear Systems , 2012 .

[33]  Carlos Silvestre,et al.  Stochastic Hybrid Systems with renewal transitions , 2010, Proceedings of the 2010 American Control Conference.

[34]  Jin Hyun Park,et al.  Fault detection and identification of nonlinear processes based on kernel PCA , 2005 .

[35]  Carlos Silvestre,et al.  Stability of impulsive systems driven by renewal processes , 2009, 2009 American Control Conference.

[36]  Jing Wang,et al.  Memory feedback controller design for stochastic Markov jump distributed delay systems with input saturation and partially known transition rates , 2015 .

[37]  John Leth,et al.  Stochastic stability of systems with semi-Markovian switching , 2014, Autom..

[38]  Do Sun Bai.  Efficient Estimation of Transition Probabilities in a Markov Chain , 1975 .

[39]  Peng Shi,et al.  A survey on Markovian jump systems: Modeling and design , 2015 .

[40]  J. Zhou,et al.  Stochastic stabilization of Semi-Markov jump uncertain systems: Dynamic output feedback case , 2014, Proceedings of the 33rd Chinese Control Conference.

[41]  Yang Shi,et al.  H∞ State-Feedback Control for Semi-Markov Jump Linear Systems With Time-Varying Delays , 2013 .

[42]  M. Fragoso,et al.  Mean Square Stabilizability of Continuous-Time Linear Systems with Partial Information on the Markovian Jumping Parameters , 2004 .

[43]  Clyde F. Martin,et al.  Stability Analysis of Positive Semi-Markovian Jump Linear Systems with State Resets , 2013, SIAM J. Control. Optim..

[44]  Zhengzhi Han,et al.  Robust stability and stabilization of linear stochastic systems with Markovian switching and uncertain transition rates , 2014 .

[45]  Lars E. O. Svensson,et al.  Optimal monetary policy under uncertainty: a Markov jump-linear-quadratic approach , 2008 .