Stability of Stochastic Nonlinear Systems With State-Dependent Switching

In this paper, the problem of stability on stochastic systems with state-dependent switching is investigated. To analyze properties of the switched system by means of Itô's formula and Dynkin's formula, it is critical to show switching instants being stopping times. When the given active-region set can be replaced by its interior, the local solution of the switched system is constructed by defining a series of stopping times as switching instants, and the criteria on global existence and stability of solution are presented by Lyapunov approach. For the case where the active-region set can not be replaced by its interior, the switched systems do not necessarily have solutions, thereby quasi-solution to the underlying problem is constructed and the boundedness criterion is proposed. The significance of this paper is that all the results presented depend on some easily-verified assumptions that are as elegant as those in the deterministic case, and the proofs themselves provide design procedures for switching controls.

[1]  R. W. Brockett,et al.  Asymptotic stability and feedback stabilization , 1982 .

[2]  Y. Pyatnitskiy,et al.  Criteria of asymptotic stability of differential and difference inclusions encountered in control theory , 1989 .

[3]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[4]  P. Florchinger.  A universal formula for the stabilization of control stochastic differential equations , 1993 .

[5]  K. Narendra,et al.  A common Lyapunov function for stable LTI systems with commuting A-matrices , 1994, IEEE Trans. Autom. Control..

[6]  Sean P. Meyn,et al.  State-Dependent Criteria for Convergence of Markov Chains , 1994 .

[7]  Eduardo Sontag,et al.  On characterizations of the input-to-state stability property , 1995 .

[8]  Eduardo D. Sontag,et al.  On the Input-to-State Stability Property , 1995, Eur. J. Control.

[9]  Sean P. Meyn,et al.  Stability and convergence of moments for multiclass queueing networks via fluid limit models , 1995, IEEE Trans. Autom. Control..

[10]  E. Boukas,et al.  H∞-Control for Markovian Jumping Linear Systems with Parametric Uncertainty , 1997 .

[11]  Xuerong Mao,et al.  Stochastic differential equations and their applications , 1997 .

[12]  J. Tsinias.  Stochastic input-to-state stability and applications to global feedback stabilization , 1998 .

[13]  Joao P. Hespanha,et al.  Logic-based switching algorithms in control , 1998 .

[14]  A. Michel,et al.  Stability theory for hybrid dynamical systems , 1998, IEEE Trans. Autom. Control..

[15]  M. Branicky.  Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[16]  X. Mao.  Stability of stochastic differential equations with Markovian switching , 1999 .

[17]  A. Morse,et al.  Stability of switched systems: a Lie-algebraic condition ( , 1999 .

[18]  A. Morse,et al.  Basic problems in stability and design of switched systems , 1999 .

[19]  Arjan van der Schaft,et al.  An Introduction to Hybrid Dynamical Systems, Springer Lecture Notes in Control and Information Sciences 251 , 1999 .

[20]  A. Michel.  Recent trends in the stability analysis of hybrid dynamical systems , 1999 .

[21]  Peng Shi,et al.  Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters , 1999, IEEE Trans. Autom. Control..

[22]  Clyde F. Martin,et al.  A Converse Lyapunov Theorem for a Class of Dynamical Systems which Undergo Switching , 1999, IEEE Transactions on Automatic Control.

[23]  Michael D. Lemmon,et al.  Supervisory hybrid systems , 1999 .

[24]  Miroslav Krstic,et al.  Stabilization of stochastic nonlinear systems driven by noise of unknown covariance , 2001, IEEE Trans. Autom. Control..

[25]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[26]  John Lygeros,et al.  Stochastic Hybrid Models: An Overview , 2003, ADHS.

[27]  Xuerong Mao,et al.  Robust stability and controllability of stochastic differential delay equations with Markovian switching , 2004, Autom..

[28]  João Pedro Hespanha,et al.  Uniform stability of switched linear systems: extensions of LaSalle's Invariance Principle , 2004, IEEE Transactions on Automatic Control.

[29]  D. Applebaum.  Lévy Processes and Stochastic Calculus: Preface , 2009 .

[30]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[31]  Manuela-Luminita Bujorianu.  Stochastic hybrid system : modelling and verification , 2005 .

[32]  Ji-Feng Zhang,et al.  Stability analysis and stabilization control of multi-variable switched stochastic systems , 2006, Autom..

[33]  Yuanqing Xia,et al.  On designing of sliding-mode control for stochastic jump systems , 2006, IEEE Transactions on Automatic Control.

[34]  Jun Zhao,et al.  Stability and L2-gain analysis for switched delay systems: A delay-dependent method , 2006, Autom..

[35]  Brian H. Fralix.  Foster-type criteria for Markov chains on general spaces , 2006, Journal of Applied Probability.

[36]  Jaroslav Krystul,et al.  Modelling of stochastic hybrid systems with applications to accident risk assessment , 2006 .

[37]  Debasish Chatterjee,et al.  Stability analysis of deterministic and stochastic switched systems via a comparison principle and multiple Lyapunov functions , 2006, SIAM J. Control. Optim..

[38]  Xuerong Mao,et al.  Stochastic Differential Equations With Markovian Switching , 2006 .

[39]  Robert Shorten,et al.  Stability Criteria for Switched and Hybrid Systems , 2007, SIAM Rev..

[40]  Xue‐Jun Xie,et al.  Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching , 2008, CCC 2008.

[41]  P. Kiessler.  Stochastic Switching Systems: Analysis and Design , 2008 .

[42]  Xin Yu,et al.  Output Feedback Regulation of Stochastic Nonlinear Systems With Stochastic iISS Inverse Dynamics , 2010, IEEE Transactions on Automatic Control.

[43]  Peng Shi,et al.  Adaptive Tracking for Stochastic Nonlinear Systems With Markovian Switching $ $ , 2010, IEEE Transactions on Automatic Control.

[44]  Xin Yu,et al.  Small-gain control method for stochastic nonlinear systems with stochastic iISS inverse dynamics , 2010, Autom..

[45]  M. Bujorianu.  Stochastic Reachability: From Markov Chains to Stochastic Hybrid Systems , 2011 .

[46]  Peng Shi,et al.  Theory of Stochastic Dissipative Systems , 2011, IEEE Transactions on Automatic Control.

[47]  Jie Tian,et al.  Stability analysis of switched stochastic systems , 2011, Autom..

[48]  Yuanqing Xia,et al.  Stochastic Barbalat's Lemma and Its Applications , 2012, IEEE Transactions on Automatic Control.

[49]  Rafael Wisniewski,et al.  A class of stochastic hybrid systems with state-dependent switching noise , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[50]  Sean P. Meyn,et al.  Random-Time, State-Dependent Stochastic Drift for Markov Chains and Application to Stochastic Stabilization Over Erasure Channels , 2010, IEEE Transactions on Automatic Control.