Stabilizing Randomly Switched Systems

This article is concerned with stability analysis and stabilization of randomly switched systems under a class of switching signals. The switching signal is modeled as a jump stochastic (not necessarily Markovian) process independent of the system state; it selects, at each instant of time, the active subsystem from a family of systems. Sufficient conditions for stochastic stability (almost sure, in the mean, and in probability) of the switched system are established when the subsystems do not possess control inputs, and not every subsystem is required to be stable. These conditions are employed to design stabilizing feedback controllers when the subsystems are affine in control. The analysis is carried out with the aid of multiple Lyapunov-like functions, and the analysis results, together with universal formulae for feedback stabilization of nonlinear systems, constitute our primary tools for control design.

[1]  P. Donnelly.  MARKOV PROCESSES Characterization and Convergence (Wiley Series in Probability and Mathematical Statistics) , 1987 .

[2]  J. Hespanha.  A model for stochastic hybrid systems with application to communication networks , 2005 .

[3]  Frank Kozin,et al.  A survey of stability of stochastic systems , 1969, Autom..

[4]  John Lygeros,et al.  Stabilization of a class of stochastic differential equations with Markovian switching , 2005, Syst. Control. Lett..

[5]  Vladimir Vasilʹevich Filippov.  Basic topological structures of ordinary differential equations , 1998 .

[6]  John Lygeros,et al.  Reachability Questions in Piecewise Deterministic Markov Processes , 2003, HSCC.

[7]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[8]  R. Khasminskii.  Stochastic Stability of Differential Equations , 1980 .

[9]  J. Lygeros,et al.  General stochastic hybrid systems: modelling and optimal control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[10]  A. Michel,et al.  Stability analysis of switched systems with stable and unstable subsystems: an average dwell time approach , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[11]  X. Mao,et al.  Asymptotic stability in distribution of stochastic differential equations with Markovian switching , 2003 .

[12]  Debasish Chatterjee,et al.  Towards ISS disturbance attenuation for randomly switched systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[13]  T. Başar.  Minimax control of switching systems under sampling , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[14]  M. Eisen,et al.  Probability and its applications , 1975 .

[15]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[16]  G. Nicolao,et al.  On almost sure stability of discrete-time Markov jump linear systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[17]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[18]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[19]  M. Rao.  Probability theory with applications , 1984 .

[20]  D. Liberzon,et al.  Stability Analysis and Stabilization of Randomly Switched Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[21]  Xuerong Mao,et al.  Stochastic Differential Equations With Markovian Switching , 2006 .

[22]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[23]  Eduardo Sontag,et al.  Forward Completeness, Unboundedness Observability, and their Lyapunov Characterizations , 1999 .

[24]  W. Walter.  Differential and Integral Inequalities , 1970 .

[25]  Debasish Chatterjee,et al.  Studies on Stability and Stabilization of Randomly Switched Systems , 2007 .

[26]  El-Kébir Boukas,et al.  Stochastic Switching Systems: Analysis and Design , 2005 .

[27]  Debasish Chatterjee,et al.  On Stability of Randomly Switched Nonlinear Systems , 2007, IEEE Transactions on Automatic Control.

[28]  Alberto De Santis,et al.  Dwell-time controllers for stochastic systems with switching Markov chain , 2005, Autom..

[29]  X. Mao.  Stability of stochastic differential equations with Markovian switching , 1999 .

[30]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[31]  Eduardo D. Sontag,et al.  Universal formulas for CLFs with respect to Minkowski balls , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[32]  V. Lakshmikantham,et al.  Differential and integral inequalities : theory and applications , 1969 .

[33]  Valery A. Ugrinovskii,et al.  Randomized Algorithms for Robust Stability and Guaranteed Cost Control of Stochastic Jump Parameter Systems with Uncertain Switching Policies , 2005 .

[34]  C. A. Desoer,et al.  Nonlinear Systems Analysis , 1978 .

[35]  A. Borovkov.  Probability Theory , 1998 .

[36]  Yuandan Lin,et al.  A universal formula for stabilization with bounded controls , 1991 .

[37]  Eduardo Sontag.  A universal construction of Artstein's theorem on nonlinear stabilization , 1989 .

[38]  P. Brémaud.  Point Processes and Queues , 1981 .

[39]  S. Kotz,et al.  The Theory Of Stochastic Processes I , 1974 .

[40]  Eduardo D. Sontag,et al.  Control-Lyapunov Universal Formulas for Restricted Inputs , 1995 .

[41]  O. Kallenberg.  Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[42]  H. Kushner.  Stochastic Stability and Control , 2012 .

[43]  P. Brémaud.  Point processes and queues, martingale dynamics , 1983 .

[44]  Bo Hu,et al.  Stability analysis of switched systems with stable and unstable subsystems: An average dwell time approach , 2001, Int. J. Syst. Sci..

[45]  Sean P. Meyn,et al.  The ODE Method and Spectral Theory of Markov Operators , 2002, math/0209277.

[46]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[47]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[48]  P. Bremaud,et al.  Point Processes and Queues: Martingale Dynamics (Springer Series in Statistics) , 1981 .

[49]  I. I. Gikhman,et al.  The Theory of Stochastic Processes II , 1975 .