Mean square stability for systems on stochastically generated discrete time scales

Abstract We consider dynamic systems which evolve on discrete time domains where the time steps form a sequence of independent, identically distributed random variables. In particular, we classify the mean-square stability of linear systems on these time domains using quadratic Lyapunov functionals. In the case where the system matrix is a function of the time step, our results agree with and generalize stability results found in the Markov jump linear systems literature. In the case where the system matrix is constant, our results generalize, illuminate, and extend to the stochastic realm results in the field of dynamic equations on time scales. In order to help see the factors that contribute to stability, we prove a sufficient condition for the solvability of the Lyapunov equation by appealing to a fixed point theorem of Ran and Reurings. Finally, an example using observer-based feedback control is presented to demonstrate the utility of the results to control engineers who cannot guarantee uniform timing of the system.

[1]  J. J. Dacunha.  Stability for time varying linear dynamic systems on time scales , 2005 .

[2]  Christiaan Heij,et al.  Introduction to mathematical systems theory , 1997 .

[3]  Robert J. Marks,et al.  Linear state feedback stabilisation on time scales , 2009, 0910.3034.

[4]  Michael Defoort,et al.  Stability analysis of a class of switched linear systems on non-uniform time domains , 2014, Syst. Control. Lett..

[5]  Michael Defoort,et al.  Stability analysis of a class of uncertain switched systems on time scale using Lyapunov functions , 2015 .

[6]  R. P. Marques,et al.  Discrete-Time Markov Jump Linear Systems , 2004, IEEE Transactions on Automatic Control.

[7]  Mohamed Ali Hammami,et al.  State feedback stabilization of a class of uncertain nonlinear systems on non-uniform time domains , 2016, Syst. Control. Lett..

[8]  Panos J. Antsaklis,et al.  Stability of model-based networked control systems with time-varying transmission times , 2004, IEEE Transactions on Automatic Control.

[9]  S. V. Babenko.  Revisiting the theory of stability on time scales of the class of linear systemswith structural perturbations , 2011 .

[10]  A. Peterson,et al.  Dynamic Equations on Time Scales: An Introduction with Applications , 2001 .

[11]  Michael Defoort,et al.  Consensus for linear multi-agent system with intermittent information transmissions using the time-scale theory , 2016, Int. J. Control.

[12]  H. Kushner.  Introduction to stochastic control , 1971 .

[13]  A. Peterson,et al.  Advances in Dynamic Equations on Time Scales , 2012 .

[14]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[15]  Martin Bohner,et al.  The Kalman filter for linear systems on time scales , 2013 .

[16]  Anatoly A. Martynyuk,et al.  Stability Theory for Dynamic Equations on Time Scales , 2016 .

[17]  A. A. Martynyuk,et al.  Nonlinear Dynamic Inequalities and Stability Quasilinear Systems on Time Scales , 2017 .

[18]  M. Fragoso,et al.  A New Approach to Linearly Perturbed Riccati Equations Arising in Stochastic Control , 1998 .

[19]  Panos J. Antsaklis,et al.  Linear Systems , 1997 .

[20]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[21]  H. Abou-Kandil,et al.  Matrix Riccati Equations in Control and Systems Theory , 2003, IEEE Transactions on Automatic Control.

[22]  Fabian R. Wirth,et al.  Stability radii for positive linear time-invariant systems on time scales , 2010, Syst. Control. Lett..

[23]  Alessandro Astolfi,et al.  Stability of Dynamical Systems - Continuous, Discontinuous, and Discrete Systems (by Michel, A.N. et al.; 2008) [Bookshelf] , 2007, IEEE Control Systems.

[24]  S. Siegmund,et al.  Exponential Stability of Linear Time-Invariant Systems on Time Scales , 2009 .

[25]  V. Dragan,et al.  The linear quadratic optimization problems for a class of linear stochastic systems with multiplicative white noise and Markovian jumping , 2004, IEEE Transactions on Automatic Control.

[26]  Robert J. Marks,et al.  CONTROLLABILITY, OBSERVABILITY, REALIZABILITY, AND STABILITY OF DYNAMIC LINEAR SYSTEMS , 2009, 0901.3764.

[27]  T. Gard,et al.  ASYMPTOTIC BEHAVIOR OF NATURAL GROWTH ON TIME SCALES , 2003 .

[28]  M. Bohner,et al.  Controllability and observability of time-invariant linear dynamic systems , 2012 .

[29]  Zbigniew Bartosiewicz,et al.  Linear positive control systems on time scales; controllability , 2012, Mathematics of Control, Signals, and Systems.

[30]  Fabian R. Wirth,et al.  A spectral characterization of exponential stability for linear time-invariant systems on time scales , 2003 .

[31]  John M. Davis,et al.  A unified Floquet theory for discrete, continuous, and hybrid periodic linear systems , 2009, 0901.3841.

[32]  John M. Davis,et al.  Optimal Control on Stochastic Time Scales , 2017 .

[33]  M. Rashford,et al.  Exponential Stability of Dynamic Equations on Time Scales , 2022 .

[34]  Zbigniew Bartosiewicz.  Positive Reachability and Observability of Linear Positive Time-Variant Systems on Non-Uniform Time Domains * *Supported by the Bialystok University of Technology grant S/WI/1/2016 , 2017 .

[35]  Zbigniew Bartosiewicz,et al.  On stabilisability of nonlinear systems on time scales , 2013, Int. J. Control.

[36]  A. Ran,et al.  A fixed point theorem in partially ordered sets and some applications to matrix equations , 2003 .

[37]  Do Duc Thuan,et al.  Stability radius of implicit dynamic equations with constant coefficients on time scales , 2011, Syst. Control. Lett..

[38]  John M. Davis,et al.  STABILITY OF SIMULTANEOUSLY TRIANGULARIZABLE SWITCHED SYSTEMS ON HYBRID DOMAINS , 2014 .

[39]  John M. Davis,et al.  Switched linear systems on time scales with relaxed commutativity constraints , 2011, 2011 IEEE 43rd Southeastern Symposium on System Theory.