Asymptotic stability in the distribution of nonlinear stochastic systems with semi-Markovian switching

abstract In this paper, finite phase semi-Markov processes are introduced. By introducing variables and a simple transformation, every finite phase semi-Markov process can be transformed to a finite Markov chain which is called its associated Markov chain. A consequence of this is that every phase semi-Markovian switching system may be equivalently expressed as its associated Markovian switching system. Existing results for Markovian switching systems may then be applied to analyze phase semi-Markovian switching systems. In the following, we obtain asymptotic stability for the distribution of nonlinear stochastic systems with semi-Markovian switching. The results can also be extended to general semi-Markovian switching systems. Finally, an example is given to illustrate the feasibility and effectiveness of the theoretical results obtained.

[1]  B. Sengupta.  Matrix geometric solutions in stochastic models , 1987 .

[2]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[3]  K. Loparo,et al.  Stability and control of discrete-time jump linear systems , 1991 .

[4]  Peng Shi,et al.  Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay , 1999, IEEE Trans. Autom. Control..

[5]  Y. Ji.  Jump linear quadratic Gaussian control : Steady-state solution and testable conditions , 1990 .

[6]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[7]  X. Mao,et al.  Asymptotic stability in distribution of stochastic differential equations with Markovian switching , 2003 .

[8]  W. Fleming,et al.  An Optimal Stochastic Production Planning Problem with Randomly Fluctuating Demand , 1987 .

[9]  Robert J. Elliott,et al.  Control of a hybrid conditionally linear Gaussian process , 1992 .

[10]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[11]  A. Skorokhod.  Asymptotic Methods in the Theory of Stochastic Differential Equations , 2008 .

[12]  F. G. Foster,et al.  A distribution model : applicable to economics , 1955 .

[13]  E. Boukas,et al.  H∞-Control for Markovian Jumping Linear Systems with Parametric Uncertainty , 1997 .

[14]  M. Fragoso,et al.  Stability Results for Discrete-Time Linear Systems with Markovian Jumping Parameters , 1993 .

[15]  Sing Kiong Nguang,et al.  Robust disturbance attenuation for discrete‐time active fault tolerant control systems with uncertainties , 2003 .

[16]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[17]  Peng Shi,et al.  Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters , 1999, IEEE Trans. Autom. Control..

[18]  Xuerong Mao,et al.  Stability in distribution of stochastic differential delay equations with Markovian switching , 2003, Syst. Control. Lett..

[19]  Éva Gyurkovics,et al.  Quadratic stabilisation with H∞-norm bound of non-linear discrete-time uncertain systems with bounded control , 2003, Syst. Control. Lett..