Stochastic Stabilization for Discrete-Time Markovian Jump Systems With Time-Varying Delay and Two Markov Chains Under Partly Known Transition Probabilities

This paper investigates the problem of state feedback controller design for discrete-time Markovian jump systems (MJSs) with time delay and two Markov chains under partly known transition probabilities. First, by constructing improved Lyapunov-Krasovskii functional (LKF), utilizing the properties that the sum of each row is one in a transition probability matrix and some tractable linear matrix inequalities (LMI), a sufficient condition is established such that the system under consideration is stochastically stable. Second, the design method of time-delay-dependent state feedback controller is proposed to ensure that the resulting closed-loop system is stochastically stable. Since no free matrix variables are applied under the proposed conditions, the method proposed reduce the complexity of calculations. Finally, two simulation examples are presented to show the effectiveness of the proposed method. Compared with the existing literature, in the proposed method not only the conservatism is reduced under the derived stability and stabilization conditions, but also the total number of matrix inequalities is less.

[1]  Xuerong Mao,et al.  Robust discrete-state-feedback stabilization of hybrid stochastic systems with time-varying delay based on Razumikhin technique , 2018, Statistics & Probability Letters.

[2]  Lianglin Xiong,et al.  New Stability of Markovian Jump Delayed Systems with Partially Unknown Transition Probabilities , 2012 .

[3]  Biao Huang,et al.  A new method for stabilization of networked control systems with random delays , 2005, Proceedings of the 2005, American Control Conference, 2005..

[4]  Peng Cheng,et al.  Asynchronous Output Feedback Control for a Class of Conic-Type Nonlinear Hidden Markov Jump Systems Within a Finite-Time Interval , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Hamid Reza Karimi,et al.  Fault detection for discrete-time Markov jump linear systems with partially known transition probabilities , 2010, Int. J. Control.

[6]  Robert E. Skelton,et al.  Stability tests for constrained linear systems , 2001 .

[7]  Jun Wu,et al.  Asymptotic Synchronization Control of Discrete-Time Delayed Neural Networks With a Reuse Mechanism Under Missing Data and Uncertainty , 2018, IEEE Access.

[8]  Jian-Ning Li,et al.  Exponential synchronization of discrete-time mixed delay neural networks with actuator constraints and stochastic missing data , 2016, Neurocomputing.

[9]  Junchao Ren,et al.  Sliding Mode Control of One-Sided Lipschitz Nonlinear Markovian Jump Systems With Partially Unknown Transition Rates , 2020, IEEE Access.

[10]  Xi Hongsheng,et al.  Controller design of networked control systems with two Markov chains under partly unknown transition probabilities , 2013 .

[11]  Samir Aberkane,et al.  Stochastic stabilization of a class of nonhomogeneous Markovian jump linear systems , 2011, Syst. Control. Lett..

[12]  Yang Liu,et al.  H∞ Tracking Control of Discrete-Time System With Delays via Data-Based Adaptive Dynamic Programming , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Qingling Zhang,et al.  Sliding mode control for discrete-time descriptor Markovian jump systems with two Markov chains , 2018, Optim. Lett..

[14]  Yu Zhang.  Stability of discrete-time Markovian jump delay systems with delayed impulses and partly unknown transition probabilities , 2014 .

[15]  Hao Shen,et al.  Extended passive filtering for discrete-time singular Markov jump systems with time-varying delays , 2016, Signal Process..

[16]  Hamid Reza Karimi,et al.  Finite-Time L2-Gain Asynchronous Control for Continuous-Time Positive Hidden Markov Jump Systems via T–S Fuzzy Model Approach , 2020, IEEE Transactions on Cybernetics.

[17]  Yunlu Li,et al.  $H_\infty$ Control for a Class of Discrete-Time Systems via Data-Based Policy Iteration With Application to Wind Turbine Control , 2020, IEEE Access.

[18]  Jian-Ning Li,et al.  Mean-square exponential stability for stochastic discrete-time recurrent neural networks with mixed time delays , 2015, Neurocomputing.

[19]  Zhengzhi Han,et al.  Stochastic stability and stabilization of positive systems with Markovian jump parameters , 2014 .

[20]  Yonggui Kao,et al.  Stabilization for Positive Markovian Jump Systems with Actuator Saturation , 2017, Circuits Syst. Signal Process..

[21]  Yanming Fu,et al.  Stability and Stabilization for Discrete-time Markovian Jump Stochastic Systems with Piecewise Homogeneous Transition Probabilities , 2019, International Journal of Control, Automation and Systems.

[22]  Qing-Long Han,et al.  Abel lemma-based finite-sum inequality and its application to stability analysis for linear discrete time-delay systems , 2015, Autom..

[23]  H. Trinh,et al.  Refined Jensen-based inequality approach to stability analysis of time-delay systems , 2015 .

[24]  Guanghui Sun,et al.  Guaranteed cost control for discrete-time Markovian jump linear system with time delay , 2013, Int. J. Syst. Sci..

[25]  Quanxin Zhu,et al.  Stability analysis of discrete-time semi-Markov jump linear systems with partly unknown semi-Markov kernel , 2020, Syst. Control. Lett..

[26]  James Lam,et al.  Stabilization of discrete-time Markovian jump linear systems via time-delayed controllers , 2006, Autom..

[27]  Hao Shen,et al.  HMM-Based Asynchronous Controller Design of Markovian Jumping Lur’e Systems Within a Finite-Time Interval , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Hieu Minh Trinh,et al.  Stochastic stability of nonlinear discrete-time Markovian jump systems with time-varying delay and partially unknown transition rates , 2016, Neurocomputing.

[29]  Hieu Minh Trinh,et al.  New finite-sum inequalities with applications to stability of discrete time-delay systems , 2016, Autom..

[30]  Le Van Hien,et al.  A novel approach to state bounding for discrete-time Markovian jump systems with interval time-varying delay , 2016, IMA J. Math. Control. Inf..

[31]  Min Wu,et al.  Stochastic Finite-Time H∞ State Estimation for Discrete-Time Semi-Markovian Jump Neural Networks With Time-Varying Delays , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Guoliang Wang,et al.  Stabilization of Markovian Jump Systems Via a Partially Mode-Dependent Controller of Dwell Times , 2019, IEEE Access.

[33]  Le Van Hien,et al.  Stochastic Stabilization of Discrete-Time Markov Jump Systems with Generalized Delay and Deficient Transition Rates , 2017, Circuits Syst. Signal Process..

[34]  James Lam,et al.  Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities , 2008, IEEE Transactions on Automatic Control.

[35]  Wei Wang,et al.  Adaptive fault-tolerant stabilization for nonlinear systems with Markovian jumping actuator failures and stochastic noises , 2015, Autom..

[36]  Wei Wang,et al.  Adaptive Failure Compensation Control for Uncertain Systems With Stochastic Actuator Failures , 2014, IEEE Transactions on Automatic Control.

[37]  Qingling Zhang,et al.  Stabilization for Networked Control Systems with Random Sampling Periods , 2015, J. Appl. Math..

[38]  Lixian Zhang,et al.  Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities , 2009, Autom..

[39]  Mo Yiwei.  Overview of Hybrid Dynamic System and Its Application , 2002 .