Stackelberg Strategy for Uncertain Markov Jump Delay Stochastic Systems

In this letter, a robust Stackelberg game for a class of uncertain Markov jump delay stochastic systems (UMJDSSs) is investigated. After introducing some definitions and preliminaries, we derive the conditions for the existence of a robust Stackelberg strategy set by means of cross coupled stochastic bilinear matrix inequalities (CCSBMIs), such that the upper bound of each decision maker’s cost function is minimized. To overcome difficulties in solving the CCSBMIs, a feasible numerical algorithm based on the Krasnoselskii iteration sequence is proposed, which consists of linear matrix inequalities and cross coupled stochastic matrix equations (CCSMEs). It is shown that the weakly convergence property is attained. Finally, a practical example is solved to demonstrate the effectiveness and efficiency of the proposed scheme.

[1]  Puduru Viswanadha Reddy,et al.  Pareto optimality in infinite horizon linear quadratic differential games , 2013, Autom..

[2]  Ian R. Petersen,et al.  Optimal guaranteed cost control of uncertain systems via static and dynamic output feedback , 1996, Autom..

[3]  Hiroaki Mukaidani.  Robust Nash Equilibrium Strategy for Uncertain Markov Jump Linear Stochastic Systems , 2018, 2018 Annual American Control Conference (ACC).

[4]  Toru Yamamoto,et al.  Nash strategy for Markov jump stochastic delay systems , 2013, 52nd IEEE Conference on Decision and Control.

[5]  X. Mao,et al.  Stochastic differential delay equations with Markovian switching , 2000 .

[6]  El-Kébir Boukas,et al.  Stochastic Switching Systems: Analysis and Design , 2005 .

[7]  Yi Shen,et al.  A note on the existence and uniqueness of mild solutions to neutral stochastic partial functional differential equations with non-Lipschitz coefficients , 2011, Comput. Math. Appl..

[8]  Magdi S. Mahmoud,et al.  Robust stability, stabilization and H-infinity control of time-delay systems with Markovian jump parameters , 2003 .

[9]  Bor-Sen Chen,et al.  Stochastic H2/H∞ control with state-dependent noise , 2004, IEEE Trans. Autom. Control..

[10]  Lee H. Keel,et al.  Feedback Stabilization of Markov Jump Linear Systems with Time-Varying Delay , 2008 .

[11]  Yang Shi,et al.  Robust stochastic stability and delayed-state-feedback stabilisation of uncertain Markovian jump linear systems with random time delays , 2015 .

[12]  Weihua Zhuang,et al.  Robust Nash Static Output Feedback Strategy for Uncertain Markov Jump Delay Stochastic Systems , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[13]  James Lam,et al.  Robust H∞ control of uncertain Markovian jump systems with time-delay , 2000, IEEE Trans. Autom. Control..

[14]  Hiroaki Mukaidani,et al.  Robust Pareto Suboptimal Strategy for Uncertain Markov Jump Linear Stochastic Systems with Multiple Decision Makers , 2018, 2018 Annual American Control Conference (ACC).

[15]  Emilia Fridman,et al.  Introduction to Time-Delay Systems: Analysis and Control , 2014 .

[16]  D. Ross.  Controller design for time lag systems via a quadratic criterion , 1971 .

[17]  S. Reich.  Weak convergence theorems for nonexpansive mappings in Banach spaces , 1979 .

[18]  Keith J. Burnham,et al.  On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters , 2002, IEEE Trans. Autom. Control..

[19]  Huabin Chen,et al.  Delayed-state-feedback exponential stabilization for uncertain Markovian jump systems with mode-dependent time-varying state delays , 2012 .

[20]  M. Mahmoud,et al.  Robust stability, stabilization and ℋ∞ control of time‐delay systems with Markovian jump parameters , 2003 .

[21]  Huanshui Zhang,et al.  Sufficient and Necessary Open-Loop Stackelberg Strategy for Two-Player Game With Time Delay , 2016, IEEE Transactions on Cybernetics.