Soft-constrained robust equilibria in stochastic differential games

In this paper, infinite-horizon soft-constrained robust equilibria in stochastic differential games are investigated for the Markov jump systems governed by Itô-type stochastic differential equations with state, control and external disturbance-dependent noise. It is shown that the saddle point equilibrium under consideration is associated with the sets of cross-coupled stochastic algebraic Riccati equations (CSAREs). After studying the saddle point solution for a single decision maker case, a multiple decision making problem is considered. A necessary condition for the existence of the robust saddle point equilibrium is found. In particular, it is noteworthy that our new results completely involve some existing results on soft-constrained stochastic Nash game. Finally, a numerical example to verify the efficiency of the proposed algorithms is given.

[1]  J. Schumacher,et al.  Robust Equilibria in Indefinite Linear-Quadratic Differential Games , 2003 .

[2]  Gang Feng,et al.  Nonlinear Stochastic $H_2/H_\infty$ Control with $(x,u,v)$-Dependent Noise: Infinite Horizon Case , 2008, IEEE Transactions on Automatic Control.

[3]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[4]  Hiroaki Mukaidani,et al.  Soft-constrained stochastic Nash games for weakly coupled large-scale discrete-time systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[5]  V. Dragan,et al.  Mathematical Methods in Robust Control of Linear Stochastic Systems , 2006 .

[6]  Hiroaki Mukaidani,et al.  Soft-constrained stochastic Nash games for multimodeling systems via static output feedback strategy , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[7]  B. Anderson,et al.  A Nash game approach to mixed H/sub 2//H/sub /spl infin// control , 1994 .

[8]  Gang Feng,et al.  Technical communique: Infinite horizon H2/H∞ control for stochastic systems with Markovian jumps , 2008 .

[9]  Jacob C. Engwerda.  A Numerical Algorithm to Find Soft-Constrained Nash Equilibria in Scalar Lq-Games , 2004 .

[10]  Jitao Sun,et al.  p-Moment stability of stochastic differential equations with impulsive jump and Markovian switching , 2006, Autom..

[11]  Li Li,et al.  On necessary and sufficient conditions for H∞ output feedback control of Markov jump linear systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[12]  Li Li,et al.  On Necessary and Sufficient Conditions for ${H}_{\infty }$ Output Feedback Control of Markov Jump Linear Systems , 2007, IEEE Transactions on Automatic Control.

[13]  Hiroaki Mukaidani,et al.  Soft-constrained stochastic Nash games for weakly coupled large-scale systems , 2009, Autom..

[14]  Bor-Sen Chen,et al.  Stochastic H2/H∞ control with state-dependent noise , 2004, IEEE Trans. Autom. Control..

[15]  Yulin Huang,et al.  Infinite Horizon H2/H Control for Stochastic Systems with Markovian Jumps , 2007, 2007 American Control Conference.

[16]  Gang Feng,et al.  Nonlinear Stochastic H 2 /H ∞ Control with (x, u, v) -Dependent Noise: Infinite Horizon Case. , 2008 .

[17]  B. Anderson,et al.  A Nash game approach to mixed H2/H∞ control , 1994, IEEE Transactions on Automatic Control.

[18]  V. Dragan,et al.  The linear quadratic optimization problems for a class of linear stochastic systems with multiplicative white noise and Markovian jumping , 2004, IEEE Transactions on Automatic Control.

[19]  Xun Yu Zhou,et al.  Indefinite Stochastic Linear Quadratic Control with Markovian Jumps in Infinite Time Horizon , 2003, J. Glob. Optim..

[20]  H. Abou-Kandil,et al.  Matrix Riccati Equations in Control and Systems Theory , 2003, IEEE Transactions on Automatic Control.