A Leader-Follower Stochastic Linear Quadratic Differential Game

A leader-follower stochastic differential game is considered with the state equation being a linear Ito-type stochastic differential equation and the cost functionals being quadratic. We allow that the coefficients of the system and those of the cost functionals are random, the controls enter the diffusion of the state equation, and the weight matrices for the controls in the cost functionals are not necessarily positive definite. The so-called open-loop strategies are considered only. Thus, the follower first solves a stochastic linear quadratic (LQ) optimal control problem with the aid of a stochastic Riccati equation. Then the leader turns to solve a stochastic LQ problem for a forward-backward stochastic differential equation. If such an LQ problem is solvable, one obtains an open-loop solution to the two-person leader-follower stochastic differential game. Moreover, it is shown that the open-loop solution admits a state feedback representation if a new stochastic Riccati equation is solvable.

[1]  T. Başar.  Contributions to the Theory of Optimal Control , 2001 .

[2]  Said Hamadène,et al.  Backward equations, stochastic control and zero-sum stochastic differential games , 1995 .

[3]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[4]  J. Bismut.  Linear Quadratic Optimal Stochastic Control with Random Coefficients , 1976 .

[5]  Akira Ichikawa.  Linear Quadratic Differential Games in a Hilbert Space , 1976 .

[6]  S. Hamadène,et al.  Nonzero sum linear–quadratic stochastic differential games and backward–forward equations , 1999 .

[7]  J. Yong,et al.  Stochastic Linear Quadratic Optimal Control Problems , 2001 .

[8]  Jiongmin Yong,et al.  Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients: Closed-Loop Representation of Open-Loop Optimal Controls , 2018 .

[9]  Huo Ying.  N-person differential games governed by semilinear stochastic evolution systems , 1991 .

[10]  Avner Friedman,et al.  Stochastic differential games , 1972 .

[11]  T. Eisele.  Nonexistence and nonuniqueness of open-loop equilibria in linear-quadratic differential games , 1982 .

[12]  Leonard D. Berkovitz.  11. A Differential Game Without Pure Strategy Solutions on an Open Set , 1964 .

[13]  A. Bensoussan.  Points de Nash Dans le Cas de Fonctionnelles Quadratiques et Jeux Differentiels lineaires a N Personnes , 1974 .

[14]  J. Lepeltier,et al.  Zero-sum stochastic differential games and backward equations , 1995 .

[15]  Situ Rong,et al.  Adapted Solutions of Backward Stochastic Evolution Equations with Jumps on Hilbert Space , 2001 .

[16]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[17]  P. Varaiya.  N-player stochastic differential games , 1976 .

[18]  R. Elliott,et al.  The Existence Of Value In Differential Games , 1972 .

[19]  Leonard D. Berkovitz,et al.  The existence of value and saddle point in games of fixed duration , 1985 .

[20]  Jiongmin Yong,et al.  Linear Forward—Backward Stochastic Differential Equations , 1999 .

[21]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[22]  W. E. Schmitendorf.  Existence of optimal open-loop strategies for a class of differential games , 1970 .

[23]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[24]  P. McLane.  Optimal stochastic control of linear systems with state- and control-dependent disturbances , 1971 .

[25]  Xudong Li.  N-person differential games governed by infinite-dimensional systems , 1986 .

[26]  E. Tarafdar,et al.  On the existence of Nash equilibrium points , 1979 .

[27]  Liping Pan,et al.  A differential game with multi-level of hierarchy , 1991 .

[28]  Kenko Uchida,et al.  On Existence of a Nash Equilibrium Point in N-Person Nonzero Sum Stochastic Differential Games , 1978 .

[29]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[30]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[31]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[32]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[33]  Andrew E. B. Lim,et al.  Linear-Quadratic Control of Backward Stochastic Differential Equations , 2001, SIAM J. Control. Optim..