An Open-Loop Stackelberg Strategy for the Linear Quadratic Mean-Field Stochastic Differential Game

This paper is concerned with the open-loop linear–quadratic (LQ) Stackelberg game of the mean-field stochastic systems in finite horizon. By means of two generalized differential Riccati equations, the follower first solves a mean-field stochastic LQ optimal control problem. Then, the leader turns to solve an optimization problem for a linear mean-field forward–backward stochastic differential equation. By introducing new state and costate variables, we present a sufficient condition for the existence and uniqueness of the Stackelberg strategy in terms of the solvability of some Riccati equations and a convexity condition. Furthermore, it is shown that the open-loop Stackelberg equilibrium admits a feedback representation involving the new state and its mean. Finally, two examples are given to show the effectiveness of the proposed results.

[1]  Gerhard Freiling,et al.  Existence and Uniqueness of Open-Loop Stackelberg Equilibria in Linear-Quadratic Differential Games , 2001 .

[2]  B. Øksendal.  Stochastic differential equations : an introduction with applications , 1987 .

[3]  Robert Pindyck,et al.  Optimal economic stabilization policies under decentralized control and conflicting objectives , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[4]  Marc Yor,et al.  Comments on the life and mathematical legacy of Wolfgang Doeblin , 2002, Finance Stochastics.

[5]  H. Abou-Kandil,et al.  Analytical solution for an open-loop Stackelberg game , 1985 .

[6]  J. Hosking.  A Stochastic Maximum Principle for a Stochastic Differential Game of a Mean-Field Type , 2012 .

[7]  Hiroaki Mukaidani,et al.  Stackelberg strategies for stochastic systems with multiple followers , 2015, Autom..

[8]  Jiongmin Yong,et al.  A Leader-Follower Stochastic Linear Quadratic Differential Game , 2002, SIAM J. Control. Optim..

[9]  J. Cruz,et al.  On the Stackelberg strategy in nonzero-sum games , 1973 .

[10]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[11]  Tamer Basar,et al.  Linear-quadratic stochastic differential Stackelberg games with a high population of followers , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[12]  Bor-Sen Chen,et al.  Finite horizon mean-field stochastic H2/H∞ control for continuous-time systems with (x, v)-dependent noise , 2015, J. Frankl. Inst..

[13]  Alain Bensoussan,et al.  Mean Field Stackelberg Games: Aggregation of Delayed Instructions , 2015, SIAM J. Control. Optim..

[14]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[15]  Weihai Zhang,et al.  H∞ Control for Continuous‐Time Mean‐Field Stochastic Systems , 2016 .

[16]  Jiongmin Yong,et al.  Linear-Quadratic Optimal Control Problems for Mean-Field Stochastic Differential Equations , 2013, SIAM J. Control. Optim..

[17]  C. Chen,et al.  Stackelburg solution for two-person games with biased information patterns , 1972 .

[18]  Hiroaki Mukaidani,et al.  Infinite horizon linear-quadratic Stackelberg games for discrete-time stochastic systems , 2017, Autom..

[19]  Weihai Zhang,et al.  Stochastic Maximum Principle for Mean-Field Type Optimal Control Under Partial Information , 2014, IEEE Transactions on Automatic Control.

[20]  J. Yong,et al.  A Linear-Quadratic Optimal Control Problem for Mean-Field Stochastic Differential Equations in Infinite Horizon , 2012, 1208.5308.

[21]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[22]  Heinrich von Stackelberg,et al.  Stackelberg (Heinrich von) - The Theory of the Market Economy, translated from the German and with an introduction by Alan T. PEACOCK. , 1953 .

[23]  Tianyou Chai,et al.  Necessary and Sufficient Condition for Two-Player Stackelberg Strategy , 2015, IEEE Transactions on Automatic Control.

[24]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[25]  J. Cruz,et al.  Additional aspects of the Stackelberg strategy in nonzero-sum games , 1973 .

[26]  Ji-Feng Zhang,et al.  Mean Field Games for Large-Population Multiagent Systems with Markov Jump Parameters , 2012, SIAM J. Control. Optim..

[27]  Huanshui Zhang,et al.  Sufficient and Necessary Open-Loop Stackelberg Strategy for Two-Player Game With Time Delay , 2016, IEEE Transactions on Cybernetics.

[28]  Juan Li,et al.  Stochastic maximum principle in the mean-field controls , 2012, Autom..