Backward-forward linear-quadratic mean-field games with major and minor agents

This paper studies the backward-forward linear-quadratic-Gaussian (LQG) games with major and minor agents (players). The state of major agent follows a linear backward stochastic differential equation (BSDE) and the states of minor agents are governed by linear forward stochastic differential equations (SDEs). The major agent is dominating as its state enters those of minor agents. On the other hand, all minor agents are individually negligible but their state-average affects the cost functional of major agent. The mean-field game in such backward-major and forward-minor setup is formulated to analyze the decentralized strategies. We first derive the consistency condition via an auxiliary mean-field SDEs and a 3×2 mixed backward-forward stochastic differential equation (BFSDE) system. Next, we discuss the wellposedness of such BFSDE system by virtue of the monotonicity method. Consequently, we obtain the decentralized strategies for major and minor agents which are proved to satisfy the ε-Nash equilibrium property.

[1]  Jiongmin Yong,et al.  Optimality Variational Principle for Controlled Forward-Backward Stochastic Differential Equations with Mixed Initial-Terminal Conditions , 2010, SIAM J. Control. Optim..

[2]  Zhiyong Yu,et al.  Linear−quadratic optimal control and nonzero‐sum differential game of forward−backward stochastic system , 2012 .

[3]  Peter E. Caines,et al.  Social Optima in Mean Field LQG Control: Centralized and Decentralized Strategies , 2012, IEEE Transactions on Automatic Control.

[4]  S. Peng,et al.  Solution of forward-backward stochastic differential equations , 1995 .

[5]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[6]  F. Antonelli,et al.  Backward-Forward Stochastic Differential Equations , 1993 .

[7]  Zhen Wu,et al.  The Maximum Principles for Stochastic Recursive Optimal Control Problems Under Partial Information , 2009, IEEE Transactions on Automatic Control.

[8]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[9]  P. Lions,et al.  Mean field games , 2007 .

[10]  N. Touzi,et al.  OPTIMAL INVESTMENT UNDER RELATIVE PERFORMANCE CONCERNS , 2015 .

[11]  Zhen Wu,et al.  On well-posedness of forward-backward SDEs-A unified approach , 2011, 1110.4658.

[12]  Olivier Guéant,et al.  Mean Field Games and Applications , 2011 .

[13]  J. Yong Finding adapted solutions of forward–backward stochastic differential equations: method of continuation , 1997 .

[14]  S. Peng,et al.  Mean-field backward stochastic differential equations and related partial differential equations , 2007, 0711.2167.

[15]  Alain Bensoussan,et al.  Linear-Quadratic Mean Field Games , 2014, Journal of Optimization Theory and Applications.

[16]  Jakša Cvitanić,et al.  HEDGING OPTIONS FOR A LARGE INVESTOR AND FORWARD-BACKWARD SDE'S , 1996 .

[17]  Juan Li,et al.  Nonlinear Stochastic Differential Games Involving a Major Player and a Large Number of Collectively Acting Minor Agents , 2013, SIAM J. Control. Optim..

[18]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[19]  Boualem Djehiche,et al.  A General Stochastic Maximum Principle for SDEs of Mean-field Type , 2011 .

[20]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[21]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[22]  Marc Quincampoix,et al.  Some Recent Aspects of Differential Game Theory , 2011, Dyn. Games Appl..

[23]  P. Caines,et al.  Social optima in mean field LQG control: Centralized and decentralized strategies , 2009 .

[24]  Andrew E. B. Lim,et al.  Linear-Quadratic Control of Backward Stochastic Differential Equations , 2001, SIAM J. Control. Optim..

[25]  Minyi Huang,et al.  Linear-Quadratic-Gaussian Mixed Games with Continuum-Parametrized Minor Players , 2012, SIAM J. Control. Optim..

[26]  J. Bismut An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .

[27]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .

[28]  Minyi Huang,et al.  Large-Population LQG Games Involving a Major Player: The Nash Certainty Equivalence Principle , 2009, SIAM J. Control. Optim..

[29]  Daniel Andersson,et al.  A Maximum Principle for SDEs of Mean-Field Type , 2011 .

[30]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[31]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[32]  Zhen Wu,et al.  A general maximum principle for optimal control of forward-backward stochastic systems , 2013, Autom..

[33]  René Carmona,et al.  Probabilistic Analysis of Mean-field Games , 2013 .

[34]  Martino Bardi,et al.  Explicit solutions of some linear-quadratic mean field games , 2012, Networks Heterog. Media.

[35]  Boualem Djehiche,et al.  Mean-Field Backward Stochastic Differential Equations . A Limit Approach ∗ , 2007 .

[36]  J. Yong,et al.  Solving forward-backward stochastic differential equations explicitly — a four step scheme , 1994 .

[37]  Hai-ping Shi Backward stochastic differential equations in finance , 2010 .

[38]  Peter E. Caines,et al.  Epsilon-Nash Mean Field Game Theory for Nonlinear Stochastic Dynamical Systems with Major and Minor Agents , 2012, SIAM J. Control. Optim..