Explicit solutions of some linear-quadratic mean field games

We consider $N$-person differential games involving linear systems affected by white noise, running cost quadratic in the control and in the displacement of the state from a reference position, and with long-time-average integral cost functional. We solve an associated system of Hamilton-Jacobi-Bellman and Kolmogorov-Fokker-Planck equations and find explicit Nash equilibria in the form of linear feedbacks. Next we compute the limit as the number $N$ of players goes to infinity, assuming they are almost identical and with suitable scalings of the parameters. This provides a quadratic-Gaussian solution to a system of two differential equations of the kind introduced by Lasry and Lions in the theory of Mean Field Games [22]. Under a natural normalization the uniqueness of this solution depends on the sign of a single parameter. We also discuss some singular limits, such as vanishing noise, cheap control, vanishing discount. Finally, we compare the L-Q model with other Mean Field models of population distribution.

[1]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[2]  A. Lachapelle,et al.  COMPUTATION OF MEAN FIELD EQUILIBRIA IN ECONOMICS , 2010 .

[3]  Yves Achdou,et al.  Mean Field Games: Numerical Methods , 2010, SIAM J. Numer. Anal..

[4]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[5]  R. Aumann Markets with a continuum of traders , 1964 .

[6]  Yves Achdou,et al.  Mean Field Games: Numerical Methods for the Planning Problem , 2012, SIAM J. Control. Optim..

[7]  M. Bardi,et al.  Ergodic Problems in Differential Games , 2007 .

[8]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[9]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[10]  R. Khasminskii Stochastic Stability of Differential Equations , 1980 .

[11]  P. Cardaliaguet,et al.  Mean Field Games , 2020, Lecture Notes in Mathematics.

[12]  P. Lions,et al.  Jeux à champ moyen. II – Horizon fini et contrôle optimal , 2006 .

[13]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[14]  Jacob Engwerda,et al.  LQ Dynamic Optimization and Differential Games , 2005 .

[15]  Olivier Guéant,et al.  A reference case for mean field games models , 2009 .

[16]  Alain Bensoussan,et al.  Regularity Results for Nonlinear Elliptic Systems and Applications , 2002 .

[17]  Olivier Guéant,et al.  Mean Field Games and Applications , 2011 .

[18]  Peter E. Caines,et al.  An Invariance Principle in Large Population Stochastic Dynamic Games , 2007, J. Syst. Sci. Complex..

[19]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[20]  D. Gomes,et al.  Discrete Time, Finite State Space Mean Field Games , 2010 .

[21]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[22]  Martino Bardi,et al.  Ergodicity, Stabilization, and Singular Perturbations for Bellman-Isaacs Equations , 2010 .

[23]  P. Lions,et al.  Mean field games , 2007 .