Linear Quadratic Mean Field Games: Asymptotic Solvability and Relation to the Fixed Point Approach

Mean field game theory has been developed largely following two routes. One of them, called the direct approach, starts by solving a large-scale game and next derives a set of limiting equations as the population size tends to infinity. The second route is to apply mean field approximations and formalize a fixed point problem by analyzing the best response of a representative player. This paper addresses the connection and difference of the two approaches in a linear quadratic (LQ) setting. We first introduce an asymptotic solvability notion for the direct approach, which means for all sufficiently large population sizes, the corresponding game has a set of feedback Nash strategies in addition to a mild regularity requirement. We provide a necessary and sufficient condition for asymptotic solvability and show that in this case the solution converges to a mean field limit. This is accomplished by developing a re-scaling method to derive a low-dimensional ordinary differential equation (ODE) system, where a non-symmetric Riccati ODE has a central role. We next compare with the fixed point approach which determines a two-point boundary value (TPBV) problem, and show that asymptotic solvability implies feasibility of the fixed point approach, but the converse is not true. We further address non-uniqueness in the fixed point approach and examine the long time behavior of the non-symmetric Riccati ODE in the asymptotic solvability problem.

[1]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[2]  Ji-Feng Zhang,et al.  Mean Field Games for Large-Population Multiagent Systems with Markov Jump Parameters , 2012, SIAM J. Control. Optim..

[3]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[4]  Alain Bensoussan,et al.  Linear-Quadratic Mean Field Games , 2014, Journal of Optimization Theory and Applications.

[5]  Leiba Rodman,et al.  Algebraic Riccati equations , 1995 .

[6]  George P. Papavassilopoulos,et al.  Limiting Behavior of LQ Deterministic Infinite Horizon Nash Games with Symmetric Players as the Number of Players goes to Infinity , 2014, ArXiv.

[7]  Daniela Tonon,et al.  Time-Dependent Focusing Mean-Field Games: The Sub-critical Case , 2017, 1704.04014.

[8]  Minyi Huang STOCHASTIC CONTROL FOR DISTRIBUTED SYSTEMS WITH APPLICATIONS TO WIRELESS COMMUNICATIONS , 2003 .

[9]  Markus Fischer On the connection between symmetric $N$-player games and mean field games , 2014, 1405.1345.

[10]  E. Ott,et al.  Exact results for the Kuramoto model with a bimodal frequency distribution. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Peter E. Caines,et al.  Epsilon-Nash Mean Field Game Theory for Nonlinear Stochastic Dynamical Systems with Major and Minor Agents , 2012, SIAM J. Control. Optim..

[12]  E. Ott,et al.  Low dimensional behavior of large systems of globally coupled oscillators. , 2008, Chaos.

[13]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[14]  Sonja Steffensen,et al.  Mean-field control and Riccati equations , 2015, Networks Heterog. Media.

[15]  Jean-Michel Lasry,et al.  The Master Equation and the Convergence Problem in Mean Field Games , 2019 .

[16]  P. Hartman Ordinary Differential Equations , 1965 .

[17]  Rene Carmona,et al.  A Probabilistic Approach to Mean Field Games with Major and Minor Players , 2014, 1610.05408.

[18]  Peter E. Caines,et al.  $\epsilon$-Nash Equilibria for Partially Observed LQG Mean Field Games With a Major Player , 2017, IEEE Transactions on Automatic Control.

[19]  Zhen Wu,et al.  Backward Mean-Field Linear-Quadratic-Gaussian (LQG) Games: Full and Partial Information , 2016, IEEE Transactions on Automatic Control.

[20]  P. Lions,et al.  Mean field games , 2007 .

[21]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[22]  Jacob Engwerda,et al.  Feedback Nash equilibria in the scalar infinite horizon LQ-game , 2000, Autom..

[23]  Peter E. Caines,et al.  Nash, Social and Centralized Solutions to Consensus Problems via Mean Field Control Theory , 2013, IEEE Transactions on Automatic Control.

[24]  Minyi Huang,et al.  Large-Population LQG Games Involving a Major Player: The Nash Certainty Equivalence Principle , 2009, SIAM J. Control. Optim..

[25]  L. Perko Differential Equations and Dynamical Systems , 1991 .

[26]  Martino Bardi,et al.  On non-uniqueness and uniqueness of solutions in finite-horizon Mean Field Games , 2017, ESAIM: Control, Optimisation and Calculus of Variations.

[27]  Rinel Foguen Tchuendom,et al.  Uniqueness for Linear-Quadratic Mean Field Games with Common Noise , 2018, Dyn. Games Appl..

[28]  Diogo A. Gomes,et al.  Mean Field Games Models—A Brief Survey , 2013, Dynamic Games and Applications.

[29]  P. Lions,et al.  The Master Equation and the Convergence Problem in Mean Field Games , 2015, 1509.02505.

[30]  T. Eisele Nonexistence and nonuniqueness of open-loop equilibria in linear-quadratic differential games , 1982 .

[31]  Quanyan Zhu,et al.  Risk-Sensitive Mean-Field Games , 2012, IEEE Transactions on Automatic Control.

[32]  Bruno Iannazzo,et al.  Numerical Solution of Algebraic Riccati Equations , 2012, Fundamentals of algorithms.

[33]  Eduardo D. Sontag,et al.  Mathematical control theory: deterministic finite dimensional systems (2nd ed.) , 1998 .

[34]  Alain Haurie,et al.  On the relationship between Nash - Cournot and Wardrop equilibria , 1983, Networks.

[35]  Minyi Huang,et al.  Linear Quadratic Mean Field Games -- Part I: The Asymptotic Solvability Problem , 2018, 1811.00522.

[36]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[37]  Andreu Mas-Colell,et al.  Walrasian Equilibria as Limits of Noncooperative Equilibria. Part I: Mixed Strategies* , 1983 .

[38]  Gerhard Freiling,et al.  A survey of nonsymmetric Riccati equations , 2002 .

[39]  Guilherme Carmona,et al.  Approximation and characterization of Nash equilibria of large games , 2020 .

[40]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[41]  R. Aumann Markets with a continuum of traders , 1964 .

[42]  J. Hale,et al.  Ordinary Differential Equations , 2019, Fundamentals of Numerical Mathematics for Physicists and Engineers.

[43]  R. Ştefan,et al.  Non-symmetric Riccati theory and linear quadratic Nash games , 2002 .

[44]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[45]  P. Cardaliaguet,et al.  Mean Field Games , 2020, Lecture Notes in Mathematics.

[46]  Fabio S. Priuli Linear-Quadratic $$N$$N-Person and Mean-Field Games: Infinite Horizon Games with Discounted Cost and Singular Limits , 2014, Dyn. Games Appl..

[47]  Minyi Huang,et al.  Stochastic Control of Mean Field Models with Mixed Players , 2011 .

[48]  Levon Nurbekyan,et al.  One-Dimensional Stationary Mean-Field Games with Local Coupling , 2016, Dyn. Games Appl..

[49]  Rabih Salhab,et al.  A Dynamic Game Model of Collective Choice in Multiagent Systems , 2015, IEEE Transactions on Automatic Control.

[50]  Tamer Basar,et al.  Linear-quadratic stochastic differential Stackelberg games with a high population of followers , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[51]  E. Green Continuum and Finite-Player Noncooperative Models of Competition , 1984 .

[52]  François Delarue,et al.  Probabilistic Theory of Mean Field Games with Applications I: Mean Field FBSDEs, Control, and Games , 2018 .

[53]  Wei Yang,et al.  On the Rate of Convergence for the Mean-Field Approximation of Controlled Diffusions with Large Number of Players , 2014, Dyn. Games Appl..

[54]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[55]  D. Paz'o,et al.  Low-dimensional dynamics of populations of pulse-coupled oscillators , 2013, 1305.4044.

[56]  D. Lacker A general characterization of the mean field limit for stochastic differential games , 2014, 1408.2708.