Cemracs 2017: numerical probabilistic approach to MFG

This project investigates numerical methods for solving fully coupled forward-backward stochastic differential equations (FBSDEs) of McKean-Vlasov type. Having numerical solvers for such mean field FBSDEs is of interest because of the potential application of these equations to optimization problems over a large population, say for instance mean field games (MFG) and optimal mean field control problems. Theory for this kind of problems has met with great success since the early works on mean field games by Lasry and Lions, see \cite{Lasry_Lions}, and by Huang, Caines, and Malham\'{e}, see \cite{Huang}. Generally speaking, the purpose is to understand the continuum limit of optimizers or of equilibria (say in Nash sense) as the number of underlying players tends to infinity. When approached from the probabilistic viewpoint, solutions to these control problems (or games) can be described by coupled mean field FBSDEs, meaning that the coefficients depend upon the own marginal laws of the solution. In this note, we detail two methods for solving such FBSDEs which we implement and apply to five benchmark problems. The first method uses a tree structure to represent the pathwise laws of the solution, whereas the second method uses a grid discretization to represent the time marginal laws of the solutions. Both are based on a Picard scheme; importantly, we combine each of them with a generic continuation method that permits to extend the time horizon (or equivalently the coupling strength between the two equations) for which the Picard iteration converges.

[1]  Hiroyoshi Mitake,et al.  Existence for stationary mean-field games with congestion and quadratic Hamiltonians , 2015 .

[2]  Games with Exhaustible Resources , 2010 .

[3]  R. Carmona,et al.  Control of McKean–Vlasov dynamics versus mean field games , 2012, 1210.5771.

[4]  Dan Crisan,et al.  Numerical method for FBSDEs of McKean–Vlasov type , 2017, The Annals of Applied Probability.

[5]  Yves Achdou,et al.  Convergence of a Finite Difference Scheme to Weak Solutions of the System of Partial Differential Equations Arising in Mean Field Games , 2015, SIAM J. Numer. Anal..

[6]  B. Bouchard,et al.  Discrete-time approximation and Monte-Carlo simulation of backward stochastic differential equations , 2004 .

[7]  Jean-David Benamou,et al.  Augmented Lagrangian Methods for Transport Optimization, Mean Field Games and Degenerate Elliptic Equations , 2015, J. Optim. Theory Appl..

[8]  Marie-Therese Wolfram,et al.  On a mean field game approach modeling congestion and aversion in pedestrian crowds , 2011 .

[9]  Diogo A. Gomes,et al.  Extended mean field games - formulation, existence, uniqueness and examples , 2013 .

[10]  René Carmona,et al.  Probabilistic Analysis of Mean-field Games , 2013 .

[11]  Peter E. Caines,et al.  Mean Field Analysis of Controlled Cucker-Smale Type Flocking: Linear Analysis and Perturbation Equations , 2011 .

[12]  Diogo A. Gomes,et al.  Mean Field Games Models—A Brief Survey , 2013, Dynamic Games and Applications.

[13]  Ronnie Sircar,et al.  Fracking, Renewables, and Mean Field Games , 2017, SIAM Rev..

[14]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[15]  Olivier Guéant,et al.  New numerical methods for mean field games with quadratic costs , 2012, Networks Heterog. Media.

[16]  Yves Achdou,et al.  Mean Field Games: Numerical Methods , 2010, SIAM J. Numer. Anal..

[17]  Peter E. Caines,et al.  Synthesis of Cucker-Smale type flocking via Mean Field stochastic control theory: Nash equilibria , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[18]  Y. Achdou,et al.  Mean Field Type Control with Congestion , 2015, Applied Mathematics & Optimization.

[19]  F. Delarue On the existence and uniqueness of solutions to FBSDEs in a non-degenerate case , 2002 .

[20]  Yu. V. Prokhorov Convergence of Random Processes and Limit Theorems in Probability Theory , 1956 .

[21]  R. Carmona,et al.  Finite State Mean Field Games with Major and Minor Players , 2016 .

[22]  R. Carmona,et al.  Mean Field Games and Systemic Risk , 2013, 1308.2172.

[23]  Yves Achdou,et al.  Mean Field Games: Convergence of a Finite Difference Method , 2012, SIAM J. Numer. Anal..

[24]  P. Cardaliaguet,et al.  Mean field game of controls and an application to trade crowding , 2016, 1610.09904.

[25]  J. Chassagneux,et al.  Numerical simulation of quadratic BSDEs , 2013, 1307.5741.

[26]  A. Lachapelle,et al.  COMPUTATION OF MEAN FIELD EQUILIBRIA IN ECONOMICS , 2010 .

[27]  D. Crisan,et al.  A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria , 2014, Memoirs of the American Mathematical Society.