Discrete-Time Ergodic Mean-Field Games with Average Reward on Compact Spaces

We present a model of discrete-time mean-field game with compact state and action spaces and average reward. Under some strong ergodicity assumption, we show it possesses a stationary mean-field equilibrium. We present an example showing that in general an equilibrium for this game may not be a good approximation of Nash equilibria of the n -person stochastic game counterparts of the mean-field game for large n . Finally, we identify two cases when the approximation is good.

[1]  A. Biswas.  PR ] 3 0 O ct 2 01 5 MEAN FIELD GAMES WITH ERGODIC COST FOR DISCRETE TIME MARKOV , 2015 .

[2]  D. Bernhardt,et al.  Anonymous sequential games: Existence and characterization of equilibria , 1995 .

[3]  Hiroyoshi Mitake,et al.  Existence for stationary mean-field games with congestion and quadratic Hamiltonians , 2015 .

[4]  I. Glicksberg.  A FURTHER GENERALIZATION OF THE KAKUTANI FIXED POINT THEOREM, WITH APPLICATION TO NASH EQUILIBRIUM POINTS , 1952 .

[5]  Pierre Cardaliaguet,et al.  Long Time Average of First Order Mean Field Games and Weak KAM Theory , 2013, Dyn. Games Appl..

[6]  Pierre-Louis Lions,et al.  Long time average of mean field games , 2012, Networks Heterog. Media.

[7]  Kim C. Border,et al.  Infinite Dimensional Analysis: A Hitchhiker’s Guide , 1994 .

[8]  Pierre-Louis Lions,et al.  Long Time Average of Mean Field Games with a Nonlocal Coupling , 2013, SIAM J. Control. Optim..

[9]  Eitan Altman,et al.  Stationary Anonymous Sequential Games with Undiscounted Rewards , 2011, Journal of Optimization Theory and Applications.

[10]  Yves Achdou,et al.  Mean Field Games: Numerical Methods , 2010, SIAM J. Numer. Anal..

[11]  Ari Arapostathis,et al.  On Solutions of Mean Field Games with Ergodic Cost , 2015, 1510.08900.

[12]  Martino Bardi,et al.  Nonlinear elliptic systems and mean-field games , 2016 .

[13]  Ermal Feleqi.  The Derivation of Ergodic Mean Field Game Equations for Several Populations of Players , 2013, Dyn. Games Appl..

[14]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[15]  Luciano Campi,et al.  $N$-player games and mean-field games with absorption , 2016, The Annals of Applied Probability.

[16]  J. Krawczyk,et al.  Games and Dynamic Games , 2012 .

[17]  D. Bernhardt,et al.  Anonymous sequential games with aggregate uncertainty , 1992 .

[18]  Edgard A. Pimentel,et al.  Regularity for second order stationary mean-field games , 2015, 1503.06445.

[19]  Dante Kalise,et al.  Proximal Methods for Stationary Mean Field Games with Local Couplings , 2016, SIAM J. Control. Optim..

[20]  Fabio S. Priuli,et al.  Linear-Quadratic N-person and Mean-Field Games with Ergodic Cost , 2014, SIAM J. Control. Optim..

[21]  S. Shankar Sastry,et al.  Infinite-horizon average-cost Markov decision process routing games , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[22]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[23]  François Delarue,et al.  Probabilistic Theory of Mean Field Games with Applications I: Mean Field FBSDEs, Control, and Games , 2018 .

[24]  Subir K. Chakrabarti,et al.  Pure strategy Markov equilibrium in stochastic games with a continuum of players , 2003 .

[25]  Diogo A. Gomes,et al.  On the existence of classical solutions for stationary extended mean field games , 2013, 1305.2696.

[26]  Ramesh Johari,et al.  Mean Field Equilibrium in Dynamic Games with Strategic Complementarities , 2013, Oper. Res..

[27]  O. Hernández-Lerma,et al.  Discrete-time Markov control processes , 1999 .

[28]  P. Lions,et al.  Mean field games , 2007 .

[29]  K. Hinderer,et al.  Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter , 1970 .

[30]  Tamer Basar,et al.  Markov-Nash equilibria in mean-field games with discounted cost , 2016, 2017 American Control Conference (ACC).

[31]  Marco Cirant,et al.  Stationary focusing mean-field games , 2016, 1602.04231.

[32]  Ermal Feleqi,et al.  Ergodic mean field games with Hörmander diffusions , 2018, Calculus of Variations and Partial Differential Equations.

[33]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[34]  Diogo A. Gomes,et al.  Mean Field Games Models—A Brief Survey , 2013, Dynamic Games and Applications.

[35]  Emmanuel Boissard.  Simple Bounds for the Convergence of Empirical and Occupation Measures in 1-Wasserstein Distance , 2011, 1103.3188.

[36]  R. M. Dudley,et al.  Real Analysis and Probability , 1989 .

[37]  Alpár Richárd Mészáros,et al.  On the Variational Formulation of Some Stationary Second-Order Mean Field Games Systems , 2017, SIAM J. Math. Anal..

[38]  Marco Cirant,et al.  Multi-population Mean Field Games systems with Neumann boundary conditions , 2015 .

[39]  Xun Li,et al.  Discrete time mean-field stochastic linear-quadratic optimal control problems , 2013, Autom..

[40]  Diogo Gomes,et al.  Two Numerical Approaches to Stationary Mean-Field Games , 2015, Dynamic Games and Applications.

[41]  R. Rosenthal,et al.  Anonymous sequential games , 1988 .