A Numerical Scheme for a Mean Field Game in Some Queueing Systems Based on Markov Chain Approximation Method

We use the Markov chain approximation method to construct approximations for the solution of the mean field game (MFG) with reflecting barriers studied in Bayraktar, Budhiraja, and Cohen (2017). The MFG is formulated in terms of a controlled reflected diffusion with a cost function that depends on the reflection terms in addition to the standard variables: state, control, and the mean field term. This MFG arises from the asymptotic analysis of an $N$-player game for single server queues with strategic servers. By showing that our scheme is an almost contraction, we establish the convergence of this numerical scheme over a small time interval.

[1]  Francois Delarue,et al.  The Master Equation for Large Population Equilibriums , 2014, 1404.4694.

[2]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[3]  P. Cardaliaguet,et al.  Mean Field Games , 2020, Lecture Notes in Mathematics.

[4]  Julien Salomon,et al.  A monotonic method for nonlinear optimal control problems with concave dependence on the state , 2011, Int. J. Control.

[5]  Olivier Gu'eant,et al.  Mean field games equations with quadratic Hamiltonian: a specific approach , 2011, 1106.3269.

[6]  Dan Crisan,et al.  Numerical method for FBSDEs of McKean–Vlasov type , 2017, The Annals of Applied Probability.

[7]  P. Lions,et al.  The Master Equation and the Convergence Problem in Mean Field Games , 2015, 1509.02505.

[8]  Elisabetta Carlini,et al.  A Semi-Lagrangian scheme for a degenerate second order Mean Field Game system , 2014, 1404.5932.

[9]  S. Shreve,et al.  An explicit formula for the Skorokhod map on [0,a]. , 2007, 0710.2977.

[10]  D. Gomes,et al.  Continuous Time Finite State Mean Field Games , 2012, 1203.3173.

[11]  P. Lions,et al.  Mean field games , 2007 .

[12]  Kim C. Border,et al.  Infinite Dimensional Analysis: A Hitchhiker’s Guide , 1994 .

[13]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[14]  Daniel Lacker,et al.  Mean field games via controlled martingale problems: Existence of Markovian equilibria , 2014, 1404.2642.

[15]  A. Lachapelle,et al.  COMPUTATION OF MEAN FIELD EQUILIBRIA IN ECONOMICS , 2010 .

[16]  Elisabetta Carlini,et al.  A Fully Discrete Semi-Lagrangian Scheme for a First Order Mean Field Game Problem , 2012, SIAM J. Numer. Anal..

[17]  Olivier Guéant,et al.  Mean Field Games and Applications , 2011 .

[18]  A. Budhiraja,et al.  Rate control under heavy traffic with strategic servers , 2016, The Annals of Applied Probability.

[19]  D. Lacker.  A general characterization of the mean field limit for stochastic differential games , 2014, 1408.2708.

[20]  Yves Achdou,et al.  Mean Field Games: Convergence of a Finite Difference Method , 2012, SIAM J. Numer. Anal..

[21]  René Carmona,et al.  Probabilistic Analysis of Mean-field Games , 2013 .

[22]  Yves Achdou,et al.  Mean Field Games: Numerical Methods , 2010, SIAM J. Numer. Anal..

[23]  Olivier Guéant,et al.  New numerical methods for mean field games with quadratic costs , 2012, Networks Heterog. Media.

[24]  R. Carmona,et al.  A probabilistic weak formulation of mean field games and applications , 2013, 1307.1152.

[25]  Peter E. Caines,et al.  The Nash certainty equivalence principle and McKean-Vlasov systems: An invariance principle and entry adaptation , 2007, 2007 46th IEEE Conference on Decision and Control.

[26]  Markus Fischer.  On the connection between symmetric $N$-player games and mean field games , 2014, 1405.1345.

[27]  Yves Achdou,et al.  Convergence of a Finite Difference Scheme to Weak Solutions of the System of Partial Differential Equations Arising in Mean Field Games , 2015, SIAM J. Numer. Anal..