Analysis of a Finite State Many Player Game Using Its Master Equation

We consider an n-player symmetric stochastic game with weak interaction between the players. Time is continuous and the horizon and the number of states are finite. We show that the value function of each of the players can be approximated by the solution of a partial differential equation called the master equation. Moreover, we analyze the fluctuations of the empirical measure of the states of the players in the game and show that it is governed by a solution to a stochastic differential equation. Finally, we prove the regularity of the master equation, which is required for the above results.

[1]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[2]  P. Protter.  Stochastic integration and differential equations , 1990 .

[3]  P. Dupuis,et al.  Large Deviation Principle For Finite-State Mean Field Interacting Particle Systems , 2016, 1601.06219.

[4]  T. Kurtz,et al.  A stochastic evolution equation arising from the fluctuations of a class of interacting particle systems , 2004 .

[5]  Francois Delarue,et al.  The Master Equation for Large Population Equilibriums , 2014, 1404.4694.

[6]  Alain Bensoussan,et al.  The Master equation in mean field theory , 2014, 1404.4150.

[7]  P. Cardaliaguet,et al.  Mean Field Games , 2020, Lecture Notes in Mathematics.

[8]  P. Lions,et al.  Mean field games , 2007 .

[9]  Daniel Lacker,et al.  Limit Theory for Controlled McKean-Vlasov Dynamics , 2016, SIAM J. Control. Optim..

[10]  D. Gomes,et al.  Continuous Time Finite State Mean Field Games , 2012, 1203.3173.

[11]  A. Krall.  Applied Analysis , 1986 .

[12]  Vassili Kolokoltsov,et al.  Sensitivity analysis for HJB equations with an application to a coupled backward-forward system , 2013, 1303.6234.

[13]  René Carmona,et al.  Probabilistic Analysis of Mean-field Games , 2013 .

[14]  R. Carmona,et al.  Finite State Mean Field Games with Major and Minor Players , 2016 .

[15]  M. Manhart,et al.  Markov Processes , 2018, Introduction to Stochastic Processes and Simulation.

[16]  Peter E. Caines,et al.  The Nash certainty equivalence principle and McKean-Vlasov systems: An invariance principle and entry adaptation , 2007, 2007 46th IEEE Conference on Decision and Control.

[17]  Markus Fischer.  On the connection between symmetric $N$-player games and mean field games , 2014, 1405.1345.

[18]  A. Budhiraja,et al.  Rate control under heavy traffic with strategic servers , 2016, The Annals of Applied Probability.

[19]  D. Lacker.  A general characterization of the mean field limit for stochastic differential games , 2014, 1408.2708.

[20]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[21]  P. Lions,et al.  The Master Equation and the Convergence Problem in Mean Field Games , 2015, 1509.02505.

[22]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[23]  Markus Fischer,et al.  Probabilistic Approach to Finite State Mean Field Games , 2017, Applied Mathematics & Optimization.