Lattice approximations of the first-order mean field type differential games

The theory of first-order mean field type differential games examines the systems of infinitely many identical agents interacting via some external media under assumption that each agent is controlled by two players. We study the approximations of the value function of the first-order mean field type differential game using solutions of model finite-dimensional differential games. The model game appears as a mean field type continuous time Markov game, i.e., the game theoretical problem with the infinitely many agents and dynamics of each agent determined by a controlled finite state nonlinear Markov chain. Given a supersolution (resp. subsolution) of the Hamilton-Jacobi equation for the model game, we construct a suboptimal strategy of the first (resp. second) player and evaluate the approximation accuracy using the modulus of continuity of the reward function and the distance between the original and model games. This gives the approximations of the value function of the mean field type differential game by values of the finite-dimensional differential games. Furthermore, we present the way to build a finite-dimensional differential game that approximates the original game with a given accuracy.

[1]  V. Kolokoltsov Nonlinear Markov Processes and Kinetic Equations , 2010 .

[2]  Huyên Pham,et al.  Dynamic Programming for Optimal Control of Stochastic McKean-Vlasov Dynamics , 2016, SIAM J. Control. Optim..

[3]  R. Carmona,et al.  Forward-Backward Stochastic Differential Equations and Controlled McKean Vlasov Dynamics , 2013, 1303.5835.

[4]  Daniel Andersson,et al.  A Maximum Principle for SDEs of Mean-Field Type , 2011 .

[5]  Fabio S. Priuli,et al.  Generalized Control Systems in the Space of Probability Measures , 2018 .

[6]  Tamer Basar,et al.  Zero-sum differential games on the Wasserstein space , 2019, Commun. Inf. Syst..

[7]  L. Ambrosio,et al.  Gradient Flows: In Metric Spaces and in the Space of Probability Measures , 2005 .

[8]  Y. Averboukh A stability property in mean field type differential games , 2019, Journal of Mathematical Analysis and Applications.

[9]  A. Sznitman Topics in propagation of chaos , 1991 .

[10]  Wilfrid Gangbo,et al.  Finite Dimensional Approximations of Hamilton-Jacobi-Bellman Equations in Spaces of Probability Measures , 2021, SIAM J. Math. Anal..

[11]  M. Falcone,et al.  Semi-Lagrangian Approximation Schemes for Linear and Hamilton-Jacobi Equations , 2014 .

[12]  T. Başar,et al.  Zero-Sum Differential Games on Probability Spaces: Hamilton-Jacobi-Isaacs Equations and Viscosity Solutions , 2019, 1912.06084.

[13]  Yurii Averboukh,et al.  Krasovskii–Subbotin Approach to Mean Field Type Differential Games , 2018, Dynamic Games and Applications.

[14]  Daniel Lacker,et al.  Limit Theory for Controlled McKean-Vlasov Dynamics , 2016, SIAM J. Control. Optim..

[15]  M. Quincampoix,et al.  Mayer control problem with probabilistic uncertainty on initial positions , 2018 .

[16]  H. Pham,et al.  Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics , 2016, 1606.08204.

[17]  P. Caines,et al.  Nash Equilibria for Large-Population Linear Stochastic Systems of Weakly Coupled Agents , 2005 .

[18]  M. Quincampoix,et al.  Optimal control of multiagent systems in the Wasserstein space , 2020, Calculus of Variations and Partial Differential Equations.

[19]  Huyen Pham,et al.  Zero-sum stochastic differential games of generalized McKean–Vlasov type , 2018, Journal de Mathématiques Pures et Appliquées.

[20]  Boualem Djehiche,et al.  A General Stochastic Maximum Principle for SDEs of Mean-field Type , 2011 .

[21]  H. Pham,et al.  Bellman equation and viscosity solutions for mean-field stochastic control problem , 2015, 1512.07866.

[22]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[23]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[24]  Antonio Marigonda,et al.  Time-Optimal Control Problem in the Space of Probability Measures , 2015, LSSC.

[25]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[26]  Yurii Averboukh,et al.  Approximate Solutions of Continuous-Time Stochastic Games , 2016, SIAM J. Control. Optim..

[27]  M. Sion On general minimax theorems , 1958 .

[28]  A. I. Subbotin Generalized Solutions of First Order PDEs , 1995 .

[29]  O. Pironneau,et al.  Dynamic programming for mean-field type control , 2014 .

[30]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[31]  Kim C. Border,et al.  Infinite Dimensional Analysis: A Hitchhiker’s Guide , 1994 .

[32]  P. Lions,et al.  Jeux à champ moyen. II – Horizon fini et contrôle optimal , 2006 .

[33]  Boualem Djehiche,et al.  Optimal Control and Zero-Sum Stochastic Differential Game Problems of Mean-Field Type , 2016, Applied Mathematics & Optimization.

[34]  V. Kolokoltsov Markov Processes, Semigroups and Generators , 2011 .

[35]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[36]  Maurizio Falcone,et al.  Numerical Methods for differential Games Based on Partial differential equations , 2006, IGTR.