Optimal incentives to mitigate epidemics: a Stackelberg mean field game approach

Motivated by models of epidemic control in large populations, we consider a Stackelberg mean field game model between a principal and a mean field of agents evolving on a finite state space. The agents play a non-cooperative game in which they can control their transition rates between states to minimize an individual cost. The principal can influence the resulting Nash equilibrium through incentives so as to optimize its own objective. We analyze this game using a probabilistic approach. We then propose an application to an epidemic model of SIR type in which the agents control their interaction rate and the principal is a regulator acting with non pharmaceutical interventions. To compute the solutions, we propose an innovative numerical approach based on Monte Carlo simulations and machine learning tools for stochastic optimization. We conclude with numerical experiments by illustrating the impact of the agents' and the regulator's optimal decisions in two models: a basic SIR model with semi-explicit solutions and in a complex model which incorporates more states.

[2]  Erhan Bayraktar,et al.  A Numerical Scheme for a Mean Field Game in Some Queueing Systems Based on Markov Chain Approximation Method , 2017, SIAM J. Control. Optim..

[3]  Alain Bensoussan,et al.  Mean Field Stackelberg Games: Aggregation of Delayed Instructions , 2015, SIAM J. Control. Optim..

[4]  T. Kurtz Approximation of Population Processes , 1987 .

[5]  Boualem Djehiche,et al.  The Principal-Agent Problem; A Stochastic Maximum Principle Approach , 2014, 1410.6392.

[6]  P. Lions,et al.  Jeux à champ moyen. II – Horizon fini et contrôle optimal , 2006 .

[7]  Hamidou Tembine,et al.  Controlling Propagation of epidemics via mean-field games , 2020, 2006.01249.

[8]  Markus Fischer,et al.  Probabilistic Approach to Finite State Mean Field Games , 2017, Applied Mathematics & Optimization.

[9]  M. Laurière,et al.  Backward propagation of chaos , 2019, Electronic Journal of Probability.

[10]  Romuald Elie,et al.  Contact rate epidemic control of COVID-19: an equilibrium view , 2020, Mathematical Modelling of Natural Phenomena.

[11]  Yuliy Sannikov A Continuous-Time Version of the Principal-Agent , 2005 .

[12]  Superlinear Drivers,et al.  7 – Backward Stochastic Differential Equations , 2011 .

[13]  Jaksa Cvitanic,et al.  Dynamic programming approach to principal–agent problems , 2015, Finance Stochastics.

[14]  Samuel Cho Mean-Field Game Analysis of SIR Model with Social Distancing , 2020, 2005.06758.

[15]  Peiqi Wang,et al.  Finite-State Contract Theory with a Principal and a Field of Agents , 2018, Manag. Sci..

[16]  Gabriel Turinici,et al.  Individual Vaccination as Nash Equilibrium in a SIR Model with Application to the 2009–2010 Influenza A (H1N1) Epidemic in France , 2015, Bulletin of Mathematical Biology.

[17]  Ronnie Sircar,et al.  Bertrand and Cournot Mean Field Games , 2015 .

[18]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[19]  Gabriel Turinici,et al.  Nash-MFG equilibrium in a SIR model with time dependent newborn vaccination , 2018 .

[20]  D. Gomes,et al.  Discrete Time, Finite State Space Mean Field Games , 2010 .

[21]  Salah Eddine Choutri,et al.  Mean-field risk sensitive control and zero-sum games for Markov chains , 2018, Bulletin des Sciences Mathématiques.

[22]  Xavier Warin,et al.  Incentives, lockdown, and testing: from Thucydides's analysis to the COVID-19 pandemic , 2020 .

[23]  Paul R. Milgrom,et al.  AGGREGATION AND LINEARITY IN THE PROVISION OF INTERTEMPORAL INCENTIVES , 1987 .

[24]  V. Kolokoltsov Nonlinear Markov Games on a Finite State Space (Mean-field and Binary Interactions) , 2012 .

[25]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[26]  Bruno Gaujal,et al.  A MEAN FIELD GAME ANALYSIS OF SIR DYNAMICS WITH VACCINATION , 2020, Probability in the Engineering and Informational Sciences.

[27]  Romuald Elie,et al.  COVID-19 pandemic control: balancing detection policy and lockdown intervention under ICU sustainability , 2020, medRxiv.

[28]  Roland P. Malhamé,et al.  A Dynamic Collective Choice Model with an Advertiser , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[29]  Hamidou Tembine,et al.  A Stochastic Maximum Principle for Markov Chains of Mean-Field Type , 2018, Games.

[30]  Hamidou Tembine,et al.  Optimal Control and Zero-Sum Games for Markov Chains of Mean-Field Type , 2016, Mathematical Control & Related Fields.

[31]  Ziad Kobeissi,et al.  On classical solutions to the mean field game system of controls , 2019, Communications in Partial Differential Equations.

[32]  H. Tembine,et al.  COVID-19: A Data-Driven Mean-Field-Type Game Perspective , 2020, medRxiv.

[33]  Peiqi Wang,et al.  A Probabilistic Approach to Extended Finite State Mean Field Games , 2018, Math. Oper. Res..

[34]  Romuald Elie,et al.  A Tale of a Principal and Many, Many Agents , 2016, Math. Oper. Res..

[35]  R. Carmona,et al.  Finite State Mean Field Games with Major and Minor Players , 2016 .

[36]  Gabriel Turinici,et al.  Equilibrium in an individual - societal SIR vaccination model in presence of discounting and finite vaccination capacity , 2016 .

[37]  Yuliy Sannikov Advances in Economics and Econometrics: Contracts: The Theory of Dynamic Principal–Agent Relationships and the Continuous-Time Approach , 2013 .

[38]  Francesco Salvarani,et al.  Optimal individual strategies for influenza vaccines with imperfect efficacy and durability of protection. , 2018, Mathematical biosciences and engineering : MBE.

[39]  Mathieu Laurière,et al.  Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games: I - The Ergodic Case , 2019, The Annals of Applied Probability.

[40]  Erhan Bayraktar,et al.  Analysis of a Finite State Many Player Game Using Its Master Equation , 2017, SIAM J. Control. Optim..

[41]  Diogo A. Gomes,et al.  On the existence of classical solutions for stationary extended mean field games , 2013, 1305.2696.