Optimal non-pharmaceutical intervention policy for Covid-19 epidemic via neuroevolution algorithm

National responses to the Covid-19 pandemic varied markedly across countries, from business-as-usual to complete shutdowns. Policies aimed at disrupting the viral transmission cycle and preventing the healthcare system from being overwhelmed, simultaneously exact an economic toll. We developed a intervention policy model that comprised the relative human, economic and healthcare costs of non-pharmaceutical epidemic intervention and arrived at the optimal strategy using the neuroevolution algorithm. The proposed model finds the minimum required reduction in contact rates to maintain the burden on the healthcare system below the maximum capacity. We find that such a policy renders a sharp increase in the control strength at the early stages of the epidemic, followed by a steady increase in the subsequent ten weeks as the epidemic approaches its peak, and finally control strength is gradually decreased as the population moves towards herd immunity. We have also shown how such a model can provide an efficient adaptive intervention policy at different stages of the epidemic without having access to the entire history of its progression in the population. This work emphasizes the importance of imposing intervention measures early and provides insights into adaptive intervention policies to minimize the economic impacts of the epidemic without putting an extra burden on the healthcare system.

[1]  S. Merler,et al.  Baseline Characteristics and Outcomes of 1591 Patients Infected With SARS-CoV-2 Admitted to ICUs of the Lombardy Region, Italy. , 2020, JAMA.

[2]  Mi G. Chorzepa,et al.  Parameterized Fragility Assessment of Bridges Subjected to Hurricane Events Using Metamodels and Multiple Environmental Parameters , 2018 .

[3]  N. G. Davies,et al.  Effects of non-pharmaceutical interventions on COVID-19 cases, deaths, and demand for hospital services in the UK: a modelling study , 2020, The Lancet Public Health.

[4]  M. T. Sofonea,et al.  Age-structured non-pharmaceutical interventions for optimal control of COVID-19 epidemic , 2020, medRxiv.

[5]  Javad Mohammadpour,et al.  A Graph Theoretic-Based Approach for Deploying Heterogeneous Multi-agent Systems with Application in Precision Agriculture , 2020, Journal of Intelligent & Robotic Systems.

[6]  J. Maciejowski,et al.  A cost–benefit analysis of the COVID-19 disease , 2020, Oxford Review of Economic Policy.

[7]  M. Kochańczyk,et al.  Pareto-based evaluation of national responses to COVID-19 pandemic shows that saving lives and protecting economy are non-trade-off objectives , 2021, Scientific Reports.

[8]  P. Rohani,et al.  Transmission dynamics reveal the impracticality of COVID-19 herd immunity strategies , 2020, Proceedings of the National Academy of Sciences.

[9]  Stephan A. Durham,et al.  Probabilistic hurricane risk analysis of coastal bridges incorporating extreme wave statistics , 2019, Engineering Structures.

[10]  Ruiyun Li,et al.  Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2) , 2020, Science.

[11]  M. T. Sofonea,et al.  Optimal COVID-19 epidemic control until vaccine deployment , 2020, medRxiv.

[12]  Sally Blower,et al.  Modelling infectious diseases in humans and animals , 2008 .

[13]  D. Sridhar,et al.  Hindsight is 2020? Lessons in global health governance one year into the pandemic , 2021, Nature Medicine.

[14]  Pejman Rohani,et al.  Combating pertussis resurgence: One booster vaccination schedule does not fit all , 2015, Proceedings of the National Academy of Sciences.

[15]  P. Rohani,et al.  Anomalous influenza seasonality in the United States and the emergence of novel influenza B viruses , 2021, Proceedings of the National Academy of Sciences.

[16]  A. Vespignani,et al.  Evolving epidemiology and transmission dynamics of coronavirus disease 2019 outside Hubei province, China: a descriptive and modelling study , 2020, The Lancet Infectious Diseases.

[17]  Jing Zhao,et al.  Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus–Infected Pneumonia , 2020, The New England journal of medicine.

[18]  Victor Chernozhukov,et al.  Optimal Targeted Lockdowns in a Multi-Group Sir Model , 2020 .

[19]  G. Chowell,et al.  Optimal control for pandemic influenza: the role of limited antiviral treatment and isolation. , 2010, Journal of theoretical biology.

[20]  Kenneth O. Stanley,et al.  Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning , 2017, ArXiv.

[21]  Quentin J. Leclerc,et al.  The impact of non-pharmaceutical interventions on SARS-CoV-2 transmission across 130 countries and territories , 2020, BMC Medicine.

[22]  C. Donnelly,et al.  Genetic evidence for the association between COVID-19 epidemic severity and timing of non-pharmaceutical interventions , 2021, Nature Communications.

[23]  Yan Zhao,et al.  Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. , 2020, JAMA.

[24]  Anton Korinek,et al.  Covid-19 Infection Externalities: Trading Off Lives vs. Livelihoods , 2020 .

[25]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[26]  Javad Mohammadpour,et al.  A reinforcement learning‐based approach for modeling and coverage of an unknown field using a team of autonomous ground vehicles , 2021, Int. J. Intell. Syst..

[27]  G. Gao,et al.  A Novel Coronavirus from Patients with Pneumonia in China, 2019 , 2020, The New England journal of medicine.

[28]  Carl A. B. Pearson,et al.  The effect of control strategies to reduce social mixing on outcomes of the COVID-19 epidemic in Wuhan, China: a modelling study , 2020, The Lancet Public Health.

[29]  Pejman Rohani,et al.  Statistical Inference for Multi-Pathogen Systems , 2011, PLoS Comput. Biol..

[30]  T. Déirdre Hollingsworth,et al.  Mitigation Strategies for Pandemic Influenza A: Balancing Conflicting Policy Objectives , 2011, PLoS Comput. Biol..

[31]  E. Dong,et al.  An interactive web-based dashboard to track COVID-19 in real time , 2020, The Lancet Infectious Diseases.

[32]  Aaron Yelowitz,et al.  Strong Social Distancing Measures In The United States Reduced The COVID-19 Growth Rate. , 2020, Health affairs.

[33]  Christl A. Donnelly,et al.  The impact of COVID-19 and strategies for mitigation and suppression in low- and middle-income countries , 2020, Science.

[34]  T. Hollingsworth,et al.  How will country-based mitigation measures influence the course of the COVID-19 epidemic? , 2020, The Lancet.

[35]  Y. Teh,et al.  Inferring the effectiveness of government interventions against COVID-19 , 2020, Science.

[36]  M. L. Chambers The Mathematical Theory of Optimal Processes , 1965 .

[37]  Xi Chen,et al.  Evolution Strategies as a Scalable Alternative to Reinforcement Learning , 2017, ArXiv.