How Robust are the Estimated Effects of Nonpharmaceutical Interventions against COVID-19?

To what extent are effectiveness estimates of nonpharmaceutical interventions (NPIs) against COVID-19 influenced by the assumptions our models make? To answer this question, we investigate 2 state-of-the-art NPI effectiveness models and propose 6 variants that make different structural assumptions. In particular, we investigate how well NPI effectiveness estimates generalise to unseen countries, and their sensitivity to unobserved factors. Models that account for noise in disease transmission compare favourably. We further evaluate how robust estimates are to different choices of epidemiological parameters and data. Focusing on models that assume transmission noise, we find that previously published results are robust across these choices and across different models. Finally, we mathematically ground the interpretation of NPI effectiveness estimates when certain common assumptions do not hold.

[1]  D. Rubin,et al.  Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome , 1983 .

[2]  D. Mackinnon,et al.  Equivalence of the Mediation, Confounding and Suppression Effect , 2000, Prevention Science.

[3]  M. Lipsitch,et al.  How generation intervals shape the relationship between growth rates and reproductive numbers , 2007, Proceedings of the Royal Society B: Biological Sciences.

[4]  A. Gelman,et al.  Causal inference using regression on the treatment variable , 2020, Regression and Other Stories.

[5]  C. Fraser.  Estimating Individual and Household Reproduction Numbers in an Emerging Epidemic , 2007, PloS one.

[6]  Joseph Hilbe,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2009 .

[7]  Aki Vehtari,et al.  Understanding predictive information criteria for Bayesian models , 2013, Statistics and Computing.

[8]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[9]  John Salvatier,et al.  Probabilistic programming in Python using PyMC3 , 2016, PeerJ Comput. Sci..

[10]  G. Collins,et al.  Handling time varying confounding in observational research , 2017, British Medical Journal.

[11]  Wes Hinsley,et al.  A simple approach to measure transmissibility and forecast incidence , 2017, Epidemics.

[12]  Johannes Zierenberg,et al.  Inferring change points in the spread of COVID-19 reveals the effectiveness of interventions , 2020, Science.

[13]  Luna Yue Huang,et al.  The effect of large-scale anti-contagion policies on the COVID-19 pandemic , 2020, Nature.

[14]  Diana Kwon.  How swamped preprint servers are blocking bad coronavirus research , 2020, Nature.

[15]  A. Rinaldo,et al.  Assessing the impact of non-pharmaceutical interventions on SARS-CoV-2 transmission in Switzerland. , 2020, Swiss medical weekly.

[16]  Nuno R. Faria,et al.  The effect of human mobility and control measures on the COVID-19 epidemic in China , 2020, medRxiv.

[17]  Causal inference using regression on the treatment variable , 2020, Regression and Other Stories.

[18]  S. Bhatt,et al.  Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe , 2020, Nature.

[19]  N. Banholzer,et al.  Impact of non-pharmaceutical interventions on documented cases of COVID-19 , 2020, medRxiv.

[20]  Y. Teh,et al.  The effectiveness and perceived burden of nonpharmaceutical interventions against COVID-19 transmission: a modelling study with 41 countries , 2020, medRxiv.

[21]  T. Hale,et al.  Oxford COVID-19 Government Response Tracker , 2020 .

[22]  A. Rinaldo,et al.  Spread and dynamics of the COVID-19 epidemic in Italy: Effects of emergency containment measures , 2020, Proceedings of the National Academy of Sciences.

[23]  Xiaohui Chen,et al.  Scenario analysis of non-pharmaceutical interventions on global COVID-19 transmissions , 2020, 2004.04529.

[24]  Quentin J. Leclerc,et al.  The impact of non-pharmaceutical interventions on SARS-CoV-2 transmission across 130 countries and territories , 2020, BMC Medicine.

[25]  J. Naudé,et al.  Worldwide Effectiveness of Various Non-Pharmaceutical Intervention Control Strategies on the Global COVID-19 Pandemic: A Linearised Control Model , 2020, medRxiv.

[26]  Bernhard Schölkopf,et al.  A Spatiotemporal Epidemic Model to Quantify the Effects of Contact Tracing, Testing, and Containment , 2020, ArXiv.

[27]  D. Brockmann,et al.  Effective containment explains subexponential growth in recent confirmed COVID-19 cases in China , 2020, Science.

[28]  R. D'Agostino,et al.  Physical distancing interventions and incidence of coronavirus disease 2019: natural experiment in 149 countries , 2020, BMJ.

[29]  Y. Teh,et al.  The effectiveness of eight nonpharmaceutical interventions against COVID-19 in 41 countries , 2020 .

[30]  A. Rinaldo,et al.  Assessing the impact of non-pharmaceutical interventions on SARS-CoV-2 transmission in Switzerland. , 2020, Swiss medical weekly.

[31]  G. Barbastathis,et al.  Neural Network aided quarantine control model estimation of global Covid-19 spread , 2020, 2004.02752.

[32]  Quentin J. Leclerc,et al.  Quantifying the impact of physical distance measures on the transmission of COVID-19 in the UK , 2020, BMC Medicine.

[33]  Nuno R. Faria,et al.  The effect of human mobility and control measures on the COVID-19 epidemic in China , 2020, Science.