Early warning signal reliability varies with COVID-19 waves

Early warning signals (EWSs) aim to predict changes in complex systems from phenomenological signals in time series data. These signals have recently been shown to precede the emergence of disease outbreaks, offering hope that policymakers can make predictive rather than reactive management decisions. Here, using a novel, sequential analysis in combination with daily COVID-19 case data across 24 countries, we suggest that composite EWSs consisting of variance, autocorrelation and skewness can predict nonlinear case increases, but that the predictive ability of these tools varies between waves based upon the degree of critical slowing down present. Our work suggests that in highly monitored disease time series such as COVID-19, EWSs offer the opportunity for policymakers to improve the accuracy of urgent intervention decisions but best characterize hypothesized critical transitions.

[1]  D. Borsboom,et al.  Overlapping timescales obscure early warning signals of the second COVID-19 wave , 2021, Proceedings of the Royal Society B.

[2]  K. Bibby,et al.  Making waves: Plausible lead time for wastewater based epidemiology as an early warning system for COVID-19 , 2021, Water Research.

[3]  C. Clements,et al.  Early warning signals predict emergence of COVID-19 waves , 2021, medRxiv.

[4]  M. Salit,et al.  Testing at scale during the COVID-19 pandemic , 2021, Nature Reviews Genetics.

[5]  S. Sharif,et al.  Prediction of COVID-19 Waves Using Social Media and Google Search: A Case Study of the US and Canada , 2021, Frontiers in Public Health.

[6]  C. Donnelly,et al.  Genetic evidence for the association between COVID-19 epidemic severity and timing of non-pharmaceutical interventions , 2021, Nature Communications.

[7]  M. Coccia The relation between length of lockdown, numbers of infected people and deaths of Covid-19, and economic growth of countries: Lessons learned to cope with future pandemics similar to Covid-19 and to constrain the deterioration of economic system , 2021, Science of The Total Environment.

[8]  P. Cairney The UK government’s COVID-19 policy: assessing evidence-informed policy analysis in real time , 2020, British Politics.

[9]  Trevor Bedford,et al.  Cryptic transmission of SARS-CoV-2 in Washington state , 2020, Science.

[10]  G. Stoker,et al.  Trust and the Coronavirus Pandemic: What are the Consequences of and for Trust? An Early Review of the Literature , 2020, Political studies review.

[11]  M. Jalali,et al.  Transparency assessment of COVID-19 models , 2020, The Lancet Global Health.

[12]  T. Hale,et al.  Global Assessment of the Relationship between Government Response Measures and COVID-19 Deaths , 2020, medRxiv.

[13]  S. Bhatt,et al.  Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe , 2020, Nature.

[14]  Peter C. Jentsch,et al.  Conditions for a Second Wave of COVID-19 Due to Interactions Between Disease Dynamics and Social Processes , 2020, Frontiers in Physics.

[15]  C. Buckee,et al.  Wrong but Useful - What Covid-19 Epidemiologic Models Can and Cannot Tell Us. , 2020, The New England journal of medicine.

[16]  S. Wood,et al.  COVID-19 and the difficulty of inferring epidemiological parameters from clinical data , 2020, The Lancet Infectious Diseases.

[17]  Gabriel G. Katul,et al.  Global convergence of COVID-19 basic reproduction number and estimation from early-time SIR dynamics , 2020, medRxiv.

[18]  M. Jolly,et al.  Anticipating the Novel Coronavirus Disease (COVID-19) Pandemic , 2020, Frontiers in Public Health.

[19]  Elisa Franco,et al.  The challenges of modeling and forecasting the spread of COVID-19 , 2020, Proceedings of the National Academy of Sciences.

[20]  Trevor Bedford,et al.  Cryptic transmission of SARS-CoV-2 in Washington state , 2020, Science.

[21]  Michael J. Tildesley,et al.  Prospects for detecting early warning signals in discrete event sequence data: Application to epidemiological incidence data , 2020, bioRxiv.

[22]  Carl A. B. Pearson,et al.  The effect of control strategies to reduce social mixing on outcomes of the COVID-19 epidemic in Wuhan, China: a modelling study , 2020, The Lancet Public Health.

[23]  Ruiyun Li,et al.  Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2) , 2020, Science.

[24]  S. Hay,et al.  Early warning signals of malaria resurgence in Kericho, Kenya , 2020, Biology Letters.

[25]  John J. Grefenstette,et al.  Detecting critical slowing down in high-dimensional epidemiological systems , 2020, PLoS Comput. Biol..

[26]  T. Hollingsworth,et al.  How will country-based mitigation measures influence the course of the COVID-19 epidemic? , 2020, The Lancet.

[27]  Robin N. Thompson,et al.  Will an outbreak exceed available resources for control? Estimating the risk from invading pathogens using practical definitions of a severe epidemic , 2019, Journal of the Royal Society Interface.

[28]  John M Drake,et al.  The statistics of epidemic transitions , 2019, PLoS Comput. Biol..

[29]  Christopher F Clements,et al.  Early warning signals of recovery in complex systems , 2019, Nature Communications.

[30]  Manfred Füllsack,et al.  Systematically false positives in early warning signal analysis , 2019, PloS one.

[31]  W. Sutherland,et al.  When can we trust population trends? Quantifying the effects of sampling interval and duration , 2018, bioRxiv.

[32]  Karen C. Abbott,et al.  Robustness of early warning signals for catastrophic and non‐catastrophic transitions , 2018 .

[33]  Éric Marty,et al.  Anticipating epidemic transitions with imperfect data , 2018, PLoS Comput. Biol..

[34]  Karen C. Abbott,et al.  Robustness of early warning signals for catastrophic and non-catastrophic transitions , 2017, bioRxiv.

[35]  Paige B. Miller,et al.  Forecasting infectious disease emergence subject to seasonal forcing , 2017, Theoretical Biology and Medical Modelling.

[36]  Arpat Ozgul,et al.  Body size shifts and early warning signals precede the historic collapse of whale stocks , 2017, Nature Ecology &Evolution.

[37]  J. Drake,et al.  Waiting time to infectious disease emergence , 2016, Journal of The Royal Society Interface.

[38]  Arpat Ozgul,et al.  Including trait-based early warning signals helps predict population collapse , 2016, Nature Communications.

[39]  Chaeshin Chu,et al.  The Characteristics of Middle Eastern Respiratory Syndrome Coronavirus Transmission Dynamics in South Korea , 2016, Osong Public Health and Research Perspectives.

[40]  Suzanne M. O’Regan,et al.  Leading indicators of mosquito-borne disease elimination , 2015, Theoretical Ecology.

[41]  Arpat Ozgul,et al.  Factors Influencing the Detectability of Early Warning Signals of Population Collapse , 2015, The American Naturalist.

[42]  S. Carpenter,et al.  Resilience indicators: prospects and limitations for early warnings of regime shifts , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  John M. Drake,et al.  Theory of early warning signals of disease emergenceand leading indicators of elimination , 2013, Theoretical Ecology.

[44]  James O. Lloyd-Smith,et al.  Inference of R 0 and Transmission Heterogeneity from the Size Distribution of Stuttering Chains , 2013, PLoS Comput. Biol..

[45]  M. Scheffer,et al.  Early warning signals also precede non-catastrophic transitions , 2013 .

[46]  C. Howard,et al.  Emerging virus diseases: can we ever expect the unexpected? , 2012, Emerging Microbes & Infections.

[47]  S. Carpenter,et al.  Methods for Detecting Early Warnings of Critical Transitions in Time Series Illustrated Using Simulated Ecological Data , 2012, PloS one.

[48]  M. Scheffer,et al.  Robustness of variance and autocorrelation as indicators of critical slowing down. , 2012, Ecology.

[49]  S. Carpenter,et al.  Early Warnings of Regime Shifts: A Whole-Ecosystem Experiment , 2011, Science.

[50]  S. Wood Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models , 2011 .

[51]  J. Drake,et al.  Early warning signals of extinction in deteriorating environments , 2010, Nature.

[52]  S. Carpenter,et al.  Early-warning signals for critical transitions , 2009, Nature.

[53]  Kate E. Jones,et al.  Global trends in emerging infectious diseases , 2008, Nature.

[54]  A. Fauci,et al.  The challenge of emerging and re-emerging infectious diseases , 2004, Nature.

[55]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .