On the predictability of infectious disease outbreaks

Infectious disease outbreaks recapitulate biology: they emerge from the multi-level interaction of hosts, pathogens, and environment. Therefore, outbreak forecasting requires an integrative approach to modeling. While specific components of outbreaks are predictable, it remains unclear whether fundamental limits to outbreak prediction exist. Here, adopting permutation entropy as a model independent measure of predictability, we study the predictability of a diverse collection of outbreaks and identify a fundamental entropy barrier for disease time series forecasting. However, this barrier is often beyond the time scale of single outbreaks, implying prediction is likely to succeed. We show that forecast horizons vary by disease and that both shifting model structures and social network heterogeneity are likely mechanisms for differences in predictability. Our results highlight the importance of embracing dynamic modeling approaches, suggest challenges for performing model selection across long time series, and may relate more broadly to the predictability of complex adaptive systems.Forecasting of infectious disease outbreaks can inform appropriate intervention measures, but whether fundamental limits to accurate prediction exist is unclear. Here, the authors use permutation entropy as a model independent measure of predictability to study limitations across a broad set of infectious diseases.

[1]  M. Newman,et al.  Network theory and SARS: predicting outbreak diversity , 2004, Journal of Theoretical Biology.

[2]  M E J Newman,et al.  Predicting epidemics on directed contact networks. , 2006, Journal of theoretical biology.

[3]  A. Politi Quantifying the Dynamical Complexity of Chaotic Time Series. , 2016, Physical review letters.

[4]  B. Grenfell,et al.  Forecasting Epidemiological and Evolutionary Dynamics of Infectious Diseases. , 2016, Trends in ecology & evolution.

[5]  C. Viboud,et al.  Using Phenomenological Models to Characterize Transmissibility and Forecast Patterns and Final Burden of Zika Epidemics , 2016, PLoS currents.

[6]  C. Dye,et al.  Modeling the SARS Epidemic , 2003, Science.

[7]  Shawn T. Brown,et al.  Contagious diseases in the United States from 1888 to the present. , 2013, The New England journal of medicine.

[8]  Alessandro Vespignani,et al.  Opinion: Mathematical models: A key tool for outbreak response , 2014, Proceedings of the National Academy of Sciences.

[9]  E. Nsoesie,et al.  A Simulation Optimization Approach to Epidemic Forecasting , 2013, PloS one.

[10]  Alessandro Vespignani,et al.  The role of the airline transportation network in the prediction and predictability of global epidemics , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[11]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[12]  L. Meyers Contact network epidemiology: Bond percolation applied to infectious disease prediction and control , 2006 .

[13]  Gerardo Chowell,et al.  The RAPIDD ebola forecasting challenge: Synthesis and lessons learnt. , 2017, Epidemics.

[14]  Alain Barrat,et al.  Simplicial Activity Driven Model. , 2018, Physical review letters.

[15]  Anil Vullikanti,et al.  Using data-driven agent-based models for forecasting emerging infectious diseases. , 2017, Epidemics.

[16]  V. Colizza,et al.  Shifting patterns of seasonal influenza epidemics , 2018, Scientific Reports.

[17]  Samuel V. Scarpino,et al.  Modelling the trajectory of disease outbreaks works , 2018, Nature.

[18]  Alessandro Vespignani,et al.  Real-Time Assessment of the International Spreading Risk Associated with the 2014 West African Ebola Outbreak , 2016 .

[19]  Xin Lu,et al.  Population mobility reductions associated with travel restrictions during the Ebola epidemic in Sierra Leone: use of mobile phone data , 2018, International journal of epidemiology.

[20]  Joshua A. Grochow,et al.  Optimal high-level descriptions of dynamical systems , 2014 .

[21]  Paola Velardi,et al.  Results from the centers for disease control and prevention’s predict the 2013–2014 Influenza Season Challenge , 2016, BMC Infectious Diseases.

[22]  R. Eggo,et al.  Real-time forecasting of infectious disease dynamics with a stochastic semi-mechanistic model , 2016, Epidemics.

[23]  Luciano Zunino,et al.  Permutation entropy based time series analysis: Equalities in the input signal can lead to false conclusions , 2017 .

[24]  Owen L. Petchey,et al.  The intrinsic predictability of ecological time series and its potential to guide forecasting , 2018, bioRxiv.

[25]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[26]  Evan L. Ray,et al.  Prediction of infectious disease epidemics via weighted density ensembles , 2017, PLoS Comput. Biol..

[27]  Éric Marty,et al.  Anticipating epidemic transitions with imperfect data , 2018, PLoS Comput. Biol..

[28]  Daniela Perrotta,et al.  Social Data Mining and Seasonal Influenza Forecasts: The FluOutlook Platform , 2015, ECML/PKDD.

[29]  J. Hyman,et al.  Mathematical and Statistical Modeling for Emerging and Re-emerging Infectious Diseases , 2016 .

[30]  Jean-Paul Chretien,et al.  Advancing Epidemic Prediction and Forecasting: A New US Government Initiative , 2015, Online Journal of Public Health Informatics.

[31]  Joshua Garland,et al.  Anomaly Detection in Paleoclimate Records Using Permutation Entropy , 2018, Entropy.

[32]  C. Viboud,et al.  Urbanization and humidity shape the intensity of influenza epidemics in U.S. cities , 2018, Science.

[33]  Gerardo Chowell,et al.  Big Data for Infectious Disease Surveillance and Modeling. , 2016, The Journal of infectious diseases.

[34]  Bruno Gonçalves,et al.  Modeling and Predicting Human Infectious Diseases , 2015, Social Phenomena.

[35]  F. B. Davy,et al.  Synthesis and Lessons Learned , 2010 .

[36]  Kenth Engø-Monsen,et al.  Impact of human mobility on the emergence of dengue epidemics in Pakistan , 2015, Proceedings of the National Academy of Sciences.

[37]  Alessandro Vespignani,et al.  Predictability and epidemic pathways in global outbreaks of infectious diseases: the SARS case study , 2007, BMC medicine.

[38]  Andreas M. Brandmaier,et al.  pdc: An R package for complexity-based clustering of time series [Computer software] , 2015 .

[39]  Derek A T Cummings,et al.  Challenges in Real-Time Prediction of Infectious Disease: A Case Study of Dengue in Thailand , 2016, PLoS neglected tropical diseases.

[40]  Theodoros G. Soldatos,et al.  Correction: Corrigendum: Src activation by β-adrenoreceptors is a key switch for tumour metastasis , 2013, Nature Communications.

[41]  Badong Chen,et al.  Weighted-permutation entropy: a complexity measure for time series incorporating amplitude information. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  A. King,et al.  The impact of past vaccination coverage and immunity on pertussis resurgence , 2018, Science Translational Medicine.

[43]  Vito Latora,et al.  Understanding mobility in a social petri dish , 2011, Scientific Reports.

[44]  John S. Brownstein,et al.  Evaluating the performance of infectious disease forecasts: A comparison of climate-driven and seasonal dengue forecasts for Mexico , 2016, Scientific Reports.

[45]  T. Geisel,et al.  Forecast and control of epidemics in a globalized world. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[46]  S. Hay,et al.  Changing Geographic Patterns and Risk Factors for Avian Influenza A(H7N9) Infections in Humans, China , 2018, Emerging infectious diseases.

[47]  Ming Tang,et al.  Effects of weak ties on epidemic predictability on community networks , 2012, Chaos.

[48]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[49]  Paige B. Miller,et al.  Forecasting infectious disease emergence subject to seasonal forcing , 2017, Theoretical Biology and Medical Modelling.

[50]  J. Drake,et al.  Waiting time to infectious disease emergence , 2016, Journal of The Royal Society Interface.

[51]  R. Ostfeld,et al.  Climate Change and Infectious Diseases: From Evidence to a Predictive Framework , 2013, Science.

[52]  Alicia Karspeck,et al.  Real-Time Influenza Forecasts during the 2012–2013 Season , 2013, Nature Communications.

[53]  Joshua Garland,et al.  Model-free quantification of time-series predictability. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Alessandro Vespignani,et al.  Prediction and predictability of global epidemics: the role of the airline transportation network , 2005, q-bio/0507029.

[55]  E. Holmes,et al.  Pandemics: spend on surveillance, not prediction , 2018, Nature.

[56]  G. Bedoya,et al.  Developmental pathways inferred from modularity, morphological integration and fluctuating asymmetry patterns in the human face , 2018, Scientific Reports.

[57]  Monica F. Myers,et al.  Forecasting disease risk for increased epidemic preparedness in public health. , 2000, Advances in parasitology.

[58]  R. Pastor-Satorras,et al.  Activity driven modeling of time varying networks , 2012, Scientific Reports.

[59]  D. Watts,et al.  Multiscale, resurgent epidemics in a hierarchical metapopulation model. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Ronald Rosenfeld,et al.  Flexible Modeling of Epidemics with an Empirical Bayes Framework , 2014, PLoS Comput. Biol..

[61]  B. Grenfell,et al.  Comparative dynamics, seasonality in transmission, and predictability of childhood infections in Mexico , 2016, Epidemiology and Infection.

[62]  M. C. Soriano,et al.  Distinguishing chaotic and stochastic dynamics from time series by using a multiscale symbolic approach. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[63]  Gerardo Chowell,et al.  Perspectives on model forecasts of the 2014–2015 Ebola epidemic in West Africa: lessons and the way forward , 2017, BMC Medicine.

[64]  Reid Priedhorsky,et al.  Epidemic Forecasting is Messier Than Weather Forecasting: The Role of Human Behavior and Internet Data Streams in Epidemic Forecast. , 2016, The Journal of infectious diseases.