Forecasting national and regional influenza-like illness for the USA

Health planners use forecasts of key metrics associated with influenza-like illness (ILI); near-term weekly incidence, week of season onset, week of peak, and intensity of peak. Here, we describe our participation in a weekly prospective ILI forecasting challenge for the United States for the 2016-17 season and subsequent evaluation of our performance. We implemented a metapopulation model framework with 32 model variants. Variants differed from each other in their assumptions about: the force-of-infection (FOI); use of uninformative priors; the use of discounted historical data for not-yet-observed time points; and the treatment of regions as either independent or coupled. Individual model variants were chosen subjectively as the basis for our weekly forecasts; however, a subset of coupled models were only available part way through the season. Most frequently, during the 2016-17 season, we chose; FOI variants with both school vacations and humidity terms; uninformative priors; the inclusion of discounted historical data for not-yet-observed time points; and coupled regions (when available). Our near-term weekly forecasts substantially over-estimated incidence early in the season when coupled models were not available. However, our forecast accuracy improved in absolute terms and relative to other teams once coupled solutions were available. In retrospective analysis, we found that the 2016-17 season was not typical: on average, coupled models performed better when fit without historically augmented data. Also, we tested a simple ensemble model for the 2016-17 season and found that it underperformed our subjective choice for all forecast targets. In this study, we were able to improve accuracy during a prospective forecasting exercise by coupling dynamics between regions. Although reduction of forecast subjectivity should be a long-term goal, some degree of human intervention is likely to improve forecast accuracy in the medium-term in parallel with the systematic consideration of more sophisticated ensemble approaches.

[1]  Erick A. Perez Alday,et al.  A New Algorithm to Diagnose Atrial Ectopic Origin from Multi Lead ECG Systems - Insights from 3D Virtual Human Atria and Torso , 2015, PLoS Comput. Biol..

[2]  Alessandro Vespignani,et al.  Real-time numerical forecast of global epidemic spreading: case study of 2009 A/H1N1pdm , 2012, BMC Medicine.

[3]  pNuha Algarzaep.  Zika virus outbreak , 2019 .

[4]  David C. Farrow,et al.  Results from the second year of a collaborative effort to forecast influenza seasons in the United States. , 2018, Epidemics.

[5]  Dylan B. George,et al.  Early Characterization of the Severity and Transmissibility of Pandemic Influenza Using Clinical Episode Data from Multiple Populations , 2015, PLoS Comput. Biol..

[6]  Jeffrey Shaman,et al.  Counteracting structural errors in ensemble forecast of influenza outbreaks , 2017, Nature Communications.

[7]  Sen Pei,et al.  Forecasting the spatial transmission of influenza in the United States , 2018, Proceedings of the National Academy of Sciences.

[8]  J. D. Tarpley,et al.  The multi‐institution North American Land Data Assimilation System (NLDAS): Utilizing multiple GCIP products and partners in a continental distributed hydrological modeling system , 2004 .

[9]  Erhan Bilal,et al.  Improving Breast Cancer Survival Analysis through Competition-Based Multidimensional Modeling , 2013, PLoS Comput. Biol..

[10]  Alicia Karspeck,et al.  Comparison of Filtering Methods for the Modeling and Retrospective Forecasting of Influenza Epidemics , 2014, PLoS Comput. Biol..

[11]  S. Schappert,et al.  Ambulatory care visits to physician offices, hospital outpatient departments, and emergency departments: United States, 1997. , 1997, Vital and health statistics. Series 13, Data from the National Health Survey.

[12]  Evan L. Ray,et al.  Prediction of infectious disease epidemics via weighted density ensembles , 2017, PLoS Comput. Biol..

[13]  K. Mo,et al.  Continental-scale water and energy flux analysis and validation for the North American Land Data Assimilation System project phase 2 (NLDAS-2): 1. Intercomparison and application of model products , 2012 .

[14]  Evan L. Ray,et al.  Infectious disease prediction with kernel conditional density estimation , 2017, Statistics in medicine.

[15]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[16]  M. Chan-yeung,et al.  A cluster of cases of severe acute respiratory syndrome in Hong Kong. , 2003, The New England journal of medicine.

[17]  S. Riley,et al.  Identifying factors that may improve mechanistic forecasting models for influenza , 2017, bioRxiv.

[18]  Cécile Viboud,et al.  Reassessing Google Flu Trends Data for Detection of Seasonal and Pandemic Influenza: A Comparative Epidemiological Study at Three Geographic Scales , 2013, PLoS Comput. Biol..

[19]  Ronald Rosenfeld,et al.  Nonmechanistic forecasts of seasonal influenza with iterative one-week-ahead distributions , 2018, PLoS Comput. Biol..

[20]  F. Ellis McKenzie,et al.  Influenza Forecasting in Human Populations: A Scoping Review , 2014, PloS one.

[21]  S. Sardi,et al.  Zika Virus Outbreak, Bahia, Brazil , 2015, Emerging infectious diseases.

[22]  A. H. Murphy,et al.  Probability Forecasting in Meteorology , 1984 .

[23]  B. Hanratty,et al.  Coping with winter bed crises , 1999, BMJ.

[24]  Daniela Perrotta,et al.  Forecasting Seasonal Influenza Fusing Digital Indicators and a Mechanistic Disease Model , 2017, WWW.

[25]  Bryan T Grenfell,et al.  Multiannual forecasting of seasonal influenza dynamics reveals climatic and evolutionary drivers , 2014, Proceedings of the National Academy of Sciences.

[26]  Jeffrey Shaman,et al.  Forecasting Influenza Outbreaks in Boroughs and Neighborhoods of New York City , 2016, PLoS Comput. Biol..

[27]  J. McCaw,et al.  Retrospective forecasting of the 2010–2014 Melbourne influenza seasons using multiple surveillance systems , 2016, Epidemiology and Infection.

[28]  R. Moss,et al.  Model selection for seasonal influenza forecasting , 2017, Infectious Disease Modelling.

[29]  Philip Polgreen,et al.  Optimal Screening Strategies for Healthcare Associated Infections in a Multi-Institutional Setting , 2014, PLoS Comput. Biol..

[30]  Robert Schechter,et al.  Swine influenza A (H1N1) infection in two children--Southern California, March-April 2009. , 2009, MMWR. Morbidity and mortality weekly report.

[31]  A. H. Murphy,et al.  A comparative evaluation of objective and subjective weather forecasts in the united states , 1984 .

[32]  Harriet L. Mills,et al.  The Spatial Resolution of Epidemic Peaks , 2014, PLoS Comput. Biol..