Influenza Forecasting with Google Flu Trends

Objective We sought to develop a practical influenza forecast model, based on real-time, geographically focused, and easy to access data, to provide individual medical centers with advanced warning of the number of influenza cases, thus allowing sufficient time to implement an intervention. Secondly, we evaluated how the addition of a real-time influenza surveillance system, Google Flu Trends, would impact the forecasting capabilities of this model. Introduction Each year, influenza results in increased Emergency Department crowding which can be mitigated through early detection linked to an appropriate response. Although current surveillance systems, such as Google Flu Trends, yield near real-time influenza surveillance, few demonstrate ability to forecast impending influenza cases. Methods Forecasting models designed to predict one week in advance were developed from weekly counts of confirmed influenza cases over seven seasons (2004 – 2011) divided into training and out-of-sample verification sets. Forecasting procedures using classical Box-Jenkins, generalized linear, and autoregressive methods were employed to develop the final model and assess the relative contribution of external variables such as, Google Flu Trends, meteorological data, and temporal information. Models were developed and evaluated through statistical measures of global deviance and log-likelihood ratio tests. An additional measure of forecast confidence, defined as the percentage of forecast values, during an influenza peak, that are within 7 influenza cases of the actual data, was examined to demonstrate practical utility of the model. Results A generalized autoregressive Poisson (GARMA) forecast model integrating previous influenza cases with Google Flu Trends information provided the most accurate influenza case predictions. Google Flu Trend data was the only source of external information providing significant forecast improvements (p = 0.00002). The final model, a GARMA intercept model with the addition of Google Flu Trends, predicted weekly influenza cases during 4 out-of-sample outbreaks within 7 cases for 80% of estimates (Figure 1). Conclusions Integer-valued autoregression of influenza cases provides a strong base forecast model, which is enhanced by the addition of Google Flu Trends confirming the predictive capabilities of search query based syndromic surveillance. This accessible and flexible forecast model can be used by individual medical centers to provide advanced warning of future influenza cases.

[1]  I M Longini,et al.  Predicting the global spread of new infectious agents. , 1986, American journal of epidemiology.

[2]  S B Thacker,et al.  Application of multiple time series analysis to the estimation of pneumonia and influenza mortality by age 1962-1983. , 1988, Statistics in medicine.

[3]  Steven A. Ackerman,et al.  Meteorology: Understanding the Atmosphere , 2002 .

[4]  Keiji Fukuda,et al.  Medical Care Capacity for Influenza Outbreaks, Los Angeles , 2002, Emerging infectious diseases.

[5]  R. Rigby,et al.  Generalized Autoregressive Moving Average Models , 2003 .

[6]  Cécile Viboud,et al.  Prediction of the spread of influenza epidemics by the method of analogues. , 2003, American journal of epidemiology.

[7]  Bonnie K. Ray,et al.  Regression Models for Time Series Analysis , 2003, Technometrics.

[8]  W. Dab,et al.  Influenza A and B epidemic criteria based on time-series analysis of health services surveillance data , 1998, European Journal of Epidemiology.

[9]  Joseph E. Cavanaugh,et al.  Regression Models for Time Series Analysis , 2004 .

[10]  Muhammad M Mamdani,et al.  Community influenza outbreaks and emergency department ambulance diversion. , 2004, Annals of emergency medicine.

[11]  M. Osterholm,et al.  Preparing for the next pandemic. , 2005, The New England journal of medicine.

[12]  S. Leach,et al.  Real-time epidemic forecasting for pandemic influenza , 2006, Epidemiology and Infection.

[13]  A Russell Localio,et al.  The association between emergency department crowding and hospital performance on antibiotic timing for pneumonia and percutaneous intervention for myocardial infarction. , 2006, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[14]  S. Park 384:Epidemiology and Etiology of Malpractice Lawsuits in Republic of Korea Emergency Departments and Urgent Care Centers , 2006 .

[15]  Anisha Dharshi,et al.  The future of emergency care in the United States health system: a report from the Institute of Medicine. , 2006, Journal of pediatric surgery.

[16]  Fergus Laughridge,et al.  The future of emergency care in the United States health system. , 2006, Annals of emergency medicine.

[17]  John Steel,et al.  Influenza Virus Transmission Is Dependent on Relative Humidity and Temperature , 2007, PLoS pathogens.

[18]  Andy Blackburn,et al.  Google Flu trends , 2008 .

[19]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[20]  Steven L Bernstein,et al.  The effect of emergency department crowding on clinically oriented outcomes. , 2009, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[21]  A. Chang,et al.  The association between emergency department crowding and adverse cardiovascular outcomes in patients with chest pain. , 2009, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[22]  T. Rebmann APIC State-of-the-art Report: The role of the infection preventionist in emergency management , 2009, American Journal of Infection Control.

[23]  M. Prietula,et al.  Situational uses of syndromic surveillance. , 2009, Biosecurity and bioterrorism : biodefense strategy, practice, and science.

[24]  Richard K. Kiang,et al.  Modeling and Predicting Seasonal Influenza Transmission in Warm Regions Using Climatological Parameters , 2010, PloS one.

[25]  Frances S. Shofer,et al.  The effect of emergency department crowding on analgesia in patients with back pain in two hospitals. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[26]  E. Meites,et al.  Data for Decision Making: Strategic Information Tools for Hospital Management During a Pandemic , 2010, Disaster Medicine and Public Health Preparedness.

[27]  Paul J. Birrell,et al.  Bayesian modeling to unmask and predict influenza A/H1N1pdm dynamics in London , 2011, Proceedings of the National Academy of Sciences.

[28]  C. Goss,et al.  Monitoring Influenza Activity in the United States: A Comparison of Traditional Surveillance Systems with Google Flu Trends , 2011, PloS one.

[29]  Hiroshi Nishiura,et al.  Real-time forecasting of an epidemic using a discrete time stochastic model: a case study of pandemic influenza (H1N1-2009) , 2011, Biomedical engineering online.

[30]  Chantel Sloan,et al.  Impact of Pollution, Climate, and Sociodemographic Factors on Spatiotemporal Dynamics of Seasonal Respiratory Viruses , 2011, Clinical and translational science.

[31]  A. Flahault,et al.  A syndromic surveillance system for clinical and non-clinical health data , 2011 .

[32]  J. Crilly,et al.  Prediction and surveillance of influenza epidemics , 2011, The Medical journal of Australia.

[33]  Matthew Mohebbi,et al.  Assessing Google Flu Trends Performance in the United States during the 2009 Influenza Virus A (H1N1) Pandemic , 2011, PloS one.

[34]  Debra Revere,et al.  Perceived usefulness of a distributed community-based syndromic surveillance system: a pilot qualitative evaluation study , 2011, BMC Research Notes.

[35]  A. Dugas,et al.  Google Flu Trends: correlation with emergency department influenza rates and crowding metrics. , 2011, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[36]  J. Schunk,et al.  Should we fear "flu fear" itself? Effects of H1N1 influenza fear on ED use. , 2012, The American journal of emergency medicine.

[37]  Nicholas G. Polson,et al.  Tracking Epidemics With Google Flu Trends Data and a State-Space SEIR Model , 2012, Journal of the American Statistical Association.