Early detection of influenza outbreaks using the DC Department of Health's syndromic surveillance system

BackgroundSince 2001, the District of Columbia Department of Health has been using an emergency room syndromic surveillance system to identify possible disease outbreaks. Data are received from a number of local hospital emergency rooms and analyzed daily using a variety of statistical detection algorithms. The aims of this paper are to characterize the performance of these statistical detection algorithms in rigorous yet practical terms in order to identify the optimal parameters for each and to compare the ability of two syndrome definition criteria and data from a children's hospital versus vs. other hospitals to determine the onset of seasonal influenza.MethodsWe first used a fine-tuning approach to improve the sensitivity of each algorithm to detecting simulated outbreaks and to identifying previously known outbreaks. Subsequently, using the fine-tuned algorithms, we examined (i) the ability of unspecified infection and respiratory syndrome categories to detect the start of the flu season and (ii) how well data from Children's National Medical Center (CNMC) did versus all the other hospitals when using unspecified infection, respiratory, and both categories together.ResultsSimulation studies using the data showed that over a range of situations, the multivariate CUSUM algorithm performed more effectively than the other algorithms tested. In addition, the parameters that yielded optimal performance varied for each algorithm, especially with the number of cases in the data stream. In terms of detecting the onset of seasonal influenza, only "unspecified infection," especially the counts from CNMC, clearly delineated influenza outbreaks out of the eight available syndromic classifications. In three of five years, CNMC consistently flags earlier (from 2 days up to 2 weeks earlier) than a multivariate analysis of all other DC hospitals.ConclusionsWhen practitioners apply statistical detection algorithms to their own data, fine tuning of parameters is necessary to improve overall sensitivity. With fined tuned algorithms, our results suggest that emergency room based syndromic surveillance focusing on unspecified infection cases in children is an effective way to determine the beginning of the influenza outbreak and could serve as a trigger for more intensive surveillance efforts and initiate infection control measures in the community.

[1]  Eric H. Y. Lau,et al.  Optimizing Use of Multistream Influenza Sentinel Surveillance Data , 2008, Emerging infectious diseases.

[2]  Matthias Schonlau,et al.  Syndromic Surveillance: Is it Worth the Effort? , 2004 .

[3]  Ken P Kleinman,et al.  Identifying pediatric age groups for influenza vaccination using a real-time regional surveillance system. , 2005, American journal of epidemiology.

[4]  Wei Zheng,et al.  Potential for early warning of viral influenza activity in the community by monitoring clinical diagnoses of influenza in hospital emergency departments , 2007, BMC public health.

[5]  Ronald D. Fricker,et al.  Evaluating Statistical Methods for Syndromic Surveillance , 2006 .

[6]  William H. Woodall,et al.  The Use of Control Charts in Health-Care and Public-Health Surveillance , 2006 .

[7]  Richard A. Lemay,et al.  Syndromic surveillance for influenzalike illness. , 2008, Biosecurity and bioterrorism : biodefense strategy, practice, and science.

[8]  J. Casani,et al.  The National Capitol Region’s Emergency Department Syndromic Surveillance System: 
Do Chief Complaint and Discharge Diagnosis Yield Different Results? , 2003, Emerging infectious diseases.

[9]  Lucila Ohno-Machado,et al.  The use of receiver operating characteristic curves in biomedical informatics , 2005, J. Biomed. Informatics.

[10]  P. Sebastiani,et al.  A Bayesian dynamic model for influenza surveillance , 2006, Statistics in medicine.

[11]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[12]  Farzad Mostashari,et al.  Monitoring the Impact of Influenza by Age: Emergency Department Fever and Respiratory Complaint Surveillance in New York City , 2007, PLoS medicine.

[13]  David M. Pennock,et al.  Using internet searches for influenza surveillance. , 2008, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[14]  V. T. Farewell,et al.  A Bayesian dynamic model for influenza surveillance , 2006 .

[15]  M. Kulldorff,et al.  Syndromic surveillance in public health practice, New York City. , 2004, Emerging infectious diseases.

[16]  Shirley Large,et al.  Tracking the spatial diffusion of influenza and norovirus using telehealth data: A spatiotemporal analysis of syndromic data , 2008, BMC medicine.

[17]  H. Burkom,et al.  Enhancing time-series detection algorithms for automated biosurveillance. , 2009, Emerging infectious diseases.

[18]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[19]  M. Thobaben,et al.  Prevention and Control of Influenza , 2003, MMWR. Morbidity and mortality weekly report.