Development and evaluation of a data-adaptive alerting algorithm for univariate temporal biosurveillance data.

This paper discusses further advances in making robust predictions with the Holt-Winters forecasts for a variety of syndromic time series behaviors and introduces a control-chart detection approach based on these forecasts. Using three collections of time series data, we compare biosurveillance alerting methods with quantified measures of forecast agreement, signal sensitivity, and time-to-detect. The study presents practical rules for initialization and parameterization of biosurveillance time series. Several outbreak scenarios are used for detection comparison. We derive an alerting algorithm from forecasts using Holt-Winters-generalized smoothing for prospective application to daily syndromic time series. The derived algorithm is compared with simple control-chart adaptations and to more computationally intensive regression modeling methods. The comparisons are conducted on background data from both authentic and simulated data streams. Both types of background data include time series that vary widely by both mean value and cyclic or seasonal behavior. Plausible, simulated signals are added to the background data for detection performance testing at signal strengths calculated to be neither too easy nor too hard to separate the compared methods. Results show that both the sensitivity and the timeliness of the Holt-Winters-based algorithm proved to be comparable or superior to that of the more traditional prediction methods used for syndromic surveillance.

[1]  H. Burkom Development, adaptation, and assessment of alerting algorithms for biosurveillance , 2003 .

[2]  Galit Shmueli,et al.  Automated time series forecasting for biosurveillance , 2007, Statistics in medicine.

[3]  Chris Chatfield,et al.  Holt‐Winters Forecasting: Some Practical Issues , 1988 .

[4]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[5]  Joseph Naus,et al.  Temporal surveillance using scan statistics , 2006, Statistics in medicine.

[6]  P E Sartwell,et al.  The incubation period and the dynamics of infectious disease. , 1966, American journal of epidemiology.

[7]  Don E. Detmer,et al.  Building the national health information infrastructure for personal health, health care services, public health, and research , 2003, BMC Medical Informatics Decis. Mak..

[8]  Lars Bergman,et al.  Computer-aided DSM-IV-diagnostics – acceptance, use and perceived usefulness in relation to users' learning styles , 2005, BMC Medical Informatics Decis. Mak..

[9]  Kenneth D. Mandl,et al.  Time series modeling for syndromic surveillance , 2003, BMC Medical Informatics Decis. Mak..

[10]  Anne B. Koehler,et al.  Forecasting models and prediction intervals for the multiplicative Holt-Winters method , 2001 .

[11]  H. Burkom,et al.  Enhancing time-series detection algorithms for automated biosurveillance. , 2009, Emerging infectious diseases.

[12]  Tom Burr,et al.  Modeling emergency department visit patterns for infectious disease complaints: results and application to disease surveillance , 2005, BMC Medical Informatics Decis. Mak..

[13]  Peter R. Winters,et al.  Forecasting Sales by Exponentially Weighted Moving Averages , 1960 .

[14]  L. Hutwagner,et al.  The bioterrorism preparedness and response Early Aberration Reporting System (EARS) , 2003, Journal of Urban Health.

[15]  William H Woodall,et al.  Detecting a rate increase using a Bernoulli scan statistic , 2008, Statistics in medicine.

[16]  C. Chatfield,et al.  Prediction intervals for multiplicative Holt-Winters , 1991 .

[17]  W. G. Cochran,et al.  The distribution of quadratic forms in a normal system, with applications to the analysis of covariance , 1934, Mathematical Proceedings of the Cambridge Philosophical Society.