Statistical methods for the prospective detection of infectious disease outbreaks: a review

Summary.  Unusual clusters of disease must be detected rapidly for effective public health interventions to be introduced. Over the past decade there has been a surge in interest in statistical methods for the early detection of infectious disease outbreaks. This growth in interest has given rise to much new methodological work, ranging across the spectrum of statistical methods. The paper presents a comprehensive review of the statistical approaches that have been proposed. Applications to both laboratory and syndromic surveillance data are provided to illustrate the various methods.

[1]  P. Green Discussion of 'Bayesian image restoration with two applications in spatial statistics' by J Besag, J C York & A Mollie , 1991 .

[2]  D F Stroup,et al.  Detection of aberrations in the occurrence of notifiable diseases surveillance data. , 1989, Statistics in medicine.

[3]  W. A. Wallis,et al.  Techniques of Statistical Analysis. , 1950 .

[4]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .

[5]  R R Sitter,et al.  A monitoring system to detect increased rates of cancer incidence. , 1990, American journal of epidemiology.

[6]  N. Verlander,et al.  National symptom surveillance using calls to a telephone health advice service--United Kingdom, December 2001-February 2003. , 2004, MMWR supplements.

[7]  Abdel-Salam G. Abdel-Salam,et al.  On the use and evaluation of prospective scan methods for health‐related surveillance , 2007 .

[8]  Yevgeniy Elbert,et al.  Development and evaluation of a data-adaptive alerting algorithm for univariate temporal biosurveillance data. , 2009, Statistics in medicine.

[9]  Andrew B Lawson,et al.  Monitoring Changes in Spatio‐temporal Maps of Disease , 2006, Biometrical journal. Biometrische Zeitschrift.

[10]  G. Rossi,et al.  An approximate CUSUM procedure for surveillance of health events. , 1999, Statistics in medicine.

[11]  M. R. Reynolds,et al.  A general approach to modeling CUSUM charts for a proportion , 2000 .

[12]  S. Fasting,et al.  Statistical process control methods allow the analysis and improvement of anesthesia care , 2003, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[13]  Galit Shmueli,et al.  Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[14]  C Wolter Monitoring intervals between rare events: a cumulative score procedure compared with Rina Chen's sets technique. , 1987, Methods of information in medicine.

[15]  A. Bryant Setting the Scene - 2 , 2008 .

[16]  T. Tango,et al.  International Journal of Health Geographics a Flexibly Shaped Spatial Scan Statistic for Detecting Clusters , 2005 .

[17]  M. Kulldorff,et al.  A Space–Time Permutation Scan Statistic for Disease Outbreak Detection , 2005, PLoS medicine.

[18]  Andre Nel,et al.  Health effects of air pollution. , 2004, The Journal of allergy and clinical immunology.

[19]  C. Paddy Farrington,et al.  Monitoring vaccine safety using case series cumulative sum charts. , 2008, Vaccine.

[20]  M. Kulldor,et al.  Prospective time-periodic geographical disease surveillance using a scan statistic , 2001 .

[21]  Allyson M. Abrams,et al.  A model-adjusted space–time scan statistic with an application to syndromic surveillance , 2005, Epidemiology and Infection.

[22]  H. Hotelling,et al.  Multivariate Quality Control , 1947 .

[23]  J C Benneyan,et al.  Statistical Quality Control Methods in Infection Control and Hospital Epidemiology, Part II: Chart Use, Statistical Properties, and Research Issues , 1998, Infection Control & Hospital Epidemiology.

[24]  David Bock,et al.  A review and discussion of prospective statistical surveillance in public health , 2003 .

[25]  Fah Fatt Gan Design of optimal exponential CUSUM control charts , 1994 .

[26]  L Knorr-Held,et al.  Bayesian modelling of inseparable space-time variation in disease risk. , 2000, Statistics in medicine.

[27]  Andrew B Lawson,et al.  EWMA smoothing and Bayesian spatial modeling for health surveillance , 2008, Statistics in medicine.

[28]  L Watier,et al.  A time series construction of an alert threshold with application to S. bovismorbificans in France. , 1991, Statistics in medicine.

[29]  A. Hulth,et al.  Practical usage of computer-supported outbreak detection in five European countries. , 2010, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[30]  F P Wheeler,et al.  Bayesian Forecasting and Dynamic Models (2nd edn) , 1998, J. Oper. Res. Soc..

[31]  Landon H. Sego,et al.  A comparison of surveillance methods for small incidence rates , 2008, Statistics in medicine.

[32]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[33]  Nicky Best,et al.  Statistical issues in the prospective monitoring of health outcomes across multiple units , 2004 .

[34]  Peter J. Diggle,et al.  Point process methodology for on‐line spatio‐temporal disease surveillance , 2005 .

[35]  Christian Sonesson,et al.  Evaluations of some Exponentially Weighted Moving Average methods , 2003 .

[36]  Adam P. Wagner Extending Scottish exception reporting systems spatially and temporally , 2010 .

[37]  S Wallenstein,et al.  A test for detection of clustering over time. , 1980, American journal of epidemiology.

[38]  L C Hutwagner,et al.  A simulation model for assessing aberration detection methods used in public health surveillance for systems with limited baselines , 2005, Statistics in medicine.

[39]  A. Lawson,et al.  Developments in General and Syndromic Surveillance for Small Area Health Data , 2004 .

[40]  W. Dunsmuir,et al.  Syndromic Surveillance for Influenzalike Illness in Ambulatory Care Setting , 2004, Emerging infectious diseases.

[41]  Galit Shmueli,et al.  Wavelet-Based Monitoring in Modern Biosurveillance , 2005 .

[42]  M. Kulldorff,et al.  An elliptic spatial scan statistic , 2006, Statistics in medicine.

[43]  Ronald B. Crosier,et al.  A new two-sided cumulative sum quality control scheme , 1986 .

[44]  Sylvan Wallenstein,et al.  Scan statistics for temporal surveillance for biologic terrorism. , 2004, MMWR supplements.

[45]  William H Woodall,et al.  Use of the local Knox statistic for the prospective monitoring of disease occurrences in space and time , 2007, Statistics in medicine.

[46]  D F Stroup,et al.  Evaluation of a method for detecting aberrations in public health surveillance data. , 1993, American journal of epidemiology.

[47]  Ross Sparks Enhancing road safety through early detection of outbreaks in the frequency of motor vehicle crashes , 2010 .

[48]  J Coberly,et al.  Public health monitoring tools for multiple data streams. , 2005, MMWR supplements.

[49]  Bert Veenendaal,et al.  Disease surveillance using a hidden Markov model , 2009, BMC Medical Informatics Decis. Mak..

[50]  A. N. Sirjaev On the Detection of Disorder in a Manufacturing Process. I. , 1963 .

[51]  Arnold Bosman,et al.  Automated, Laboratory-based System Using the Internet for Disease Outbreak Detection, the Netherlands , 2003, Emerging infectious diseases.

[52]  Renato Assunção,et al.  Surveillance to detect emerging space-time clusters , 2009, Comput. Stat. Data Anal..

[53]  J. Naus,et al.  Scan Statistics , 2014, Encyclopedia of Social Network Analysis and Mining.

[54]  David Madigan,et al.  Bayesian Data Mining for Health Surveillance , 2005 .

[55]  S B Thacker,et al.  Application of multiple time series analysis to the estimation of pneumonia and influenza mortality by age 1962-1983. , 1988, Statistics in medicine.

[56]  E G Knox,et al.  The Detection of Space‐Time Interactions , 1964 .

[57]  Wolfgang Schmid,et al.  Multivariate CUSUM chart: properties and enhancements , 2009 .

[58]  A. Dobson,et al.  The application of statistical process control charts to the detection and monitoring of hospital-acquired infections. , 2001, Journal of quality in clinical practice.

[59]  S. W. Roberts,et al.  Control Chart Tests Based on Geometric Moving Averages , 2000, Technometrics.

[60]  Tonglin Zhang,et al.  Spatial Scan Statistics in Loglinear Models , 2007 .

[61]  Jeffrey S. Duchin,et al.  A simulation study comparing aberration detection algorithms for syndromic surveillance , 2007, BMC Medical Informatics Decis. Mak..

[62]  M. Clyde,et al.  Health Effects of Air Pollution: A Statistical Review , 2003 .

[63]  Galit Shmueli,et al.  Statistical issues and challenges associated with rapid detection of bio‐terrorist attacks , 2005, Statistics in medicine.

[64]  M. Kulldorff,et al.  Dead Bird Clusters as an Early Warning System for West Nile Virus Activity , 2003, Emerging infectious diseases.

[65]  Michael Höhle,et al.  Count data regression charts for the monitoring of surveillance time series , 2008, Comput. Stat. Data Anal..

[66]  Peter R. Winters,et al.  Forecasting Sales by Exponentially Weighted Moving Averages , 1960 .

[67]  Peihua Qiu,et al.  A Rank-Based Multivariate CUSUM Procedure , 2001, Technometrics.

[68]  Eva Andersson,et al.  Sufficient Reduction in Multivariate Surveillance , 2009 .

[69]  Christian H. Weifi Categorical Time Series Analysis and Applications in Statistical Quality Control , 2009 .

[70]  J. Nickerson,et al.  A multivariate exponentially weighted moving average control chart for photovoltaic processes , 2005, Conference Record of the Thirty-first IEEE Photovoltaic Specialists Conference, 2005..

[71]  Andrew W. Moore,et al.  Algorithms for rapid outbreak detection: a research synthesis , 2005, J. Biomed. Informatics.

[72]  A. Flahault,et al.  A routine tool for detection and assessment of epidemics of influenza-like syndromes in France. , 1991, American journal of public health.

[73]  Christina M. Mastrangelo,et al.  A Statistical Approach to Reduce Hospital-Associated Infections , 2008 .

[74]  F. Carrat,et al.  Monitoring epidemiologic surveillance data using hidden Markov models. , 1999, Statistics in medicine.

[75]  M Frisén,et al.  Evaluations of methods for statistical surveillance. , 1992, Statistics in medicine.

[76]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[77]  Andrew B. Lawson,et al.  Spatial and Syndromic Surveillance for Public Health: Lawson/Spatial and Syndromic Surveillance for Public Health , 2005 .

[78]  K. Kafadar,et al.  Analysis of aberrations in public health surveillance data: estimating variances on correlated samples. , 1992, Statistics in medicine.

[79]  M. Frisén,et al.  Robust outbreak surveillance of epidemics in Sweden , 2009, Statistics in medicine.

[80]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[81]  U Helfenstein,et al.  Box-Jenkins modelling of some viral infectious diseases. , 1986, Statistics in medicine.

[82]  R. Assunção,et al.  Fast detection of arbitrarily shaped disease clusters , 2006, Statistics in medicine.

[83]  G. D. Williamson,et al.  A monitoring system for detecting aberrations in public health surveillance reports. , 1999, Statistics in medicine.

[84]  Olha Bodnar,et al.  Surveillance of the mean behavior of multivariate time series , 2007 .

[85]  Toshiro Tango,et al.  International Journal of Health Geographics a Flexibly Shaped Space-time Scan Statistic for Disease Outbreak Detection and Monitoring , 2022 .

[86]  S Wallenstein,et al.  Use of the scan statistic to detect time-space clustering. , 1989, American journal of epidemiology.

[87]  F F Nobre,et al.  A monitoring system to detect changes in public health surveillance data. , 1994, International journal of epidemiology.

[88]  Pemetaan Jumlah Balita,et al.  Spatial Scan Statistic , 2014, Encyclopedia of Social Network Analysis and Mining.

[89]  J. Besag,et al.  Bayesian image restoration, with two applications in spatial statistics , 1991 .

[90]  Peter A Rogerson,et al.  Monitoring change in spatial patterns of disease: comparing univariate and multivariate cumulative sum approaches , 2004, Statistics in medicine.

[91]  J. Edward Jackson,et al.  Quality Control Methods for Several Related Variables , 1959 .

[92]  Hsinchun Chen,et al.  Prospective Infectious Disease Outbreak Detection Using Markov Switching Models , 2010, IEEE Transactions on Knowledge and Data Engineering.

[93]  Ronald B. Crosier,et al.  Fast Initial Response for CUSUM Quality-Control Schemes: Give Your CUSUM A Head Start.: Give Your CUSUM A Head Start. , 2000 .

[94]  Nick Andrews,et al.  Outbreak detection: application to infectious disease surveillance , 2003 .

[95]  N. Verlander,et al.  Early warning and NHS Direct: a role in community surveillance? , 2003, Journal of public health medicine.

[96]  Lori Hutwagner,et al.  Comparing Aberration Detection Methods with Simulated Data , 2005, Emerging infectious diseases.

[97]  Andrew B. Lawson,et al.  Spatial and syndromic surveillance for public health , 2005 .

[98]  Marianne Frisén,et al.  Multivariate outbreak detection , 2010 .

[99]  M. Frisén,et al.  Semiparametric Surveillance of Monotonic Changes , 2009 .

[100]  Noor Azina Ismail,et al.  ‘Online’ monitoring and retrospective analysis of hospital outcomes based on a scan statistic , 2003, Statistics in medicine.

[101]  M. Frisén,et al.  Semiparametric estimation of outbreak regression , 2010 .

[102]  Haikady N. Nagaraja,et al.  Inference in Hidden Markov Models , 2006, Technometrics.

[103]  J. Bithell Statistical methods for analysing point-source exposures , 1996 .

[104]  Leonhard Held,et al.  A statistical framework for the analysis of multivariate infectious disease surveillance counts , 2005 .

[105]  Beth Ann Griffin,et al.  Early detection of influenza outbreaks using the DC Department of Health's syndromic surveillance system , 2009, BMC public health.

[106]  P A Rogerson,et al.  Surveillance systems for monitoring the development of spatial patterns. , 1997, Statistics in medicine.

[107]  R. Serfling Methods for current statistical analysis of excess pneumonia-influenza deaths. , 1963, Public health reports.

[108]  L. Hutwagner,et al.  The bioterrorism preparedness and response Early Aberration Reporting System (EARS) , 2003, Journal of Urban Health.

[109]  Ken P Kleinman,et al.  Assessing surveillance using sensitivity, specificity and timeliness , 2006, Statistical methods in medical research.

[110]  Michael Höhle,et al.  Aberration detection in R illustrated by Danish mortality monitoring , 2010 .

[111]  D. Hawkins,et al.  A nonparametric multivariate cumulative sum procedure for detecting shifts in all directions , 2003 .

[112]  M. Kulldorff,et al.  Multivariate scan statistics for disease surveillance , 2007, Statistics in medicine.

[113]  Jae Won Lee,et al.  Comparison of various statistical methods for detecting disease outbreaks , 2010, Comput. Stat..

[114]  V. Parkash,et al.  STATISTICAL PROCESS CONTROL , 2013 .

[115]  Peter A. Rogerson,et al.  GeoSurveillance: a GIS-based system for the detection and monitoring of spatial clusters , 2009, J. Geogr. Syst..

[116]  Richard Platt,et al.  Automated Detection of Infectious Disease Outbreaks in Hospitals: A Retrospective Cohort Study , 2010, PLoS medicine.

[117]  William H. Woodall,et al.  The Use of Control Charts in Health-Care and Public-Health Surveillance , 2006 .

[118]  U Goldbourt,et al.  Clustering of leukaemia cases in a city in Israel. , 1997, Statistics in medicine.

[119]  Michael Coory,et al.  Using control charts to monitor quality of hospital care with administrative data. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[120]  Peter A. Rogerson,et al.  Monitoring point patterns for the development of space–time clusters , 2001 .

[121]  Marianne Frisén,et al.  Principles for Multivariate Surveillance , 2007 .

[122]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[123]  James M. Lucas,et al.  Fast Initial Response for CUSUM Quality-Control Schemes: Give Your CUSUM A Head Start , 2000, Technometrics.

[124]  Kenneth D. Mandl,et al.  Time series modeling for syndromic surveillance , 2003, BMC Medical Informatics Decis. Mak..

[125]  Volker Schmid,et al.  A two-component model for counts of infectious diseases. , 2005, Biostatistics.

[126]  Eva Andersson Hotelling's T 2 Method in Multivariate On-Line Surveillance: On the Delay of an Alarm , 2008 .

[127]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[128]  R Chen,et al.  Analysing post-alarm data in a monitoring system in order to accept or reject the alarm. , 1993, Statistics in medicine.

[129]  Marianne Frisén,et al.  Properties and Use of the Shewhart Method and Its Followers , 2007 .

[130]  A. Mann Estimating the impact of influenza vaccination and antigenic drift on influenza-related morbidity and mortality in England & Wales using hidden Markov models , 2010 .

[131]  Chris Chatfield,et al.  Holt‐Winters Forecasting: Some Practical Issues , 1988 .

[132]  W. H. Deitenbeck Introduction to statistical process control. , 1995, Healthcare facilities management series.

[133]  Rina Chen,et al.  A Survillance System for Congenital Malformations , 1978 .

[134]  Yoshinori Yamamoto Preface , 1994, Nihon Hoshasen Gijutsu Gakkai zasshi.

[135]  David J. Spiegelhalter,et al.  An Empirical Approximation to the Null Unbounded Steady-State Distribution of the Cumulative Sum Statistic , 2008, Technometrics.

[136]  Connie M. Borror,et al.  Poisson EWMA Control Charts , 1998 .

[137]  James M. Lucas,et al.  Counted Data CUSUM's , 1985 .

[138]  Bikas K. Sinha,et al.  Surveillance Strategies for Detecting Changepoint in Incidence Rate Based on Exponentially Weighted Moving Average Methods , 2008 .

[139]  Monitoring clinical performance: invited comments on the papers by Grigg and Farewell and Marshall et al. , 2004 .

[140]  Marianne Frisén,et al.  Statistical Surveillance. Optimality and Methods , 2003 .

[141]  Camille Pelat,et al.  Online detection and quantification of epidemics , 2007, BMC Medical Informatics Decis. Mak..

[142]  Ronald D. Fricker,et al.  Rejoinder: Some methodological issues in biosurveillance , 2011 .

[143]  J. Heijne,et al.  Automated detection of infectious disease outbreaks: hierarchical time series models , 2006, Statistics in Medicine.

[144]  Thacker Sb,et al.  A method for evaluating systems of epidemiological surveillance. , 1988 .

[145]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[146]  I. Tager,et al.  Application of exponential smoothing for nosocomial infection surveillance. , 1996, American journal of epidemiology.

[147]  S B Thacker,et al.  A method for evaluating systems of epidemiological surveillance. , 1988, World health statistics quarterly. Rapport trimestriel de statistiques sanitaires mondiales.

[148]  Paola Sebastiani,et al.  Automated Detection of Influenza Epidemics with Hidden Markov Models , 2003, IDA.

[149]  L. Held,et al.  Multivariate modelling of infectious disease surveillance data , 2008, Statistics in medicine.

[150]  A. Lawson Spatial and Spatio‐Temporal Disease Analysis , 2005 .

[151]  Peihua Qiu Introduction to Statistical Process Control , 2013 .

[152]  D. Costagliola,et al.  When is the epidemic warning cut-off point exceeded? , 1994, European Journal of Epidemiology.

[153]  D. Quade,et al.  A surveillance system based on a short memory scheme. , 1989, Statistics in medicine.

[154]  Antonio López-Quílez,et al.  Bayesian Markov switching models for the early detection of influenza epidemics , 2008, Statistics in medicine.

[155]  Michael Höhle,et al.  surveillance: An R package for the monitoring of infectious diseases , 2007, Comput. Stat..

[156]  L. Stern,et al.  Automated outbreak detection: a quantitative retrospective analysis , 1999, Epidemiology and Infection.

[157]  Galit Shmueli,et al.  Automated time series forecasting for biosurveillance , 2007, Statistics in medicine.

[158]  Howard S. Burkom,et al.  Statistical Challenges Facing Early Outbreak Detection in Biosurveillance , 2010, Technometrics.

[159]  A. G. Munford A Control Chart Based on Cumulative Scores , 1980 .

[160]  Seoung Bum Kim,et al.  A comparison of CUSUM, EWMA, and temporal scan statistics for detection of increases in poisson rates , 2010, Qual. Reliab. Eng. Int..

[161]  M. J. R. Healy A Simple Method for Monitoring Routine Statistics , 1983 .

[162]  E. Andersson,et al.  Effect of Dependency in Systems for Multivariate Surveillance , 2009, Commun. Stat. Simul. Comput..

[163]  T Tango,et al.  A class of tests for detecting 'general' and 'focused' clustering of rare diseases. , 1995, Statistics in medicine.

[164]  M Cardinal,et al.  On the application of integer-valued time series models for the analysis of disease incidence. , 1999, Statistics in medicine.

[165]  V. Agrawal,et al.  Authors’ reply , 2010, Indian journal of psychiatry.

[166]  R F Raubertas,et al.  An analysis of disease surveillance data that uses the geographic locations of the reporting units. , 1989, Statistics in medicine.

[167]  A. Lawson,et al.  Surveillance of individual level disease maps , 2006, Statistical methods in medical research.

[168]  Jian Zhang,et al.  MULTIVARIATE CUMULATIVE SUM CONTROL CHARTS BASED ON PROJECTION PURSUIT , 2001 .

[169]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[170]  John S. Oakland Chapter 15 – The implementation of statistical process control , 2008 .

[171]  Peter J. Diggle,et al.  Spatio-Temporal Point Processes: Methods and Applications , 2005 .

[172]  George Gettinby,et al.  PREDICTION OF INFECTIOUS DISEASES:AN EXCEPTION REPORTING SYSTEM , 2003 .

[173]  William H Woodall,et al.  Detecting a rate increase using a Bernoulli scan statistic , 2008, Statistics in medicine.

[174]  Antonio López-Quílez,et al.  FluDetWeb: an interactive web-based system for the early detection of the onset of influenza epidemics , 2009, BMC Medical Informatics Decis. Mak..

[175]  Eva Andersson,et al.  Statistical Surveillance of Epidemics: Peak Detection of Influenza in Sweden , 2008, Biometrical journal. Biometrische Zeitschrift.

[176]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[177]  Fw Fred Steutel,et al.  Discrete analogues of self-decomposability and stability , 1979 .

[178]  S. W. Roberts A Comparison of Some Control Chart Procedures , 1966 .

[179]  Renato Assunção,et al.  A Simulated Annealing Strategy for the Detection of Arbitrarily Shaped Spatial Clusters , 2022 .

[180]  Fah Fatt Gan,et al.  Designs of One- and Two-Sided Exponential EWMA Charts , 1998 .

[181]  R A Parker,et al.  Analysis of surveillance data with Poisson regression: a case study. , 1989, Statistics in medicine.

[182]  Benjamin J Cowling,et al.  Methods for monitoring influenza surveillance data. , 2006, International journal of epidemiology.

[183]  H. Tillett,et al.  Influenza surveillance in England and Wales using routine statistics: Development of ‘cusum’ graphs to compare 12 previous winters and to monitor the 1980/81 winter , 1982, Journal of Hygiene.

[184]  Raymond G. Carey,et al.  Improving Healthcare with Control Charts: Basic and Advanced SPC Methods and Case Studies , 2002 .

[185]  Jun Zhang,et al.  Detection of Outbreaks from Time Series Data Using Wavelet Transform , 2003, AMIA.

[186]  Bonnie Berger,et al.  Automated real time constant-specificity surveillance for disease outbreaks , 2007, BMC Medical Informatics Decis. Mak..

[187]  P. Sebastiani,et al.  A Bayesian dynamic model for influenza surveillance , 2006, Statistics in medicine.

[188]  Joseph Naus,et al.  Temporal surveillance using scan statistics , 2006, Statistics in medicine.

[189]  S B Thacker,et al.  An evaluation of influenza mortality surveillance, 1962-1979. I. Time series forecasts of expected pneumonia and influenza deaths. , 1981, American journal of epidemiology.

[190]  William H. Woodall,et al.  Performance Metrics for Surveillance Schemes , 2008 .

[191]  Christian Sonesson,et al.  A CUSUM framework for detection of space–time disease clusters using scan statistics , 2007, Statistics in medicine.

[192]  Peter A Rogerson,et al.  Approaches to syndromic surveillance when data consist of small regional counts. , 2004, MMWR supplements.

[193]  Daniel B Neill,et al.  An empirical comparison of spatial scan statistics for outbreak detection , 2009, International journal of health geographics.

[194]  Leonhard Held,et al.  Joint spatial analysis of gastrointestinal infectious diseases , 2006, Statistical methods in medical research.

[195]  Eva Andersson,et al.  Modeling influenza incidence for the purpose of on-line monitoring , 2007, Statistical methods in medical research.

[196]  Nick Andrews,et al.  A Statistical Algorithm for the Early Detection of Outbreaks of Infectious Disease , 1996 .

[197]  J Leal,et al.  Validity of electronic surveillance systems: a systematic review. , 2008, The Journal of hospital infection.

[198]  Protecting the leaders—syndromic surveillance for the G8 summit in Scotland , 2006 .

[199]  V T Farewell,et al.  Use of risk-adjusted CUSUM and RSPRTcharts for monitoring in medical contexts , 2003, Statistical methods in medical research.

[200]  J C Benneyan,et al.  Statistical Quality Control Methods in Infection Control and Hospital Epidemiology, Part I Introduction and Basic Theory , 1998, Infection Control & Hospital Epidemiology.

[201]  Ron S. Kenett,et al.  Data-analytic aspects of the Shiryayev-Roberts control chart: Surveillance of a non-homogeneous Poisson process , 1996 .

[202]  R. Platt,et al.  A generalized linear mixed models approach for detecting incident clusters of disease in small areas, with an application to biological terrorism. , 2004, American journal of epidemiology.

[203]  W. F. Athas,et al.  Evaluating cluster alarms: a space-time scan statistic and brain cancer in Los Alamos, New Mexico. , 1998, American journal of public health.

[204]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[205]  Fah Fatt Gan,et al.  Monitoring observations generated from a binomial distribution using modified exponentially weighted moving average control chart , 1990 .