A review and discussion of prospective statistical surveillance in public health

A review of methods suggested in the literature for sequential detection of changes in public health surveillance data is presented. Many researchers have noted the need for prospective methods. In recent years there has been an increased interest in both the statistical and the epidemiological literature concerning this type of problem. However, most of the vast literature in public health monitoring deals with retrospective methods, especially spatial methods. Evaluations with respect to the statistical properties of interest for prospective surveillance are rare. The special aspects of prospective statistical surveillance and different ways of evaluating such methods are described. Attention is given to methods that include only the time domain as well as methods for detection where observations have a spatial structure. In the case of surveillance of a change in a Poisson process the likelihood ratio method and the Shiryaev-Roberts method are derived. Copyright 2003 Royal Statistical Society.

[1]  R. German,et al.  Sensitivity and Predictive Value Positive Measurements for Public Health Surveillance Systems , 2000, Epidemiology.

[2]  G. Rossi,et al.  An approximate CUSUM procedure for surveillance of health events. , 1999, Statistics in medicine.

[3]  K J Lui,et al.  An application of a mathematical model to adjust for time lag in case reporting. , 1989, Statistics in medicine.

[4]  P Royston,et al.  Identifying the fertile phase of the human menstrual cycle. , 1991, Statistics in medicine.

[5]  E. Lesaffre,et al.  Disease mapping and risk assessment for public health. , 1999 .

[6]  L Watier,et al.  A time series construction of an alert threshold with application to S. bovismorbificans in France. , 1991, Statistics in medicine.

[7]  C C Spicer,et al.  The computer surveillance of congenital malformations. , 1968, British medical bulletin.

[8]  N Mantel,et al.  A Monitoring System for Chronic Diseases , 1982, Methods of Information in Medicine.

[9]  M. Kulldorff A spatial scan statistic , 1997 .

[10]  M. Srivastava,et al.  Comparison of EWMA, CUSUM and Shiryayev-Roberts Procedures for Detecting a Shift in the Mean , 1993 .

[11]  M. J. R. Healy A Simple Method for Monitoring Routine Statistics , 1983 .

[12]  T Tango,et al.  A class of tests for detecting 'general' and 'focused' clustering of rare diseases. , 1995, Statistics in medicine.

[13]  L. Bakketeig,et al.  Surveillance of congenital malformations and other conditions of the newborn. , 1975, International journal of epidemiology.

[14]  R. G. Parrish,et al.  Guidelines for evaluating surveillance systems. , 1988, MMWR supplements.

[15]  B. Levy,et al.  Toward a holistic approach to public health surveillance. , 1996, American journal of public health.

[16]  Giovanni Radaelli Using the Cuscore technique in the surveillance of rare health events , 1992 .

[17]  G Gallus,et al.  On surveillance methods for congenital malformations. , 1986, Statistics in medicine.

[18]  S B Thacker,et al.  Surveillance in environmental public health: issues, systems, and sources. , 1996, American journal of public health.

[19]  Noel A Cressie,et al.  11 Spatial statistical methods for environmental epidemiology , 2000, Bioenvironmental and public health statistics.

[20]  Peter Wessman The surveillance of several processes with different change points , 1999 .

[21]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[22]  Medicines Control Agency The SAMM guidelines Guidelines for company‐sponsored Safety Assessment of Marketed Medicines , 1994 .

[23]  S G Hilsenbeck,et al.  Quality control practices in centralized tumor registries in North America. , 1990, Journal of clinical epidemiology.

[24]  Stephen B. Vardeman,et al.  Average Run Lengths for CUSUM Schemes When Observations Are Exponentially Distributed , 1985 .

[25]  Giuseppe Gallus,et al.  On detection of a change in the dynamics of rare health events , 1989 .

[26]  Andrew B. Lawson,et al.  Statistical Methods in Spatial Epidemiology , 2001 .

[27]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[28]  J. Weatherall,et al.  SURVEILLANCE OF MALFORMATIONS , 1976 .

[29]  Eric Järpe Detection of environmental catastrophes , 2000 .

[30]  Martin Kulldorff,et al.  Prospective time periodic geographical disease surveillance using a scan statistic , 2001 .

[31]  William H. Woodall,et al.  Control Charts Based on Attribute Data: Bibliography and Review , 1997 .

[32]  Lone Simonsen,et al.  A Method for Timely Assessment of Influenza‐Associated Mortality in the United States , 1997, Epidemiology.

[33]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Optimal stopping rules , 1977 .

[34]  Sue Eckstein,et al.  Guidelines for company-sponsored safety assessment of marketed medicines (SAMM) , 2003 .

[35]  E. Järpe Surveillance of the interaction parameter of the ising model , 1999 .

[36]  A Morabia,et al.  From disease surveillance to the surveillance of risk factors. , 1996, American journal of public health.

[37]  Christian Sonesson,et al.  Evaluations of some Exponentially Weighted Moving Average methods , 2003 .

[38]  David Bock,et al.  Likelihood based methods for detection of turning points in business cycles - A comparative study , 2001 .

[39]  R R Sitter,et al.  A monitoring system to detect increased rates of cancer incidence. , 1990, American journal of epidemiology.

[40]  C. P. Farrington,et al.  The Detection of Outbreaks of Infectious Disease , 1997, Geomed.

[41]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[42]  Ron S. Kenett,et al.  On Sequential Detection of a Shift in the Probability of a Rare Event , 1983 .

[43]  S B Thacker,et al.  A Bayesian Approach to the Detection of Aberrations in Public Health Surveillance Data , 1993, Epidemiology.

[44]  Peter A. Rogerson,et al.  Monitoring point patterns for the development of space–time clusters , 2001 .

[45]  Joe Whittaker,et al.  A Dynamic Changepoint Model for Detecting the Onset of Growth in Bacteriological Infections , 1994 .

[46]  G Barbujani,et al.  Comparison of two statistical techniques for the surveillance of birth defects through a Monte Carlo simulation. , 1984, Statistics in medicine.

[47]  F F Nobre,et al.  A monitoring system to detect changes in public health surveillance data. , 1994, International journal of epidemiology.

[48]  R Chen,et al.  Analysing post-alarm data in a monitoring system in order to accept or reject the alarm. , 1993, Statistics in medicine.

[49]  Roger Marshall,et al.  A Review of Methods for the Statistical Analysis of Spatial Patterns of Disease , 1991 .

[50]  R Chen,et al.  The relative efficiency of the sets and the cusum techniques in monitoring the occurrence of a rare event. , 1987, Statistics in medicine.

[51]  D. Siegmund,et al.  Using the Generalized Likelihood Ratio Statistic for Sequential Detection of a Change-Point , 1995 .

[52]  S. McNabb,et al.  Evaluation of a method for detecting outbreaks of diseases in six states. , 1993, American journal of preventive medicine.

[53]  J. Cohen,et al.  Experience of European collaboration in influenza surveillance in the winter of 1993-1994. , 1996, Journal of public health medicine.

[54]  D F Stroup,et al.  Evaluation of a method for detecting aberrations in public health surveillance data. , 1993, American journal of epidemiology.

[55]  I. Tager,et al.  Application of exponential smoothing for nosocomial infection surveillance. , 1996, American journal of epidemiology.

[56]  G. D. Williamson,et al.  A monitoring system for detecting aberrations in public health surveillance reports. , 1999, Statistics in medicine.

[57]  James M. Lucas,et al.  Counted Data CUSUM's , 1985 .

[58]  L. Hutwagner,et al.  Using laboratory-based surveillance data for prevention: an algorithm for detecting Salmonella outbreaks. , 1997, Emerging infectious diseases.

[59]  U Goldbourt,et al.  Clustering of leukaemia cases in a city in Israel. , 1997, Statistics in medicine.

[60]  S B Thacker,et al.  Application of multiple time series analysis to the estimation of pneumonia and influenza mortality by age 1962-1983. , 1988, Statistics in medicine.

[61]  Rina Chen,et al.  A Survillance System for Congenital Malformations , 1978 .

[62]  I Heuch,et al.  A new sequential procedure for surveillance of Down's syndrome. , 1993, Statistics in medicine.

[63]  P A Rogerson,et al.  Surveillance systems for monitoring the development of spatial patterns. , 1997, Statistics in medicine.

[64]  G. Barbujani,et al.  A review of statistical methods for continuous monitoring of malformation frequencies , 1987, European Journal of Epidemiology.

[65]  E G Knox,et al.  The Detection of Space‐Time Interactions , 1964 .

[66]  Fah Fatt Gan Design of optimal exponential CUSUM control charts , 1994 .

[67]  P. Lavin,et al.  Using an autoregressive model to detect departures from steady states in unequally spaced tumour biomarker data. , 1992, Statistics in medicine.

[68]  D. Quade,et al.  A surveillance system based on a short memory scheme. , 1989, Statistics in medicine.

[69]  Fah Fatt Gan,et al.  Designs of One- and Two-Sided Exponential EWMA Charts , 1998 .

[70]  T. Lai Sequential changepoint detection in quality control and dynamical systems , 1995 .

[71]  M Frisén,et al.  Evaluations of methods for statistical surveillance. , 1992, Statistics in medicine.

[72]  F. Gan,et al.  Computing Average Run Lengths for Exponential CUSUM Schemes , 1994 .

[73]  Samuel L. Groseclose,et al.  Summary of Notifiable Diseases, United States. , 1997 .

[74]  S B Thacker,et al.  Public health surveillance in the United States. , 1988, Epidemiologic reviews.

[75]  S E Vollset,et al.  Statistical methods for surveillance of congenital malformations: when do the data indicate a true shift in the risk that an infant is affected by some type of malformation? , 1991, The International journal of risk & safety in medicine.

[76]  Nick Andrews,et al.  A Statistical Algorithm for the Early Detection of Outbreaks of Infectious Disease , 1996 .

[77]  Jaxk Reeves,et al.  A statistical signalling model for use in surveillance of adverse drug reaction data , 1998 .

[78]  Andrew B. Lawson,et al.  Comments on the papers by Williams et al., Kulldorff, Knorr‐Held and Best, and Rogerson , 2001 .

[79]  Marianne Frisén,et al.  Evaluations of likelihood ratio methods for surveillance. Differences and robustness , 1999 .

[80]  Eva Andersson,et al.  Monitoring cyclical processes. A non-parametric approach , 2002 .

[81]  B R Schlain,et al.  Using autoregressive and random walk models to detect trends and shifts in unequally spaced tumour biomarker data. , 1993, Statistics in medicine.

[82]  S B Thacker,et al.  Public health surveillance for chronic conditions: a scientific basis for decisions. , 1995, Statistics in medicine.

[83]  Hrafnhildur Arnkelsdóttir SURVEILLANCE OF RARE EVENTS. ON EVALUATION OF THE SETS METHOD , 1995 .

[84]  D F Stroup,et al.  Detection of aberrations in the occurrence of notifiable diseases surveillance data. , 1989, Statistics in medicine.

[85]  M. O'connell Research Report 2001 , 2001 .

[86]  M. Praus,et al.  Alert systems for post-marketing surveillance of adverse drug reactions. , 1993, Statistics in medicine.

[87]  G D Williamson,et al.  A study of the average run length characteristics of the National Notifiable Diseases Surveillance System. , 1999, Statistics in medicine.

[88]  C Wolter Monitoring intervals between rare events: a cumulative score procedure compared with Rina Chen's sets technique. , 1987, Methods of information in medicine.

[89]  R F Raubertas,et al.  An analysis of disease surveillance data that uses the geographic locations of the reporting units. , 1989, Statistics in medicine.

[90]  A F Smith,et al.  Monitoring renal transplants: an application of the multiprocess Kalman filter. , 1983, Biometrics.

[91]  W. Dab,et al.  Influenza A and B epidemic criteria based on time-series analysis of health services surveillance data , 1998, European Journal of Epidemiology.

[92]  G Gallus,et al.  Poisson approximation to a negative binomial process in the surveillance of rare health events. , 1991, Methods of information in medicine.

[93]  J D Erickson The International Clearinghouse for Birth Defects Monitoring Systems: Past, present and future. , 1991, The International journal of risk & safety in medicine.

[94]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .

[95]  R Chen Revised values for the parameters of the sets technique for monitoring the incidence rate of a rare disease. , 1986, Methods of information in medicine.

[96]  Adrian F. M. Smith,et al.  Monitoring Kidney Transplant Patients , 1983 .

[97]  M Cardinal,et al.  On the application of integer-valued time series models for the analysis of disease incidence. , 1999, Statistics in medicine.

[98]  K. Gordon,et al.  Modeling and Monitoring Biomedical Time Series , 1990 .

[99]  Marianne Frisén,et al.  Statistical Surveillance. Optimality and Methods , 2003 .

[100]  P. Wessman,et al.  Some principles for surveillance adopted for multivariate processes with a common change point , 1998 .

[101]  D R Walker,et al.  A deviation bar chart for detecting dengue outbreaks in Puerto Rico. , 1999, American journal of public health.