Optimal Sequential Surveillance for Finance, Public Health, and Other Areas

Abstract The aim of sequential surveillance is on-line detection of an important change in an underlying process as soon as possible after the change has occurred. Statistical methods suitable for surveillance differ from hypothesis testing methods. In addition, the criteria for optimality differ from those used in hypothesis testing. The need for sequential surveillance in industry, economics, and medicine, and for environmental purposes is described. Even though the methods have been developed under different scientific cultures, inferential similarities can be identified. Applications contain complexities such as autocorrelations, complex distributions, complex types of changes, and spatial as well as other multivariate settings. Approaches to handling these complexities are discussed. Expressing methods for surveillance through likelihood functions makes it possible to link the methods to various optimality criteria. This approach also facilitates the choice of an optimal surveillance method for each specific application and provides some directions for improving earlier suggested methods.

[1]  R. Brookmeyer,et al.  Public Health Surveillance in Action: A Framework , 2009 .

[2]  M. Frisén,et al.  Robust outbreak surveillance of epidemics in Sweden , 2009, Statistics in medicine.

[3]  E. Andersson,et al.  Effect of Dependency in Systems for Multivariate Surveillance , 2009, Commun. Stat. Simul. Comput..

[4]  Eva Andersson,et al.  Predictions by early indicators of the time and height of the peaks of yearly influenza outbreaks in Sweden , 2008, Scandinavian journal of public health.

[5]  Landon H. Sego,et al.  A comparison of surveillance methods for small incidence rates , 2008, Statistics in medicine.

[6]  Eva Andersson,et al.  The Relation between Statistical Surveillance and Technical Analysis in Finance , 2008 .

[7]  W. Schmid,et al.  Sequential Monitoring of Optimal Portfolio Weights , 2008 .

[8]  W. Schmid,et al.  Surveillance of Univariate and Multivariate Linear Time Series , 2008 .

[9]  Eva Andersson,et al.  Statistical Surveillance of Epidemics: Peak Detection of Influenza in Sweden , 2008, Biometrical journal. Biometrische Zeitschrift.

[10]  David Bock,et al.  Aspects on the control of false alarms in statistical surveillance and the impact on the return of financial decision systems , 2008 .

[11]  Eva Andersson,et al.  Modeling influenza incidence for the purpose of on-line monitoring , 2007, Statistical methods in medical research.

[12]  Christian M. Hafner,et al.  Statistics of Financial Markets , 2008 .

[13]  Abdel-Salam G. Abdel-Salam,et al.  On the use and evaluation of prospective scan methods for health‐related surveillance , 2007 .

[14]  Sven Knoth,et al.  Accurate ARL Calculation for EWMA Control Charts Monitoring Normal Mean and Variance Simultaneously , 2007 .

[15]  Marion R. Reynolds,et al.  Multivariate Control Charts for Monitoring the Process Mean and Variability Using Sequential Sampling , 2007 .

[16]  Fugee Tsung,et al.  Detection and Diagnosis of Unknown Abrupt Changes Using CUSUM Multi-Chart Schemes , 2007 .

[17]  Gregory F Cooper,et al.  Issues in applied statistics for public health bioterrorism surveillance using multiple data streams: research needs , 2007, Statistics in medicine.

[18]  Marianne Frisén,et al.  Properties and Use of the Shewhart Method and Its Followers , 2007 .

[19]  David Bock,et al.  Evaluations of likelihood based surveillance of volatility , 2007 .

[20]  Explorative analysis of spatial aspects on the Swedish influenza data , 2007 .

[21]  Marianne Frisén,et al.  Optimal Surveillance Based on Exponentially Weighted Moving Averages , 2006 .

[22]  Ken P Kleinman,et al.  Assessing surveillance using sensitivity, specificity and timeliness , 2006, Statistical methods in medical research.

[23]  M. Frisén,et al.  Some statistical aspects of methods for detection of turning points in business cycles , 2006 .

[24]  William H. Woodall,et al.  The Use of Control Charts in Health-Care and Public-Health Surveillance , 2006 .

[25]  Fugee Tsung,et al.  A Reference-Free Cuscore Chart for Dynamic Mean Change Detection and a Unified Framework for Charting Performance Comparison , 2006 .

[26]  Sven Knoth,et al.  The Art of Evaluating Monitoring Schemes — How to Measure the Performance of Control Charts? , 2006 .

[27]  David Bock,et al.  Statistical surveillance of cyclical processes with application to turns in business cycles , 2005 .

[28]  H. Keselman,et al.  Multiple Comparison Procedures , 2005 .

[29]  Andrew B. Lawson,et al.  Spatial and Syndromic Surveillance for Public Health: Lawson/Spatial and Syndromic Surveillance for Public Health , 2005 .

[30]  Michael Verhofen,et al.  Introduction to Modern Portfolio Optimization , 2005 .

[31]  Andrew W. Moore,et al.  Algorithms for rapid outbreak detection: a research synthesis , 2005, J. Biomed. Informatics.

[32]  Narinder Singh Sahni,et al.  In-Line Process and Product Control Using Spectroscopy and Multivariate Calibration , 2005 .

[33]  Bernd Scherer,et al.  Introduction to modern portfolio optimization with NUOPT and S-PLUS , 2005 .

[34]  Andrew B. Lawson,et al.  Spatial and syndromic surveillance for public health , 2005 .

[35]  W. Schmid,et al.  Statistical Surveillance of the Parameters of a One-Factor Cox–Ingersoll–Ross Model , 2004 .

[36]  Christian Sonesson,et al.  Surveillance in Longitudinal Models: Detection of Intrauterine Growth Restriction , 2004, Biometrics.

[37]  W. Härdle,et al.  Statistics of Financial Markets: An Introduction , 2004 .

[38]  Nicky Best,et al.  Statistical issues in the prospective monitoring of health outcomes across multiple units , 2004 .

[39]  Magnus Pettersson,et al.  SPC with Applications to Churn Management , 2004 .

[40]  Alexander Aue,et al.  Delay time in sequential detection of change , 2004 .

[41]  Kristina Wärmefjord.  Multivariate quality control and diagnosis of sources of variation in assembled products , 2004 .

[42]  Wolfgang Schmid,et al.  EWMA Charts for Monitoring the Mean and the Autocovariances of Stationary Gaussian Processes , 2003 .

[43]  Andrew B. Lawson.  Some Considerations in Spatial-Temporal Analysis of Public Health Surveillance Data , 2003 .

[44]  Christian Sonesson,et al.  Evaluations of some Exponentially Weighted Moving Average methods , 2003 .

[45]  Marianne Frisén,et al.  Graphical evaluation of statistical surveillance , 2003 .

[46]  David M. Hartley,et al.  Syndromic Surveillance and Bioterrorism-related Epidemics , 2003, Emerging infectious diseases.

[47]  N. Best,et al.  Following Shipman: a pilot system for monitoring mortality rates in primary care , 2003, The Lancet.

[48]  Marianne Frisén,et al.  Statistical Surveillance. Optimality and Methods , 2003 .

[49]  Surveillance of a Simple Linear Regression , 2003 .

[50]  David Bock,et al.  A review and discussion of prospective statistical surveillance in public health , 2003 .

[51]  W. Härdle,et al.  Statistical Tools for Finance and Insurance , 2003 .

[52]  Eva Andersson,et al.  Monitoring cyclical processes. A non-parametric approach , 2002 .

[53]  Gerhard Stahl,et al.  Applied Quantitative Finance , 2002 .

[54]  Sven Knoth,et al.  Monitoring the mean and the variance of a stationary process , 2002 .

[55]  Joe H. Sullivan,et al.  A Self-Starting Control Chart for Multivariate Individual Observations , 2002, Technometrics.

[56]  Albert N. Shiryaev,et al.  Quickest Detection Problems in the Technical Analysis of the Financial Data , 2002 .

[57]  H. Föllmer,et al.  Stochastic Finance: An Introduction in Discrete Time , 2002 .

[58]  Elisabeth J. Umble,et al.  Cumulative Sum Charts and Charting for Quality Improvement , 2001, Technometrics.

[59]  Minitab.  Statistical Methods for Quality Improvement , 2001 .

[60]  M. Kulldor,et al.  Prospective time-periodic geographical disease surveillance using a scan statistic , 2001 .

[61]  Christian Gourieroux,et al.  Financial Econometrics: Problems, Models, and Methods , 2001 .

[62]  M. Beibel.  A note on sequential detection with exponential penalty for the delay , 2000 .

[63]  Ronald B. Crosier,et al.  Fast Initial Response for CUSUM Quality-Control Schemes: Give Your CUSUM A Head Start.: Give Your CUSUM A Head Start. , 2000 .

[64]  James M. Lucas,et al.  Fast Initial Response for CUSUM Quality-Control Schemes: Give Your CUSUM A Head Start , 2000, Technometrics.

[65]  S. W. Roberts,et al.  Control Chart Tests Based on Geometric Moving Averages , 2000, Technometrics.

[66]  Erik Järpe.  On Univariate and Spatial Surveillance , 2000 .

[67]  Douglas C. Montgomery,et al.  Research Issues and Ideas in Statistical Process Control , 1999 .

[68]  E. Ziegel,et al.  Statistics for the environment , 1999 .

[69]  Tze Leung Lai,et al.  Efficient recursive algorithms for detection of abrupt changes in signals and control systems , 1999, IEEE Trans. Autom. Control..

[70]  A. Shiryaev.  Essentials of stochastic finance , 1999 .

[71]  E. Järpe.  Surveillance of the interaction parameter of the ising model , 1999 .

[72]  Marianne Frisén,et al.  Evaluations of likelihood ratio methods for surveillance. Differences and robustness , 1999 .

[73]  H. Poor.  Quickest detection with exponential penalty for delay , 1998 .

[74]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[75]  Connie M. Borror,et al.  Poisson EWMA Control Charts , 1998 .

[76]  Magnus Pettersson,et al.  Monitoring a freshwater fish population: Statistical surveillance of biodiversity , 1998 .

[77]  P. Wessman,et al.  Some principles for surveillance adopted for multivariate processes with a common change point , 1998 .

[78]  Sven Knoth,et al.  Control Charts for Time Series , 1997 .

[79]  P A Rogerson,et al.  Surveillance systems for monitoring the development of spatial patterns. , 1997, Statistics in medicine.

[80]  Wolfgang Schmid,et al.  Some properties of the EWMA control chart in the presence of autocorrelation , 1997 .

[81]  Wolfgang Schmid,et al.  CUSUM control schemes for Gaussian processes , 1997 .

[82]  William H. Woodall,et al.  Control Charts Based on Attribute Data: Bibliography and Review , 1997 .

[83]  M. Meltzer,et al.  The economic impact of a bioterrorist attack: are prevention and postattack intervention programs justifiable? , 1997, Emerging infectious diseases.

[84]  Ron S. Kenett,et al.  Data-analytic aspects of the Shiryayev-Roberts control chart: Surveillance of a non-homogeneous Poisson process , 1996 .

[85]  H. White,et al.  Monitoring Structural Change , 1996 .

[86]  T. Lai.  Sequential changepoint detection in quality control and dynamical systems , 1995 .

[87]  M Kulldorff,et al.  Spatial disease clusters: detection and inference. , 1995, Statistics in medicine.

[88]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[89]  Moshe Pollak,et al.  An efficient nonparametric detection scheme and its application to surveillance of a Bernoulli process with unknown baseline , 1994 .

[90]  M. Frisén.  Statistical surveillance of business cycles , 1994 .

[91]  A. W. Kemp,et al.  Statistics for the Environment. , 1993 .

[92]  M. Srivastava,et al.  Comparison of EWMA, CUSUM and Shiryayev-Roberts Procedures for Detecting a Shift in the Mean , 1993 .

[93]  E. Yashchin.  Statistical Control Schemes: Methods, Applications and Generalizations , 1993 .

[94]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[95]  Emmanuel Yashchin,et al.  Performance of CUSUM control schemes for serially correlated observations , 1993 .

[96]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[97]  M Frisén,et al.  Evaluations of methods for statistical surveillance. , 1992, Statistics in medicine.

[98]  Giovanni Radaelli.  Using the Cuscore technique in the surveillance of rare health events , 1992 .

[99]  Fah Fatt Gan,et al.  Monitoring observations generated from a binomial distribution using modified exponentially weighted moving average control chart , 1990 .

[100]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[101]  Stephen V. Crowder,et al.  Design of Exponentially Weighted Moving Average Schemes , 1989 .

[102]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[103]  R. Crosier.  Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[104]  G. Moustakides.  Optimal stopping times for detecting changes in distributions , 1986 .

[105]  G Gallus,et al.  On surveillance methods for congenital malformations. , 1986, Statistics in medicine.

[106]  James M. Lucas,et al.  Counted Data CUSUM's , 1985 .

[107]  Stephen B. Vardeman,et al.  Average Run Lengths for CUSUM Schemes When Observations Are Exponentially Distributed , 1985 .

[108]  D. Siegmund,et al.  A diffusion process and its applications to detecting a change in the drift of Brownian motion , 1984 .

[109]  A F Smith,et al.  Monitoring renal transplants: an application of the multiprocess Kalman filter. , 1983, Biometrics.

[110]  Rina Chen,et al.  A Survillance System for Congenital Malformations , 1978 .

[111]  D. Siegmund,et al.  APPROXIMATIONS TO THE EXPECTED SAMPLE SIZE OF CERTAIN SEQUENTIAL TESTS , 1975 .

[112]  G. Lorden.  PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[113]  B. Källén,et al.  Multiple malformations studied with a national register of malformations. , 1969, Pediatrics.

[114]  C C Spicer,et al.  The computer surveillance of congenital malformations. , 1968, British medical bulletin.

[115]  S. W. Roberts.  A Comparison of Some Control Chart Procedures , 1966 .

[116]  A. Shiryaev.  On Optimum Methods in Quickest Detection Problems , 1963 .

[117]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[118]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .