To reduce or not to reduce: a study on spatio-temporal surveillance

The majority of control charts based on scan statistics for spatio-temporal surveillance use full observation vectors. In high-dimensional applications, dimension-reduction techniques are usually applied. Typically, the dimension reduction is conducted as a post-processing step rather than in the data acquisition stage and thus, a full sample covariance matrix is required. When the dimensionality of data is high, (i) the sample covariance matrix tends to be ill-conditioned due to a limited number of samples; (ii) the inversion of such a sample covariance matrix causes numerical issues; and (iii) aggregating information from all variables may lead to high communication costs in sensor networks. In this paper, we propose a set of reduced-dimension (RD) control charts that perform dimension reduction during the data acquisition process by spatial scanning. The proposed methods avoid computational difficulties and possibly high communication costs. We derive a theoretical measure that characterizes the performance difference between the RD approach and the full observation approach. The numerical results show that the RD approach has little performance loss under several commonly used spatial models while enjoying all the benefits of implementation. A case study on water quality monitoring demonstrates the effectiveness of the proposed methods in real applications.

[1]  Alexander S. Szalay,et al.  Real time change point detection by incremental PCA in large scale sensor data , 2014, 2014 IEEE High Performance Extreme Computing Conference (HPEC).

[2]  Ewa Skubalska-Rafajłowicz,et al.  Random projections and Hotelling’s T2 statistics for change detection in high-dimensional data streams , 2013, Int. J. Appl. Math. Comput. Sci..

[3]  Peter A Rogerson,et al.  Approaches to syndromic surveillance when data consist of small regional counts. , 2004, MMWR supplements.

[4]  Richard Ballance,et al.  Water Quality Monitoring : A Practical Guide to the Design and Implementation of Freshwater Quality Studies and Monitoring Programmes , 1998 .

[5]  Kwok-Leung Tsui,et al.  A Review of Healthcare, Public Health, and Syndromic Surveillance , 2008 .

[6]  George C. Runger,et al.  Projections and the U(2) Multivariate Control Chart , 1996 .

[7]  James R. Wilson,et al.  Monitoring nonlinear profiles using a wavelet-based distribution-free CUSUM chart , 2012 .

[8]  Mi Lim Lee,et al.  Robust distribution-free multivariate CUSUM charts for spatiotemporal biosurveillance in the presence of spatial correlation , 2015 .

[9]  Yajun Mei,et al.  Scalable SUM-Shrinkage Schemes for Distributed Monitoring Large-Scale Data Streams , 2016 .

[10]  Wei Jiang,et al.  A spatial variable selection method for monitoring product surface , 2016 .

[11]  Shiyu Zhou,et al.  Discriminant locality preserving projection chart for statistical monitoring of manufacturing processes , 2014 .

[12]  Fuzhen Zhang The Schur complement and its applications , 2005 .

[13]  David J. Spiegelhalter,et al.  Statistical methods for healthcare regulation: rating, screening and surveillance , 2012 .

[14]  Peter Willett,et al.  Distributed Target Detection in Sensor Networks Using Scan Statistics , 2009, IEEE Transactions on Signal Processing.

[15]  Meng Wang,et al.  Sketching for sequential change-point detection , 2015, EURASIP Journal on Advances in Signal Processing.

[16]  T Tango,et al.  A class of tests for detecting 'general' and 'focused' clustering of rare diseases. , 1995, Statistics in medicine.

[17]  D. Siegmund,et al.  Sequential multi-sensor change-point detection , 2012, 2013 Information Theory and Applications Workshop (ITA).

[18]  Mustafa M. Aral,et al.  Contaminant Source Location Identification in River Networks Using Water Quality Monitoring Systems for Exposure Analysis , 2011 .

[19]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[20]  Gaston H. Gonnet,et al.  On the LambertW function , 1996, Adv. Comput. Math..

[21]  Yongro Park,et al.  Statistical Process Control‐Based Intrusion Detection and Monitoring , 2014, Qual. Reliab. Eng. Int..

[22]  Olha Bodnar,et al.  Multivariate control charts based on a projection approach , 2005 .

[23]  R. Crosier Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[24]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[25]  Yajun Mei,et al.  An Adaptive Sampling Strategy for Online High-Dimensional Process Monitoring , 2015, Technometrics.

[26]  Stephen E. Fienberg,et al.  Discussion on the paper by Spiegelhalter, Sherlaw-Johnson, Bardsley, Blunt, Wood and Grigg , 2012 .

[27]  Christian Sonesson,et al.  A CUSUM framework for detection of space–time disease clusters using scan statistics , 2007, Statistics in medicine.

[28]  L. M. Berliner,et al.  Dimension-Reduced Modeling of Spatio-Temporal Processes , 2014 .

[29]  James R. Wilson,et al.  A distribution-free tabular CUSUM chart for autocorrelated data , 2007 .

[30]  Heungsun Hwang,et al.  Dimension-Reduced Clustering of Functional Data via Subspace Separation , 2017, Journal of Classification.

[31]  Erin E. Peterson,et al.  A Moving Average Approach for Spatial Statistical Models of Stream Networks , 2010 .

[32]  P A Rogerson,et al.  Surveillance systems for monitoring the development of spatial patterns. , 1997, Statistics in medicine.

[33]  James R. Wilson,et al.  Monitoring nonlinear profiles adaptively with a wavelet-based distribution-free CUSUM chart , 2015 .

[34]  Rebecca Willett,et al.  Change-Point Detection for High-Dimensional Time Series With Missing Data , 2012, IEEE Journal of Selected Topics in Signal Processing.

[35]  Carlo Gaetan,et al.  Spatial Statistics and Modeling , 2009 .

[36]  J. Healy A note on multivariate CUSUM procedures , 1987 .

[37]  Wei Jiang,et al.  Spatiotemporal surveillance methods in the presence of spatial correlation , 2011, Statistics in medicine.

[38]  Mi Lim Lee,et al.  Spatiotemporal biosurveillance with spatial clusters: control limit approximation and impact of spatial correlation , 2014 .