Quickest Change Detection in the Presence of a Nuisance Change

In the quickest change detection problem in which both nuisance and critical changes may occur, the objective is to detect the critical change as quickly as possible without raising an alarm when either there is no change or a nuisance change has occurred. A window-limited sequential change detection procedure based on the generalized likelihood ratio test statistic is proposed. A recursive update scheme for the proposed test statistic is developed and is shown to be asymptotically optimal under mild technical conditions. In the scenario where the post-change distribution belongs to a parametrized family, a generalized stopping time and a lower bound on its average run length are derived. The proposed stopping rule is compared with the finite moving average (FMA) stopping time and the naive 2-stage procedure that detects the nuisance or critical change using separate CuSum stopping procedures for the nuisance and critical changes. Simulations demonstrate that the proposed rule outperforms the FMA stopping time and the 2-stage procedure, and experiments on a real dataset on bearing failure verify the performance of the proposed stopping time.

[1]  Hoon Sohn,et al.  Structural Health Monitoring Using Statistical Process Control , 2000 .

[2]  Philip S. Yu,et al.  Review spam detection via temporal pattern discovery , 2012, KDD.

[3]  Taposh Banerjee,et al.  Data-Efficient Minimax Quickest Change Detection With Composite Post-Change Distribution , 2015, IEEE Transactions on Information Theory.

[4]  Shaofeng Zou,et al.  Quickest Change Detection Under Transient Dynamics: Theory and Asymptotic Analysis , 2019, IEEE Transactions on Information Theory.

[5]  V. Veeravalli,et al.  General Asymptotic Bayesian Theory of Quickest Change Detection , 2005 .

[6]  Yajun Mei,et al.  Quickest Change Detection and Kullback-Leibler Divergence for Two-State Hidden Markov Models , 2015, IEEE Transactions on Signal Processing.

[7]  Vikram Krishnamurthy,et al.  Quickest Detection POMDPs With Social Learning: Interaction of Local and Global Decision Makers , 2010, IEEE Transactions on Information Theory.

[8]  Venugopal V. Veeravalli,et al.  A Binning Approach to Quickest Change Detection With Unknown Postchange Distribution , 2018, IEEE Transactions on Signal Processing.

[9]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[10]  A. Willsky,et al.  A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems , 1976 .

[11]  C. Faloutsos,et al.  EVENT DETECTION IN TIME SERIES OF MOBILE COMMUNICATION GRAPHS , 2010 .

[12]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[13]  Vito M. R. Muggeo,et al.  Efficient change point detection for genomic sequences of continuous measurements , 2011, Bioinform..

[14]  Huazhong Yang,et al.  Drift detection and calibration of sensor networks , 2015, 2015 International Conference on Wireless Communications & Signal Processing (WCSP).

[15]  Taposh Banerjee,et al.  Quickest Change Detection , 2012, ArXiv.

[16]  Yu Wang,et al.  A Deep Learning Approach for Blind Drift Calibration of Sensor Networks , 2017, IEEE Sensors Journal.

[17]  Ali Tajer,et al.  Quickest Search for a Change Point , 2019, 2019 IEEE International Symposium on Information Theory (ISIT).

[18]  Tomasz Bojdecki Probability maximizing approach to optimal stopping and its application to a disorder problem , 1980 .

[19]  Douglas C. Montgomery,et al.  Using Control Charts to Monitor Process and Product Quality Profiles , 2004 .

[20]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[21]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[22]  C. Fuh Asymptotic operating characteristics of an optimal change point detection in hidden Markov models , 2004, math/0503682.

[23]  D. Siegmund,et al.  Using the Generalized Likelihood Ratio Statistic for Sequential Detection of a Change-Point , 1995 .

[24]  Y. Mei Asymptotically optimal methods for sequential change-point detection , 2003 .

[25]  Taposh Banerjee,et al.  Energy-efficient quickest change detection in sensor networks , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[26]  Wee Peng Tay,et al.  Optimal sampling policy for quickest change detection , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[27]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[28]  Wee Peng Tay,et al.  Asymptotically Optimal Quickest Change Detection under a Nuisance Change , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[30]  Mohammed J. Zaki,et al.  ADMIT: anomaly-based data mining for intrusions , 2002, KDD.

[31]  Wuqiong Luo,et al.  Infection Spreading and Source Identification: A Hide and Seek Game , 2015, IEEE Transactions on Signal Processing.

[32]  Vikram Krishnamurthy,et al.  Bayesian Sequential Detection With Phase-Distributed Change Time and Nonlinear Penalty—A POMDP Lattice Programming Approach , 2011, IEEE Transactions on Information Theory.

[33]  H. Vincent Poor,et al.  Quickest Detection in Cognitive Radio: A Sequential Change Detection Framework , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[34]  T. Lai Sequential changepoint detection in quality control and dynamical systems , 1995 .

[35]  Gonzalo Seco-Granados,et al.  Performance Bounds for Finite Moving Average Tests in Transient Change Detection , 2018, IEEE Transactions on Signal Processing.

[36]  M. Bauer,et al.  Digital change detection in forest ecosystems with remote sensing imagery , 1996 .

[37]  I. Nikiforov,et al.  Sequential Detection of Transient Changes , 2012 .

[38]  Hongjoong Kim,et al.  A novel approach to detection of intrusions in computer networks via adaptive sequential and batch-sequential change-point detection methods , 2006, IEEE Transactions on Signal Processing.

[39]  Wee-Peng Tay,et al.  A dynamic Bayesian nonparametric model for blind calibration of sensor networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Ehsan Ebrahimzadeh,et al.  Sequential detection of transient changes in stochastic systems under a sampling constraint , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[41]  Feng Ji,et al.  Estimating Infection Sources in Networks Using Partial Timestamps , 2017, IEEE Transactions on Information Forensics and Security.

[42]  David J. Hand,et al.  Statistical fraud detection: A review , 2002 .

[43]  George V. Moustakides,et al.  Multiple Optimality Properties of the Shewhart Test , 2014, 1401.3408.

[44]  Anna Scaglione,et al.  Distributed change detection in large scale sensor networks through the synchronization of pulse-coupled oscillators , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[45]  Alexander G. Tartakovsky,et al.  Rapid Detection of Attacks in Computer Networks by Quickest Changepoint Detection Methods , 2014 .

[46]  Cheng-Der Fuh,et al.  SPRT and CUSUM in hidden Markov models , 2003 .

[47]  Wee Peng Tay,et al.  Quickest Change Detection Under a Nuisance Change , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[48]  R. Cooke Real and Complex Analysis , 2011 .

[49]  Taposh Banerjee,et al.  Power system line outage detection and identification — A quickest change detection approach , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  George V. Moustakides Quickest Detection of Abrupt Changes for a Class of Random Processes , 1998, IEEE Trans. Inf. Theory.

[51]  Subhash Challa,et al.  Drift aware wireless sensor networks , 2007, 2007 10th International Conference on Information Fusion.

[52]  Feng Ji,et al.  An Algorithmic Framework for Estimating Rumor Sources With Different Start Times , 2017, IEEE Transactions on Signal Processing.

[53]  Moshe Pollak,et al.  Shewhart Revisited , 2013 .

[54]  George V. Moustakides,et al.  Sequentially detecting transitory changes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[55]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .