Change Detection via Affine and Quadratic Detectors

The goal of the paper is to develop a specific application of the convex optimization based hypothesis testing techniques developed in A. Juditsky, A. Nemirovski, "Hypothesis testing via affine detectors," Electronic Journal of Statistics 10:2204--2242, 2016. Namely, we consider the Change Detection problem as follows: given an evolving in time noisy observations of outputs of a discrete-time linear dynamical system, we intend to decide, in a sequential fashion, on the null hypothesis stating that the input to the system is a nuisance, vs. the alternative stating that the input is a "nontrivial signal," with both the nuisances and the nontrivial signals modeled as inputs belonging to finite unions of some given convex sets. Assuming the observation noises zero mean sub-Gaussian, we develop "computation-friendly" sequential decision rules and demonstrate that in our context these rules are provably near-optimal.

[1]  Yajun Mei.  Asymptotic Optimality Theory for Decentralized Sequential Hypothesis Testing in Sensor Networks , 2008, IEEE Transactions on Information Theory.

[2]  Anatoli Juditsky,et al.  Hypothesis testing via affine detectors , 2016 .

[3]  M. Pollak.  Optimal Detection of a Change in Distribution , 1985 .

[4]  B. Brodsky,et al.  Nonparametric Methods in Change Point Problems , 1993 .

[5]  Farida Enikeeva,et al.  High-dimensional change-point detection with sparse alternatives , 2013, 1312.1900.

[6]  Oleg Lepski,et al.  On a multi-channel change-point problem , 2008 .

[7]  T. Lai.  Sequential changepoint detection in quality control and dynamical systems , 1995 .

[8]  Yu. I. Ingster,et al.  Classification of sparse high-dimensional vectors , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[9]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[10]  Taposh Banerjee,et al.  Quickest Change Detection , 2012, ArXiv.

[11]  D. Siegmund.  Sequential Analysis: Tests and Confidence Intervals , 1985 .

[12]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[13]  Georgios Fellouris,et al.  Second-Order Asymptotic Optimality in Multisensor Sequential Change Detection , 2016, IEEE Transactions on Information Theory.

[14]  Anatoli B. Juditsky,et al.  On sequential hypotheses testing via convex optimization , 2014, Autom. Remote. Control..

[15]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[16]  Benjamin Yakir,et al.  The Statistics of Gene Mapping , 2007 .

[17]  V. Guigues.  Nonparametric multivariate breakpoint detection for the means, variances, and covariances of a discrete time stochastic process , 2012 .

[18]  M. Pollak.  Average Run Lengths of an Optimal Method of Detecting a Change in Distribution. , 1987 .

[19]  Arjun K. Gupta,et al.  Parametric Statistical Change Point Analysis , 2000 .

[20]  NavalSurface WeaponsCenter.  Maneuvering Target Tracking Using Adaptive State Estimation , 1977 .

[21]  Yajun Mei,et al.  Scalable SUM-Shrinkage Schemes for Distributed Monitoring Large-Scale Data Streams , 2016 .

[22]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[23]  V. Veeravalli,et al.  Asymptotically Optimal Quickest Change Detection in Distributed Sensor Systems , 2008 .

[24]  A. Juditsky,et al.  Change-point estimation from indirect observations. 1. Minimax complexity , 2008 .

[25]  C'eline L'evy-Leduc,et al.  Detection and localization of change-points in high-dimensional network traffic data , 2009, 0908.2310.

[26]  G. Lorden.  PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[27]  G. Moustakides.  Optimal stopping times for detecting changes in distributions , 1986 .

[28]  W. Shewhart.  The Economic Control of Quality of Manufactured Product. , 1932 .

[29]  A. Shiryaev.  On Optimum Methods in Quickest Detection Problems , 1963 .

[30]  Alan S. Willsky.  Detection of abrupt changes in dynamic systems , 1985 .

[31]  Michael H. Neumann.  Optimal Change‐point Estimation in Inverse Problems , 1997 .

[32]  Change-point estimation from indirect observations 1 , 2007 .

[33]  L. Gordon,et al.  An Efficient Sequential Nonparametric Scheme for Detecting a Change of Distribution , 1994 .

[34]  Yu. I. Ingster,et al.  Detection boundary in sparse regression , 2010, 1009.1706.

[35]  A. Juditsky,et al.  Hypothesis testing by convex optimization , 2013, 1311.6765.

[36]  Y. Xie,et al.  Sequential Adaptive Detection for In-Situ Transmission Electron Microscopy (TEM) , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[37]  2 MULTICHANNEL CHANGE DETECTION : THEORY 17 . 2 . 1 Problem Formulation , 2003 .

[38]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .