Optimal Sequential Detection of Signals With Unknown Appearance and Disappearance Points in Time

This article addresses a sequential changepoint detection problem, assuming that the duration of change may be finite and unknown. This problem is of importance for many applications, e.g., for signal and image processing where signals appear and disappear at unknown points in time or space. In contrast to the conventional optimality criterion in quickest change detection that requires minimization of the expected delay to detection for a given average run length to a false alarm, we focus on a reliable maximin change detection criterion of maximizing the minimal probability of detection in a given time (or space) window for a given local maximal probability of false alarm in the prescribed window. We show that the optimal detection procedure is a modified CUSUM procedure. We then compare operating characteristics of this optimal procedure with popular in engineering the Finite Moving Average (FMA) detection algorithm and the ordinary CUSUM procedure using Monte Carlo simulations, which show that typically the later algorithms have almost the same performance as the optimal one. At the same time, the FMA procedure has a substantial advantage – independence to the intensity of the signal, which is usually unknown. Finally, the FMA algorithm is applied to detecting faint streaks of satellites in optical images.

[1]  George V. Moustakides,et al.  Multiple Optimality Properties of the Shewhart Test , 2014, 1401.3408.

[2]  A. E. Kolessa Detection of Faint Space Debris Elements with Unknown Orbits , 2013 .

[3]  Pieter Bastiaan Ober,et al.  Sequential analysis: hypothesis testing and changepoint detection , 2015 .

[4]  Gonzalo Seco-Granados,et al.  Performance Bounds for Finite Moving Average Tests in Transient Change Detection , 2018, IEEE Transactions on Signal Processing.

[5]  A. Tartakovsky Sequential Change Detection and Hypothesis Testing , 2019 .

[6]  Ehsan Ebrahimzadeh,et al.  Sequential detection of transient changes in stochastic systems under a sampling constraint , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[7]  Mark A. Richards,et al.  Fundamentals of Radar Signal Processing , 2005 .

[8]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .

[9]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[10]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[11]  J. Brown,et al.  Adaptive spatial-temporal filtering methods for clutter removal and target tracking , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Moshe Pollak,et al.  Asymptotic Exponentiality of the Distribution of First Exit Times for a Class of Markov Processes with Applications to Quickest Change Detection , 2006 .

[13]  Igor Nikiforov,et al.  Detecting a Suddenly Arriving Dynamic Profile of Finite Duration , 2017, IEEE Transactions on Information Theory.

[14]  Sylvie Buteau,et al.  Image processing technique for automatic detection of satellite streaks , 2007 .

[15]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[16]  Shaofeng Zou,et al.  Asymptotic optimality of D-CuSum for quickest change detection under transient dynamics , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[17]  Alexander G. Tartakovsky,et al.  Rapid Detection of Attacks in Computer Networks by Quickest Changepoint Detection Methods , 2014 .

[18]  V. G. Repin Detecting a signal with unknown moments of appearance and disappearance , 1991 .

[19]  Alexander G. Tartakovsky,et al.  Efficient Computer Network Anomaly Detection by Changepoint Detection Methods , 2012, IEEE Journal of Selected Topics in Signal Processing.

[20]  Peter Willett,et al.  Feature article: security of SCADA systems against cyber–physical attacks , 2017, IEEE Aerospace and Electronic Systems Magazine.

[21]  I. Nikiforov,et al.  Reliable detection of faults in measurement systems , 2000 .

[22]  B. Brodsky,et al.  Discussion on “Is Average Run Length to False Alarm Always an Informative Criterion?” by Yajun Mei , 2008 .

[23]  Georgios Rovatsos,et al.  Quickest change detection under transient dynamics , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Vojtech Cvrcek,et al.  Detection and Certification of Faint Streaks in Astronomical Images , 2019, VISIGRAPP.

[25]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[26]  H. Poor Quickest detection with exponential penalty for delay , 1998 .

[27]  V. Veeravalli,et al.  Bayesian Quickest Transient Change Detection , 2010 .

[28]  Moshe Pollak,et al.  Shewhart Revisited , 2013 .

[29]  V. Veeravalli,et al.  Sequential algorithms for moving anomaly detection in networks , 2020 .

[30]  P. Hickson A fast algorithm for the detection of faint orbital debris tracks in optical images , 2018, Advances in Space Research.

[31]  I. Nikiforov,et al.  Sequential Detection of Transient Changes , 2012 .

[32]  A. Zhigljavsky,et al.  Power of the MOSUM test for online detection of a transient change in mean , 2020, Sequential Analysis.

[33]  Rudolf B. Blazek,et al.  Detection of intrusions in information systems by sequential change-point methods , 2005 .