Change detection with unknown post-change parameter using Kiefer-Wolfowitz method

We consider a change detection problem with an unknown post-change parameter. The optimal algorithm in minimizing worst case detection delay subject to a constraint on average run length, referred as parallel CUSUM, is computationally expensive. We propose a low complexity algorithm based on parameter estimation using Kiefer-Wolfowitz (KW) method with CUSUM based change detection. We also consider a variant of KW method where the tuning sequences of KW method are reset periodically. We study the performance under the Gaussian mean change model. Our results show that reset KW-CUSUM performs close to the parallel CUSUM in terms of worst case delay versus average run length. Non-reset KW-CUSUM algorithm has smaller probability of false alarm compared to the existing algorithms, when run over a finite duration.

[1]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .

[2]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[3]  Igor V. Nikiforov A suboptimal quadratic change detection scheme , 2000, IEEE Trans. Inf. Theory.

[4]  Yajun Mei,et al.  Is Average Run Length to False Alarm Always an Informative Criterion? , 2008 .

[5]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[6]  Taposh Banerjee,et al.  Quickest Change Detection , 2012, ArXiv.

[7]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[8]  Yajun Mei,et al.  Quickest detection in censoring sensor networks , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[9]  Vinod Sharma,et al.  Generalized Analysis of a Distributed Energy Efficient Algorithm for Change Detection , 2009, IEEE Transactions on Wireless Communications.

[10]  Huaiyu Dai,et al.  Adaptive quickest change detection with unknown parameter , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  J. Norris Appendix: probability and measure , 1997 .

[12]  Srikrishna Bhashyam,et al.  Algorithms for change detection with unknown number of affected sensors , 2013, 2013 National Conference on Communications (NCC).

[13]  H. Robbins A Stochastic Approximation Method , 1951 .

[14]  J. Kiefer,et al.  Stochastic Estimation of the Maximum of a Regression Function , 1952 .

[15]  Mark Broadie,et al.  General Bounds and Finite-Time Improvement for the Kiefer-Wolfowitz Stochastic Approximation Algorithm , 2011, Oper. Res..