Optimality of CUSUM Rule Approximations in Change-Point Detection Problems: Application to Nonlinear State–Space Systems

The well-known cumulative sum (CUSUM) sequential rule for abrupt model change detection in stochastic dynamic systems relies on the knowledge of the probability density functions of the system output variables conditional on their past values and on the system functioning mode at each time step. This paper shows how to build an asymptotically optimal detection rule under the common average run length (ARL) constraint when these densities are not available but can be consistently estimated. This is the case for nonlinear state-space systems observed through output variables: for such systems, a new class of particle filters based on convolution kernels allows to get consistent estimates of the conditional densities, leading to an optimal CUSUM-like filter detection rule (FDR).

[1]  Vivien Rossi,et al.  Approche non paramétrique du filtrage de système non linéaire à temps discret et à paramètres inconnus , 2005 .

[2]  Christophe Andrieu,et al.  Particle methods for change detection, system identification, and control , 2004, Proceedings of the IEEE.

[3]  OPTIMAL CHANGE POINT DETECTION IN STATE SPACE MODELS , .

[4]  B. Azimi-Sadjadi,et al.  Change detection for nonlinear systems; a particle filtering approach , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[5]  L. Devroye.  A Course in Density Estimation , 1987 .

[6]  H. Vincent Poor,et al.  Online activity detection in a multiuser environment using the matrix CUSUM Algorithm , 2002, IEEE Trans. Inf. Theory.

[7]  T. Lai.  Asymptotic Optimality of Invariant Sequential Probability Ratio Tests , 1981 .

[8]  F. Gland,et al.  STABILITY AND UNIFORM APPROXIMATION OF NONLINEAR FILTERS USING THE HILBERT METRIC AND APPLICATION TO PARTICLE FILTERS1 , 2004 .

[9]  G. Moustakides.  Optimal stopping times for detecting changes in distributions , 1986 .

[10]  Igor V. Nikiforov,et al.  A generalized change detection problem , 1995, IEEE Trans. Inf. Theory.

[11]  Jean-Pierre Vila,et al.  Nonlinear filtering in discrete time : A particle convolution approach , 2006 .

[12]  A. Willsky,et al.  A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems , 1976 .

[13]  Alexander G. Tartakovsky.  ASYMPTOTIC OPTIMALITY IN BAYESIAN CHANGEPOINT DETECTION PROBLEMS UNDER GLOBAL FALSE ALARM PROBABILITY CONSTRAINT , 2006 .

[14]  Qinghua Zhang,et al.  Nonlinear system fault detection and isolation based on bootstrap particle filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[15]  Jean-Pierre Vila,et al.  Adaptive threshold computation for CUSUM-type procedures in change detection and isolation problems , 2008, Comput. Stat. Data Anal..

[16]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[17]  V. Veeravalli,et al.  General Asymptotic Bayesian Theory of Quickest Change Detection , 2005 .

[18]  Tze Leung Lai,et al.  Efficient recursive algorithms for detection of abrupt changes in signals and control systems , 1999, IEEE Trans. Autom. Control..

[19]  Visakan Kadirkamanathan,et al.  Fault detection and isolation in non-linear stochastic systems—A combined adaptive Monte Carlo filtering and likelihood ratio approach , 2004 .

[20]  Y. Ritov.  Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[21]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[22]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[23]  P. Moral.  Nonlinear Filtering Using Random Particles , 1996 .

[24]  I. V. Nikiforov,et al.  A lower bound for the detection/isolation delay in a class of sequential tests , 2003, IEEE Trans. Inf. Theory.

[25]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[26]  G. Lorden.  PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[27]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[28]  Igor V. Nikiforov.  A simple recursive algorithm for diagnosis of abrupt changes in random signals , 2000, IEEE Trans. Inf. Theory.

[29]  Rakesh K. Bansal,et al.  An algorithm for detecting a change in a stochastic process , 1986, IEEE Trans. Inf. Theory.

[30]  Cheng-Der Fuh,et al.  SPRT and CUSUM in hidden Markov models , 2003 .

[31]  Tze Leung Lai.  Sequential multiple hypothesis testing and efficient fault detection-isolation in stochastic systems , 2000, IEEE Trans. Inf. Theory.

[32]  Visakan Kadirkamanathan,et al.  Particle filtering based likelihood ratio approach to fault diagnosis in nonlinear stochastic systems , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[33]  Stephen S. Wilson,et al.  Random iterative models , 1996 .