Density-Based Empirical Likelihood Ratio Change Point Detection Policies

Nonparametric detection of a change in distribution is studied when observations are independent. We provide a general method for constructing distribution-free change point detection schemes that have approximately likelihood structures. This method utilizes principles of the maximum empirical likelihood (EL) approach to approximate powerful parametric likelihood ratios. The product of the approximation can be associated with entropy-based test statistics. Entropy-based tests have been well addressed in the literature in the context of powerful decision rules for goodness of fit. We extend the entropy-based technique, using the EL principles. CUSUM and Shiryayev–Roberts (SR) detection policies are shown to be powerful parametric likelihood tests for detecting a change in distribution. We apply the proposed method to obtain nonparametric forms of the CUSUM and SR procedures. A Monte Carlo study demonstrates that the proposed method provides very efficient tests when comparing with the classical procedures. An example based on a real data is provided to demonstrate implementation and effectiveness of the new tests.

[1]  Edward C. van der Meulen,et al.  Entropy-Based Tests of Uniformity , 1981 .

[2]  Guaranteed maximum likelihood splitting tests of a linear regression model , 2006 .

[3]  Albert Vexler,et al.  Empirical likelihood ratios applied to goodness-of-fit tests based on sample entropy , 2010, Comput. Stat. Data Anal..

[4]  Dietmar Ferger,et al.  On the power of nonparametric changepoint-tests , 1994 .

[5]  A. Krieger,et al.  Surveillance of a Simple Linear Regression , 2003 .

[6]  Douglas A. Wolfe,et al.  Nonparametric statistical procedures for the changepoint problem , 1984 .

[7]  T. Lai Sequential changepoint detection in quality control and dynamical systems , 1995 .

[8]  Nonparametric AMOC Changepoint Tests for Stochastically Ordered Alternatives , 2006 .

[9]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[10]  H. Ohta,et al.  A Test for Normality Based on Kullback—Leibler Information , 1989 .

[11]  S. Ghosh,et al.  Ch. 31. Bayesian and frequentist methods in change-point problems , 2001 .

[12]  Retrospective Parametric Tests for Homogeneity of Data , 2007 .

[13]  Pranab Kumar Sen,et al.  Nonparametric Tests for Shift and Change in Regression at an Unknown Time Point , 1989 .

[14]  Oldrich A Vasicek,et al.  A Test for Normality Based on Sample Entropy , 1976 .

[15]  A. Vexler Martingale Type Statistics Applied to Change Points Detection , 2008 .

[16]  M. Srivastava,et al.  On Tests for Detecting Change in Mean , 1975 .

[17]  Nader Ebrahimi,et al.  Testing exponentiality based on Kullback-Leibler information , 1992 .

[18]  B. Whitcomb,et al.  An extension of a change-point problem , 2009 .

[19]  A. Owen Empirical Likelihood Ratio Confidence Regions , 1990 .

[20]  Albert Vexler,et al.  Change point problems in the model of logistic regression , 2005 .

[21]  Guaranteed testing for epidemic changes of a linear regression model , 2006 .

[22]  D. Siegmund,et al.  Tests for a change-point , 1987 .

[23]  Sangun Park,et al.  Correcting moments for goodness of fit tests based on two entropy estimates , 2003 .

[24]  Changliang Zou,et al.  Empirical likelihood ratio test for the change-point problem , 2007 .

[25]  E. Gombay U-Statistics for Change under Alternatives , 2001 .

[26]  E. Gombay U-statistics for sequential change detection , 2000 .

[27]  Enrique F Schisterman,et al.  Maximum Likelihood Ratio Tests for Comparing the Discriminatory Ability of Biomarkers Subject to Limit of Detection , 2008, Biometrics.

[28]  Paul L. Canner,et al.  A Simulation Study of One- and Two-Sample Kolmogorov-Smirnov Statistics with a Particular Weight Function , 1975 .

[29]  Xiaotong Shen,et al.  Empirical Likelihood , 2002 .

[30]  M. D. Martínez-Miranda,et al.  Computational Statistics and Data Analysis , 2009 .

[31]  Edit Gombay,et al.  An application of the maximum likelihood test to the change-point problem , 1994 .

[32]  L. Horváth,et al.  Invariance principles for changepoint problems , 1988 .

[33]  Ehsan S. Soofi,et al.  Bayes Estimate and Inference for Entropy and Information Index of Fit , 2008 .

[34]  A. N. PETTrrr A Non-parametric Approach to the Change-point Problem , 1979 .

[35]  L. Gordon,et al.  An Efficient Sequential Nonparametric Scheme for Detecting a Change of Distribution , 1994 .

[36]  A. Owen Empirical likelihood ratio confidence intervals for a single functional , 1988 .

[37]  Art B. Owen,et al.  Empirical Likelihood for Linear Models , 1991 .