Empirical Likelihood Ratio Test With Distribution Function Constraints

In this work, we study non-parametric hypothesis testing problem with distribution function constraints. The empirical likelihood ratio test has been widely used in testing problems with moment (in)equality constraints. However, some detection problems cannot be described using moment (in)equalities. We propose a distribution function constraint along with an empirical likelihood ratio test. This detector is applicable to a wide variety of robust parametric/non-parametric detection problems. Since the distribution function constraints provide a more exact description of the null hypothesis, the test outperforms the empirical likelihood ratio test with moment constraints as well as many popular goodness-of-fit tests, such as the robust Kolmogorov-Smirnov test and the Cramér-von Mises test. Examples from communication systems with real-world noise samples are provided to show their performance. Specifically, the proposed test significantly outperforms the robust Kolmogorov-Smirnov test and the Cramér-von Mises test when the null hypothesis is nested in the alternative hypothesis. The same example is repeated when we assume no noise uncertainty. By doing so, we are able to claim that in our case, it is necessary to include uncertainty in noise distribution. Additionally, the asymptotic optimality of the proposed test is provided.

[1]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[2]  H. Lilliefors On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[3]  A. Owen Empirical likelihood ratio confidence intervals for a single functional , 1988 .

[4]  A. W. van der Vaart,et al.  Uniform Central Limit Theorems , 2001 .

[5]  Ahmed H. Tewfik,et al.  A Framework for Inference Using Goodness of Fit Tests Based on Ensemble of Phi-Divergences , 2013, IEEE Transactions on Signal Processing.

[6]  R. Dudley,et al.  Uniform Central Limit Theorems: Notation Index , 2014 .

[7]  David Middleton,et al.  Non-Gaussian Noise Models in Signal Processing for Telecommunications: New Methods and Results for Class A and Class B Noise Models , 1999, IEEE Trans. Inf. Theory.

[8]  Bernard C. Levy,et al.  Principles of Signal Detection and Parameter Estimation , 2008 .

[9]  Anant Sahai,et al.  SNR Walls for Signal Detection , 2008, IEEE Journal of Selected Topics in Signal Processing.

[10]  Adam M. Rosen,et al.  Confidence Sets for Partially Identified Parameters that Satisfy a Finite Number of Moment Inequalities , 2006 .

[11]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[12]  P. J. Huber A Robust Version of the Probability Ratio Test , 1965 .

[13]  Ofer Zeitouni,et al.  On universal hypotheses testing via large deviations , 1991, IEEE Trans. Inf. Theory.

[14]  David Middleton Canonical Non-Gaussian Noise Models: Their Implications for Measurement and for Prediction of Receiver Performance , 1979, IEEE Transactions on Electromagnetic Compatibility.

[15]  J. Wellner,et al.  GOODNESS-OF-FIT TESTS VIA PHI-DIVERGENCES , 2006, math/0603238.

[16]  Yuichi Kitamura,et al.  On the Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions , 2001 .

[17]  Ivan A. Canay EL inference for partially identified models: Large deviations optimality and bootstrap validity , 2010 .

[18]  Neri Merhav,et al.  When is the generalized likelihood ratio test optimal? , 1992, IEEE Trans. Inf. Theory.

[19]  T. W. Anderson On the Distribution of the Two-Sample Cramer-von Mises Criterion , 1962 .

[20]  A. Owen Empirical Likelihood Ratio Confidence Regions , 1990 .

[21]  W. Hoeffding Asymptotically Optimal Tests for Multinomial Distributions , 1965 .

[22]  F. Massey The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[23]  J. Lawless,et al.  Empirical Likelihood and General Estimating Equations , 1994 .

[24]  D. Darling,et al.  A Test of Goodness of Fit , 1954 .

[25]  Sean P. Meyn,et al.  On thresholds for robust goodness-of-fit tests , 2010, 2010 IEEE Information Theory Workshop.

[26]  Bernard C. Levy,et al.  Robust Hypothesis Testing With a Relative Entropy Tolerance , 2007, IEEE Transactions on Information Theory.

[27]  Ralph B. D'Agostino,et al.  Goodness-of-Fit-Techniques , 2020 .