Exact unconditional tests for a 2 × 2 matched-pairs design

The problem of comparing two proportions in a 2 × 2 matched-pairs design with binary responses is considered. We consider one-sided null and alternative hypotheses. The problem has two nuisance parameters. Using the monotonicity of the multinomial distribution, four exact unconditional tests based on p-values are proposed by reducing the dimension of the nuisance parameter space from two to one in computation. The size and power of the four exact tests and two other tests, the exact conditional binomial test and the asymptotic McNemar’s test, are considered. It is shown that the tests based on the confidence interval p-value are more powerful than the tests based on the standard p-value. In addition, it is found that the exact conditional binomial test is conservative and not powerful for testing the hypothesis. Moreover, the asymptotic McNemar’s test is shown to have incorrect size; that is, its size is larger than the nominal level of the test. Overall, the test based on McNemar’s statistic and the confidence interval p-value is found to be the most powerful test with the correct size among the tests in this comparison.

[1]  E. Lehmann.  Testing Statistical Hypotheses , 1960 .

[2]  J. Shuster,et al.  The 2 x 2 matched-pairs trial: exact unconditional design and analysis. , 1991, Biometrics.

[3]  Choongrak Kim,et al.  Exact Properties of Some Exact Test Statistics for Comparing Two Binomial Proportions , 1990 .

[4]  Unconditional Exact Tests for Equivalence or Noninferiority for Paired Binary Endpoints , 2001, Biometrics.

[5]  Q. Mcnemar.  Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[6]  P. Bickel,et al.  Mathematical Statistics: Basic Ideas and Selected Topics , 1977 .

[7]  R. Berger,et al.  P Values Maximized Over a Confidence Set for the Nuisance Parameter , 1994 .

[8]  G. A. Barnard,et al.  THE MEANING OF A SIGNIFICANCE LEVEL , 1947 .

[9]  J J Chen,et al.  An approximate unconditional test of non-inferiority between two proportions. , 2000, Statistics in medicine.

[10]  W. G. Cochran.  The comparison of percentages in matched samples. , 1950, Biometrika.

[11]  Moshe Shaked,et al.  Stochastic orders and their applications , 1994 .

[12]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[13]  E. S. Pearson,et al.  THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL , 1934 .

[14]  Roger L. Berger,et al.  More Powerful Tests from Confidence Interval p Values , 1996 .

[15]  F. T. Wright,et al.  Order restricted statistical inference , 1988 .

[16]  G. Barnard.  Significance tests for 2 X 2 tables. , 1947, Biometrika.