Statistical tests for the comparison of two samples: The general alternative

ABSTRACT It is common to test the null hypothesis that two samples were drawn from identical distributions; and the Smirnov (sometimes called Kolmogorov–Smirnov) test is conventionally applied. We present simulation results to compare the performance of this test with three recently introduced alternatives. We consider both continuous and discrete data. We show that the alternative methods preserve type I error at the nominal level as well as the Smirnov test but offer superior power. We argue for the routine replacement of the Smirnov test with the modified Baumgartner test according to Murakami (2006), or with the test proposed by Zhang (2006).

[1]  Markus Neuhäuser,et al.  An exact two-sample test based on the baumgartner-weiss-schindler statistic and a modification of lepage's test , 2000 .

[2]  Jin Zhang,et al.  Powerful Two-Sample Tests Based on the Likelihood Ratio , 2006, Technometrics.

[3]  Christopher F. Baum,et al.  Instrumental Variables and GMM: Estimation and Testing , 2003 .

[4]  Vance W. Berger,et al.  Kolmogorov–Smirnov Tests , 2005 .

[5]  G. Ruxton,et al.  Round your numbers in rank tests: exact and asymptotic inference and ties , 2009, Behavioral Ecology and Sociobiology.

[6]  Marie Schmidt,et al.  Nonparametrics Statistical Methods Based On Ranks , 2016 .

[7]  A K-SAMPLE RANK TEST BASED ON MODIFIED BAUMGARTNER STATISTIC AND ITS POWER COMPARISON , 2006 .

[8]  Werner Baumgartner,et al.  A Nonparametric Test for the General Two-Sample Problem , 1998 .

[9]  Markus Neuhäuser,et al.  Nonparametric Statistical Tests: A Computational Approach , 2011 .

[10]  Markus Neuhäuser.  One-Sided two-sample and trend tests based on a modified baumgartner-weiss-schindler statistic , 2001 .

[11]  Ronald H. Randles,et al.  On Neutral Responses (Zeros) in the Sign Test and Ties in the Wilcoxon–Mann–Whitney Test , 2001 .

[12]  Dietrich Trenkler,et al.  Exact and randomization distributions of Kolmogorov-Smirnov tests two or three samples , 1995 .

[13]  Markus Neuhäuser.  A note on the exact test based on the Baumgartner-Weiß-Schindler statistic in the presence of ties , 2003, Comput. Stat. Data Anal..

[14]  K. Singleton,et al.  An omnibus test for the two-sample problem using the empirical characteristic function , 1986 .

[15]  Sebastian J. Goerg,et al.  Nonparametric Testing of Distributions—the Epps–Singleton Two-Sample Test using the Empirical Characteristic Function , 2009 .

[16]  Markus Neuhäuser,et al.  The Baumgartner-Weiss-Schindler test in the presence of ties. , 2002, Biometrics.