Comparisons of various types of normality tests

Normality tests can be classified into tests based on chi-squared, moments, empirical distribution, spacings, regression and correlation and other special tests. This paper studies and compares the power of eight selected normality tests: the Shapiro–Wilk test, the Kolmogorov–Smirnov test, the Lilliefors test, the Cramer–von Mises test, the Anderson–Darling test, the D'Agostino–Pearson test, the Jarque–Bera test and chi-squared test. Power comparisons of these eight tests were obtained via the Monte Carlo simulation of sample data generated from alternative distributions that follow symmetric short-tailed, symmetric long-tailed and asymmetric distributions. Our simulation results show that for symmetric short-tailed distributions, D'Agostino and Shapiro–Wilk tests have better power. For symmetric long-tailed distributions, the power of Jarque–Bera and D'Agostino tests is quite comparable with the Shapiro–Wilk test. As for asymmetric distributions, the Shapiro–Wilk test is the most powerful test followed by the Anderson–Darling test.

[1]  K. Pearson.  On the Criterion that a Given System of Deviations from the Probable in the Case of a Correlated System of Variables is Such that it Can be Reasonably Supposed to have Arisen from Random Sampling , 1900 .

[2]  Richard Von Mises,et al.  Wahrscheinlichkeitsrechnung und ihre Anwendung in der Statistik und theoretischen Physik , 1931 .

[3]  AN Kolmogorov-Smirnov,et al.  Sulla determinazione empírica di uma legge di distribuzione , 1933 .

[4]  A. Wald,et al.  On the Choice of the Number of Class Intervals in the Application of the Chi Square Test , 1942 .

[5]  F. Mosteller,et al.  Low Moments for Small Samples: A Comparative Study of Order Statistics , 1947 .

[6]  D. Darling,et al.  A Test of Goodness of Fit , 1954 .

[7]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[8]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[9]  S. Shapiro,et al.  A Comparative Study of Various Tests for Normality , 1968 .

[10]  M. Stephens,et al.  Further percentage points for WN2 , 1968 .

[11]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean Unknown , 1969 .

[12]  S. Shapiro,et al.  An Approximate Analysis of Variance Test for Normality , 1972 .

[13]  E. S. Pearson,et al.  Tests for departure from normality. Empirical results for the distributions of b2 and √b1 , 1973 .

[14]  Benno Schorr,et al.  On the choice of the class intervals in the application of the chi-square test , 1974 .

[15]  B. Schmeiser,et al.  An approximate method for generating asymmetric random variables , 1974, CACM.

[16]  S. Weisberg,et al.  An Approximate Analysis of Variance Test for Non-Normality Suitable for Machine Calculation , 1975 .

[17]  L. Shenton,et al.  Omnibus test contours for departures from normality based on √b1 and b2 , 1975 .

[18]  E. S. Pearson,et al.  Tests for departure from normality: Comparison of powers , 1977 .

[19]  R. A. Groeneveld,et al.  Practical Nonparametric Statistics (2nd ed). , 1981 .

[20]  J. Royston.  Expected Normal Order Statistics (Exact and Approximate) , 1982 .

[21]  J. Royston.  The W Test for Normality , 1982 .

[22]  J. Royston.  An Extension of Shapiro and Wilk's W Test for Normality to Large Samples , 1982 .

[23]  Asymptotic Results on the Greenwood Statistic and Some of its Generalizations , 1984 .

[24]  Leland Wilkinson,et al.  An Analytic Approximation to the Distribution of Lilliefors's Test Statistic for Normality , 1986 .

[25]  Ralph B. D'Agostino,et al.  Goodness-of-Fit-Techniques , 2020 .

[26]  Anil K. Bera,et al.  A test for normality of observations and regression residuals , 1987 .

[27]  R. D'Agostino,et al.  A Suggestion for Using Powerful and Informative Tests of Normality , 1990 .

[28]  P. Royston.  Approximating the Shapiro-Wilk W-test for non-normality , 1992 .

[29]  A. Martin-Löf.  On the composition of elementary errors , 1994 .

[30]  P. Royston.  A Remark on Algorithm as 181: The W‐Test for Normality , 1995 .

[31]  Z. Govindarajulu,et al.  A modification of the test of Shapiro and Wilk for normality , 1997 .

[32]  C. H. Sim,et al.  Goodness-of-fit test based on empirical characterisitc function , 2000 .

[33]  David J. Groggel,et al.  Practical Nonparametric Statistics , 2000, Technometrics.

[34]  Thomas E. Wehrly.  Fitting Statistical Distributions: The Generalized Lambda Distribution and Generalized Bootstrap Methods , 2002, Technometrics.

[35]  S. Keskin.  Comparison of Several Univariate Normality Tests Regarding Type I Error Rate and Power of the Test in Simulation based Small Samples , 2006 .

[36]  P. Farrell,et al.  Comprehensive study of tests for normality and symmetry: extending the Spiegelhalter test , 2006 .

[37]  A. Elhan,et al.  Investigation of Four Different Normality Tests in Terms of Type 1 Error Rate and Power under Different Distributions , 2006 .

[38]  H. Büning,et al.  Jarque–Bera Test and its Competitors for Testing Normality – A Power Comparison , 2007 .

[39]  B. Yazici,et al.  A comparison of various tests of normality , 2007 .

[40]  Karl Pearson F.R.S..  X. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling , 2009 .