Tests for Normality Based on Entropy Divergences

The normal distribution is among the most useful distributions in statistical applications. Accordingly, testing for normality is of fundamental importance in many fields including biopharmaceutical research. A generally powerful test for normality is the Shapiro-Wilk test, which can be derived based on estimated entropy divergence. Another well-known test for normality based on entropy divergence was proposed by Vasicek (1976) which has inspired the development of many goodness-of-fit tests for other important distributions. Despite extensive research on the subject, there still exists considerable confusion concerning the fundamental characteristics of Vasicek’s test. This article presents a unified derivation of both the Shapiro-Wilk test and Vasicek’s test based on estimated entropy divergence and clarifies some existing confusion. A comparative study of power performance for these two well-known tests for normality is presented with respect to a wide range of alternatives.

[1]  Kai-Sheng Song,et al.  Limit theorems for nonparametric sample entropy estimators , 2000 .

[2]  Birdal Senoglu,et al.  Goodness-of-fit tests based on Kullback-Leibler information , 2004, IEEE Transactions on Reliability.

[3]  R. Geary,et al.  Testing for Normality , 2003 .

[4]  Jin Zhang,et al.  Likelihood-ratio tests for normality , 2005, Comput. Stat. Data Anal..

[5]  N. Ebrahimi,et al.  Two measures of sample entropy , 1994 .

[6]  S. Shapiro,et al.  An Approximate Analysis of Variance Test for Normality , 1972 .

[7]  R. D'Agostino,et al.  A Suggestion for Using Powerful and Informative Tests of Normality , 1990 .

[8]  Daniele Coin,et al.  A goodness-of-fit test for normality based on polynomial regression , 2008, Comput. Stat. Data Anal..

[9]  K. Pearson.  On the Criterion that a Given System of Deviations from the Probable in the Case of a Correlated System of Variables is Such that it Can be Reasonably Supposed to have Arisen from Random Sampling , 1900 .

[10]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[11]  Karl Pearson F.R.S..  X. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling , 2009 .

[12]  R. D'Agostino.  An omnibus test of normality for moderate and large size samples , 1971 .

[13]  R. D'Agostino.  Small Sample Probability Points for the D Test of Normality , 1972 .

[14]  Nader Ebrahimi,et al.  Testing exponentiality based on Kullback-Leibler information , 1992 .

[15]  Byungjin Choi.  Improvement of goodness-of-fit test for normal distribution based on entropy and power comparison , 2008 .

[16]  S. Shapiro,et al.  A Comparative Study of Various Tests for Normality , 1968 .

[17]  Edward C. van der Meulen,et al.  Entropy-Based Tests of Uniformity , 1981 .

[18]  M. Stephens.  EDF Statistics for Goodness of Fit and Some Comparisons , 1974 .