A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong

McGraw and Wong (1992) described an appealing index of effect size, called CL, which measures the difference between two populations in terms of the probability that a score sampled at random from the first population will be greater than a score sampled at random from the second. McGraw and Wong introduced this "common language effect size statistic" for normal distributions and then proposed an approximate estimation for any continuous distribution. In addition, they generalized CL to the n-group case, the correlated samples case, and the discrete values case. In the current paper a different generalization of CL, called the A measure of stochastic superiority, is proposed, which may be directly applied for any discrete or continuous variable that is at least ordinally scaled. Exact methods for point and interval estimation as well as the significance tests of the A = .5 hypothesis are provided. New generalizations ofCL are provided for the multi-group and correlated samples cases.

[1]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[2]  William Kruskal,et al.  A Nonparametric test for the Several Sample Problem , 1952 .

[3]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[4]  Maurice G. Kendall,et al.  The Advanced Theory of Statistics, Vol. 2: Inference and Relationship , 1979 .

[5]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[6]  P. Levy,et al.  Substantive significance of significant differences between two groups. , 1967, Psychological bulletin.

[7]  J. Walsh.  Elements of Nonparametric Statistics , 1968 .

[8]  H. Friedman.  Magnitude of experimental effect and a table for its rapid estimation. , 1968 .

[9]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[10]  J. Hájek.  A course in nonparametric statistics , 1969 .

[11]  E. Lehmann,et al.  Nonparametrics: Statistical Methods Based on Ranks , 1976 .

[12]  A. Sockloff,et al.  Statistical power analysis for the behavioral sciences: (revised edition), by Jacob Cohen. New York: Academic Press, 1977, xv + 474 pp., $24.50. , 1978 .

[13]  Pandu R. Tadikamalla,et al.  A Probability Distribution and its Uses in Fitting Data , 1979 .

[14]  Douglas A. Wolfe,et al.  Introduction to the Theory of Nonparametric Statistics. , 1980 .

[15]  R. Randles,et al.  Introduction to the Theory of Nonparametric Statistics , 1991 .

[16]  George E. Policello,et al.  Robust Rank Procedures for the Behrens-Fisher Problem , 1981 .

[17]  Donald B. Rubin,et al.  A Simple, General Purpose Display of Magnitude of Experimental Effect , 1982 .

[18]  Pairwise versus joint ranking: Another look at the Kruskal-Wallis statistic , 1985 .

[19]  S. Hora.  Statistical Inference Based on Ranks , 1986 .

[20]  Ronald H. Rnndles.  Nonparametric Statistical Inference (2nd ed.) , 1986 .

[21]  J. Miller,et al.  A warning about median reaction time. , 1988, Journal of experimental psychology. Human perception and performance.

[22]  T. Micceri.  The unicorn, the normal curve, and other improbable creatures. , 1989 .

[23]  R. Wilcox.  Determining whether an experimental group is stochastically larger than a control , 1990 .

[24]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[25]  K. McGraw,et al.  A common language effect size statistic. , 1992 .

[26]  Bruno D. Zumbo,et al.  Parametric Alternatives to the Student T Test under Violation of Normality and Homogeneity of Variance , 1992 .

[27]  Patrick Onghena,et al.  A theoretical and empirical comparison of mainframe, microcomputer, and pocket calculator pseudorandom number generators , 1993 .

[28]  Gideon Keren,et al.  A Handbook for data analysis in the behavioral sciences : methodological issues , 1993 .

[29]  Bruno D. Zumbo,et al.  The relative power of parametric and nonparametric statistical methods. , 1993 .

[30]  M. C. Jones,et al.  3. Nonparametric Statistical Inference , 1993 .

[31]  N. Cliff.  Dominance statistics: Ordinal analyses to answer ordinal questions. , 1993 .

[32]  D. W. Zimmerman,et al.  Rank Transformations and the Power of the Student T Test and Welch T' Test for Non-Normal Populations with Unequal Variances , 1993 .

[33]  J. S. Maritz,et al.  Distribution-Free Statistical Methods , 1996 .

[34]  Bruno D. Zumbo,et al.  Investigation of the Robust Rank-Order Test for Non-Normal Populations with Unequal Variances: The Case of Reaction Time , 1997 .

[35]  Harold D. Delaney,et al.  The Kruskal-Wallis Test and Stochastic Homogeneity , 1998 .

[36]  Philip H. Ramsey.  Nonparametric Statistical Methods , 1974, Technometrics.