Cliff's Delta Calculator: A non-parametric effect size program for two groups of observations

The Cliff´s Delta statistic is an effect size measure that quantifies the amount of difference between two non-parametric variables beyond p-values interpretation. This measure can be understood as a useful complementary analysis for the corresponding hypothesis testing. During the last two decades the use of effect size measures has been strongly encouraged by methodologists and leading institutions of behavioral sciences. The aim of this contribution is to introduce the Cliff´s Delta Calculator software that performs such analysis and offers some interpretation tips. Differences and similarities with the parametric case are analysed and illustrated. The implementation of this free program is fully described and compared with other calculators. Alternative algorithmic approaches are mathematically analysed and a basic linear algebra proof of its equivalence is formally presented. Two worked examples in cognitive psychology are commented. A visual interpretation of Cliff´s Delta is suggested. Availability, installation and applications of the program are presented and discussed.

[1]  M. Kendall.  Statistical Methods for Research Workers , 1937, Nature.

[2]  Gerd Gigerenzer,et al.  The empire of chance , 1989 .

[3]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[4]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[5]  Gerd Gigerenzer,et al.  The superego, the ego, and the id in statistical reasoning , 1993 .

[6]  N. Cliff.  Dominance statistics: Ordinal analyses to answer ordinal questions. , 1993 .

[7]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[8]  Bruce Thompson.  The concept of statistical significance testing , 1994 .

[9]  J. S. Meca,et al.  Pruebas de significación y magnitud del efecto:Reflexiones y propuestas , 1997 .

[10]  W. Dunlap,et al.  On the Logic and Purpose of Significance Testing , 1997 .

[11]  Margaret Epp,et al.  The earth is round , 1998 .

[12]  Jeffrey D. Kromrey,et al.  Analysis Options for Testing Group Differences on Ordered Categorical Variables: An Empirical Investigation of Type I Error Control and Statistical Power , 1998 .

[13]  Bruce Thompson,et al.  Statistical Significance and Effect Size Reporting: Portrait of a Possible Future. , 1998 .

[14]  Jeffrey D. Kromrey,et al.  Using SAS to Calculate Tests of Cliff ’ s Delta , 1999 .

[15]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[16]  Sample size determination for at test given at value from a previous study: A FORTRAN 77 program , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[17]  J. Krueger,et al.  Null hypothesis significance testing. On the survival of a flawed method. , 2001, The American psychologist.

[18]  Jeffrey D. Kromrey,et al.  Robust Confidence Intervals for Effect Sizes: A Comparative Study of Cohen's d and Cliff's Delta Under Non-normality and Heterogeneous Variances , 2004 .

[19]  R. Bakeman.  Recommended effect size statistics for repeated measures designs , 2005, Behavior research methods.

[20]  R. Grissom,et al.  Effect sizes for research: A broad practical approach. , 2005 .

[21]  Michael J Strube,et al.  SNOOP: A program for demonstrating the consequences of premature and repeated null hypothesis testing , 2006, Behavior research methods.

[22]  Michael Friendly,et al.  Visual Statistics: Seeing Data with Dynamic Interactive Graphics , 2006 .

[23]  Computing the power of a t test , 2007 .

[24]  Nuria Cortada de Kohan,et al.  TAMAÑO DEL EFECTO: REVISIÓN TEÓRICA Y APLICACIONES CON EL SISTEMA ESTADÍSTICO ViSta , 2008 .

[25]  G. Macbeth,et al.  Evidencia de priming gustativo y su disociación con la memoria explícita , 2008 .

[26]  Guillermo Macbeth,et al.  UNDERCONFIDENCE BIAS AS A SPECIFIC-DOMAIN PHENOMENON , 2009 .

[27]  Rubén Daniel Ledesma,et al.  Computing Effect Size Measures with ViSta - The Visual Statistics System , 2009 .

[28]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[29]  Null Hypothesis Significance Testing , 2010 .

[30]  Wei Pan,et al.  A Comprehensive Review of Effect Size Reporting and Interpreting Practices in Academic Journals in Education and Psychology. , 2010 .