Effect size estimates: current use, calculations, and interpretation.

The Publication Manual of the American Psychological Association (American Psychological Association, 2001, American Psychological Association, 2010) calls for the reporting of effect sizes and their confidence intervals. Estimates of effect size are useful for determining the practical or theoretical importance of an effect, the relative contributions of factors, and the power of an analysis. We surveyed articles published in 2009 and 2010 in the Journal of Experimental Psychology: General, noting the statistical analyses reported and the associated reporting of effect size estimates. Effect sizes were reported for fewer than half of the analyses; no article reported a confidence interval for an effect size. The most often reported analysis was analysis of variance, and almost half of these reports were not accompanied by effect sizes. Partial η2 was the most commonly reported effect size estimate for analysis of variance. For t tests, 2/3 of the articles did not report an associated effect size estimate; Cohen's d was the most often reported. We provide a straightforward guide to understanding, selecting, calculating, and interpreting effect sizes for many types of data and to methods for calculating effect size confidence intervals and power analysis.

[1]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[2]  G. Cumming Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis , 2011 .

[3]  Tobias Greitemeyer,et al.  Red, rank, and romance in women viewing men. , 2010, Journal of experimental psychology. General.

[4]  Paul D. Ellis,et al.  The essential guide to effect sizes : statistical power, meta-analysis, and the interpretation of research results , 2010 .

[5]  Thomas Günther Editorial , 2009, Document Numérique.

[6]  T. Baguley Standardized or simple effect size: what should be reported? , 2009, British journal of psychology.

[7]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[8]  Joseph R. Rausch,et al.  Sample size planning for statistical power and accuracy in parameter estimation. , 2008, Annual review of psychology.

[9]  G. Glass Primary, Secondary, and Meta-Analysis of Research , 2008 .

[10]  M Gallucci Effect sizes for research: A broad practical approach. Robert J Grissom, John J Kim, New Jersey: Erlbaum, 2005, Hardback £43.95 ISBN 0805850147 , 2007 .

[11]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[12]  R. McGrath,et al.  When effect sizes disagree: the case of r and d. , 2006, Psychological methods.

[13]  Joseph R. Rausch,et al.  Sample size planning for the standardized mean difference: accuracy in parameter estimation via narrow confidence intervals. , 2006, Psychological methods.

[14]  K. Goulden,et al.  Effect Sizes for Research: A Broad Practical Approach , 2006 .

[15]  J. P. Morgan,et al.  Design and Analysis: A Researcher's Handbook , 2005, Technometrics.

[16]  R. Bakeman Recommended effect size statistics for repeated measures designs , 2005, Behavior research methods.

[17]  R. Grissom,et al.  Effect sizes for research: A broad practical approach. , 2005 .

[18]  B. Thompson,et al.  How to Estimate and Interpret Various Effect Sizes , 2004 .

[19]  L. Hsu Biases of success rate differences shown in binomial effect size displays. , 2004, Psychological methods.

[20]  J. H. Steiger,et al.  Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. , 2004, Psychological methods.

[21]  J. Algina,et al.  Generalized eta and omega squared statistics: measures of effect size for some common research designs. , 2003, Psychological methods.

[22]  K. Bird,et al.  Confidence Intervals for Effect Sizes in Analysis of Variance , 2002 .

[23]  C. J. Huberty,et al.  A History of Effect Size Indices , 2002 .

[24]  R. J. Boik Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach , 2001 .

[25]  Bruce Thompson,et al.  Confidence Intervals for Effect Sizes , 2001 .

[26]  G. Cumming,et al.  A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions , 2001 .

[27]  Steff Lewis,et al.  Forest plots: trying to see the wood and the trees , 2001, BMJ : British Medical Journal.

[28]  J. Hoenig,et al.  Statistical Practice The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis , 2001 .

[29]  A. Vargha,et al.  A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong , 2000 .

[30]  D. Rubin,et al.  Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach , 1999 .

[31]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[32]  D. Rubin,et al.  Contrasts and Effect Sizes in Behavioral Research , 1999 .

[33]  G. Loftus Psychology Will Be a Much Better Science When We Change the Way We Analyze Data , 1996 .

[34]  John T. E. Richardson Measures of effect size , 1996 .

[35]  R. Abelson Statistics As Principled Argument , 1995 .

[36]  Jacob Cohen The earth is round (p < .05) , 1994 .

[37]  R. Grissom Probability of the superior outcome of one treatment over another. , 1994 .

[38]  Hugh Coolican Research methods and statistics in psychology, 2nd ed. , 1994 .

[39]  A. Aron,et al.  Statistics for Psychology , 1994 .

[40]  W. Schweigert,et al.  Research Methods and Statistics in Psychology , 2023 .

[41]  K. McGraw,et al.  A common language effect size statistic. , 1992 .

[42]  D. C. Howell Statistical methods for psychology, 3rd ed. , 1992 .

[43]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[44]  R. Rosenthal,et al.  Statistical Procedures and the Justification of Knowledge in Psychological Science , 1989 .

[45]  M. S. Patel,et al.  An introduction to meta-analysis. , 1989, Health Policy.

[46]  G. Newman,et al.  CONFIDENCE INTERVALS , 1987, The Lancet.

[47]  D. C. Howell Statistical Methods for Psychology , 1987 .

[48]  John P. Campbell,et al.  Editorial: Some Remarks From the Outgoing Editor. , 1982 .

[49]  L. Hedges Estimation of effect size from a series of independent experiments. , 1982 .

[50]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[51]  Jacob Cohen,et al.  The statistical power of abnormal-social psychological research: a review. , 1962, Journal of abnormal and social psychology.

[52]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[53]  Frank Yates,et al.  The Influence of Statistical Methods for Research Workers on the Development of the Science of Statistics , 1951 .

[54]  R. Wherry,et al.  A New Formula for Predicting the Shrinkage of the Coefficient of Multiple Correlation , 1931 .