The Other Half of the Story: Effect Size Analysis in Quantitative Research

Effect size measures are a key complement to statistical significance testing when reporting quantitative research findings. The authors provide a rationale for use of effect size and specific tools and guidelines for interpretation of results.

[1]  C. Ferguson.  An effect size primer: A guide for clinicians and researchers. , 2009 .

[2]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[3]  Joe W. Kotrlik,et al.  A Mediated Hierarchical Regression Analysis of Factors Related to Career Research Productivity of Human Resource Education and Development Postsecondary Faculty. , 2004 .

[4]  R. Nickerson,et al.  Null hypothesis significance testing: a review of an old and continuing controversy. , 2000, Psychological methods.

[5]  Paul D. Ellis,et al.  The essential guide to effect sizes : statistical power, meta-analysis, and the interpretation of research results , 2010 .

[6]  Jason W. Osborne,et al.  Sweating the small stuff in educational psychology: how effect size and power reporting failed to change from 1969 to 1999, and what that means for the future of changing practices 1 , 2008 .

[7]  Joe W. Kotrlik,et al.  The Incorporation of Effect Size in The Incorporation of Effect Size in Information Technology, Learning, Information Technology, Learning, and Performance Research and Performance Research , 2003 .

[8]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[9]  A Policy on Reporting of Effect Sizes. , 2000, Contemporary educational psychology.

[10]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[11]  Joel K. Abraham,et al.  Short Lesson Plan Associated with Increased Acceptance of Evolutionary Theory and Potential Change in Three Alternate Conceptions of Macroevolution in Undergraduate Students , 2012, CBE life sciences education.

[12]  Kelly E. Matthews,et al.  Using the Principles of BIO2010 to Develop an Introductory, Interdisciplinary Course for Biology Students , 2010, CBE life sciences education.

[13]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[14]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[15]  Jerry J. Vaske,et al.  Communicating Judgments About Practical Significance: Effect Size, Confidence Intervals and Odds Ratios , 2002 .

[16]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1965 .

[17]  Ian J Quitadamo,et al.  Learning to improve: using writing to increase critical thinking performance in general education biology. , 2007, CBE life sciences education.

[18]  B. Thompson.  Research news and Comment: AERA Editorial Policies Regarding Statistical Significance Testing: Three Suggested Reforms , 1996 .

[19]  Joe W. Kotrl.  The Incorporation of Effect Size in Information Technology , Learning , and Performance Research , 2003 .

[20]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[21]  Douglas H. Johnson.  The Insignificance of Statistical Significance Testing , 1999 .

[22]  R. Coe,et al.  It's the Effect Size, Stupid What effect size is and why it is important , 2012 .

[23]  V. Sampson,et al.  The Efficacy of Student-Centered Instruction in Supporting Science Learning , 2012, Science.

[24]  D. Rubin,et al.  r equivalent: A simple effect size indicator. , 2003, Psychological methods.

[25]  C. J. Huberty,et al.  A History of Effect Size Indices , 2002 .

[26]  Xitao Fan,et al.  Statistical Significance and Effect Size in Education Research: Two Sides of a Coin , 2001 .

[27]  T. Levine,et al.  Eta Squared, Partial Eta Squared, and Misreporting of Effect Size in Communication Research , 2002 .

[28]  Alan J. Gottesman,et al.  CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature , 2013, CBE life sciences education.

[29]  F. Juanes,et al.  The importance of statistical power analysis: an example from Animal Behaviour , 1996, Animal Behaviour.

[30]  Jennifer L. Momsen,et al.  Stereotyped: Investigating Gender in Introductory Science Courses , 2013, CBE life sciences education.

[31]  L. Hedges.  Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[32]  R. Kirk.  Practical Significance: A Concept Whose Time Has Come , 1996 .

[33]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[34]  Jacob Cohen.  Measurement Educational and Psychological Educational and Psychological Measurement Eta-squared and Partial Eta-squared in Fixed Factor Anova Designs Educational and Psychological Measurement Additional Services and Information For , 2022 .

[35]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[36]  K. McGraw,et al.  A common language effect size statistic. , 1992 .

[37]  G. Cumming,et al.  High Impact = High Statistical Standards? Not Necessarily So , 2013, PloS one.

[38]  James A. Rosenthal,et al.  Qualitative Descriptors of Strength of Association and Effect Size , 1996 .

[39]  Bruce Thompson,et al.  The Use of Statistical Significance Tests in Research: Bootstrap and Other Alternatives , 1993 .

[40]  Gang Xu,et al.  A Visitor's Guide to Effect Sizes – Statistical Significance Versus Practical (Clinical) Importance of Research Findings , 2004, Advances in health sciences education : theory and practice.