Effect Size Estimation: Factors to Consider and Mistakes to Avoid

In recent years, there has been an increase in the reporting of effect size information. This paper (a) provides a review of commonly used effect size indices, (b) highlights some common misconceptions about effect size estimates, and (c) introduces a number of infrequently used effect size measures which depending upon the research context and the audience may better communicate the importance of the relationship between two variables.

[1]  R. Abelson.  Statistics As Principled Argument , 1995 .

[2]  R. Rosenthal.  Parametric measures of effect size. , 1994 .

[3]  K. McGraw,et al.  A common language effect size statistic. , 1992 .

[4]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[5]  David M. Lane,et al.  Male-female differences: A computer simulation. , 1996 .

[6]  M. Oakes.  Statistical Inference: A Commentary for the Social and Behavioural Sciences , 1986 .

[7]  Wayne F. Cascio,et al.  Strategies for reducing employee turnover: A meta-analysis. , 1985 .

[8]  C. Judd,et al.  Data analysis: continuing issues in the everyday analysis of psychological data. , 1995, Annual review of psychology.

[9]  D. Rubin,et al.  Contrasts and Effect Sizes in Behavioral Research , 1999 .

[10]  Mark Fichman,et al.  Variance Explained: Why Size Does Not (Always) Matter , 1999 .

[11]  Lloyd G. Humphreys,et al.  Incorporating General Intelligence into Epidemiology and the Social Sciences. , 1997 .

[12]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[13]  William R. Shadish,et al.  Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. , 1998 .

[14]  Philip Bobko,et al.  Correlation and Regression: Principles and Applications for Industrial/Organizational Psychology and Management , 1995 .

[15]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data , 1991 .

[16]  Deborah A. Prentice,et al.  When small effects are impressive , 1992 .

[17]  Tamás Rudas,et al.  Odds Ratios in the Analysis of Contingency Tables , 1997 .

[18]  Jennifer M. George,et al.  The Role of Personality in Organizational Life: Issues and Evidence , 1992 .

[19]  J. Carroll.  The nature of the data, or how to choose a correlation coefficient , 1961 .

[20]  Jean M. Phillips.  EFFECTS OF REALISTIC JOB PREVIEWS ON MULTIPLE ORGANIZATIONAL OUTCOMES: A META-ANALYSIS , 1998 .

[21]  R. Kirk.  Practical Significance: A Concept Whose Time Has Come , 1996 .

[22]  Daniel M. Cable,et al.  AN EMPIRICAL INVESTIGATION OF THE PREDICTORS OF EXECUTIVE CAREER SUCCESS , 1995 .

[23]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[24]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[25]  J. S. Long,et al.  Regression Models for Categorical and Limited Dependent Variables , 1997 .

[26]  W. Tryon.  Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: an integrated alternative method of conducting null hypothesis statistical tests. , 2001, Psychological methods.

[27]  F. Pampel.  Logistic Regression: A Primer , 2000 .

[28]  Joseph L. Fleiss,et al.  Measures of effect size for categorical data. , 1994 .

[29]  Kevin R. Murphy,et al.  Individual differences and behavior in organizations , 1996 .

[30]  John T. E. Richardson.  Measures of effect size , 1996 .

[31]  R. Darlington,et al.  Multiple regression in psychological research and practice. , 1968, Psychological bulletin.

[32]  John P. Wanous,et al.  A meta-analysis of realistic job preview experiments. , 1985 .

[33]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[34]  William P. Dunlap,et al.  Generalizing the common language effect size indicator to bivariate normal correlations. , 1994 .

[35]  Robert Rosenthal,et al.  How are we doing in soft psychology , 1990 .