On a Proper Meta-Analytic Model for Correlations

Combining statistical information across studies is a standard research tool in applied psychology. The most common approach in applied psychology is the fixed effects model. The fixed-effects approach assumes that individual study characteristics such as treatment conditions, study context, or individual differences do not influence study effect sizes. That is, that the majority of the differences between the effect sizes of different studies can be explained by sampling error alone. We critique the fixed-effects methodology for correlations and propose an advancement, the random-effects model, that ameliorates problems imposed by fixed-effects models. The random-effects approach explicitly incorporates between-study differences in data analysis and provides estimates of how those study characteristics influence the relationships among constructs of interest. Because they can model the influence of study characteristics, we assert that random-effects models have advantages for psychological research. Parameter estimates of both models are compared and evidence in favor of the random-effects approach is presented.

[1]  Philip Bobko,et al.  Correlation and Regression: Principles and Applications for Industrial/Organizational Psychology and Management , 1995 .

[2]  Blair T. Johnson,et al.  Comparison of three major meta-analytic approaches. , 1995 .

[3]  Jacob Cohen The earth is round (p < .05) , 1994 .

[4]  M. Koslowsky,et al.  COMPONENTS OF ARTIFACTUAL VARIANCE IN META‐ANALYTIC RESEARCH , 1994 .

[5]  John A. Wagner,et al.  Participation's Effects On Performance and Satisfaction: A Reconsideration Of Research Evidence , 1994 .

[6]  Gwenn W. Gröndal,et al.  Meta-analytic procedures for social research , 1993 .

[7]  D. P. Gaver,et al.  Combining Information: Statistical Issues and Opportunities for Research , 1993 .

[8]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[9]  W. Härdle Applied Nonparametric Regression , 1991 .

[10]  P. Meehl Why Summaries of Research on Psychological Theories are Often Uninterpretable , 1990 .

[11]  Edwin A. Locke,et al.  Fact and Fiction in Analyzing Research on Participative Decision Making: A Critique of Cotton, Vollrath, Froggatt, Lengnick-Hall, and Jennings , 1990 .

[12]  J. Mathieu,et al.  A review and meta-analysis of the antecedents, correlates, and consequences of organizational commitment , 1990 .

[13]  Mark L. Lengnick-Hall,et al.  Fact: The Form of Participation Does Matter—A Rebuttal to Leana, Locke, and Schweiger , 1990 .

[14]  Wolfgang Härdle,et al.  Applied Nonparametric Regression: The kernel method , 1990 .

[15]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[16]  Michael J. Strube,et al.  Averaging correlation coefficients: Influence of heterogeneity and set size. , 1988 .

[17]  S. Raudenbush Educational Applications of Hierarchical Linear Models: A Review , 1988 .

[18]  Donald B. Rubin,et al.  Comment: Assumptions and Procedures in the File Drawer Problem , 1988 .

[19]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[20]  J. Feldman Meta-Analysis: Cumulating Research Findings Across Studies , 1984 .

[21]  Jeffrey E. Harris,et al.  Bayes Methods for Combining the Results of Cancer Studies in Humans and other Species , 1983 .

[22]  Carl Friedrich Gauss Theoria motus corporum coelestium , 1981 .

[23]  Donald B. Rubin,et al.  Interpersonal expectancy effects: the first 345 studies , 1978, Behavioral and Brain Sciences.

[24]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[25]  D. Lykken Statistical significance in psychological research. , 1968, Psychological bulletin.

[26]  D. Bakan,et al.  The test of significance in psychological research. , 1966, Psychological bulletin.

[27]  W. W. Rozeboom The fallacy of the null-hypothesis significance test. , 1960, Psychological bulletin.

[28]  H. Hotelling New Light on the Correlation Coefficient and its Transforms , 1953 .

[29]  William G. Cochran,et al.  The analysis of groups of experiments , 1938, The Journal of Agricultural Science.

[30]  F. David,et al.  Tables of the Ordinates and Probability Integral of the Distribution of the Correlation Coefficient in Small Samples , 1938 .

[31]  W. G. Cochran Problems arising in the analysis of a series of similar experiments , 1937 .

[32]  R. Fisher,et al.  Statistical Methods for Research Workers , 1930, Nature.