Dependent effect sizes in meta-analysis: incorporating the degree of interdependence.

In the present article, a commonly used meta-analytic procedure for handling dependent effect sizes from a single sample was examined, and 2 revised procedures that estimate and incorporate the degree of interdependence were proposed. The authors' simulation results reveal that the commonly used procedure that averages the effect sizes from a single sample (denoted as the samplewise procedure) underestimates the degree of heterogeneity. The proposed variations are less biased than the samplewise procedure in estimating the degree of heterogeneity in most of the situations that we examined. Future directions to further improve the procedures for handling dependent effect sizes from a single sample are discussed.

[1]  C Abraham,et al.  Psychosocial correlates of heterosexual condom use: a meta-analysis. , 1999, Psychological bulletin.

[2]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[3]  Jan F. Bjørnstad,et al.  Meta-Analysis Calculations Based on Independent and Nonindependent Cases , 1999 .

[4]  Ingram Olkin,et al.  Stochastically dependent effect sizes. , 1994 .

[5]  S. Premack,et al.  Individual unionization decisions. , 1988 .

[6]  Min-Sun Kim,et al.  Relationships Among Attitudes, Behavioral Intentions, and Behavior , 1993 .

[7]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[8]  Blair H. Sheppard,et al.  The Theory of Reasoned Action: A Meta-Analysis of Past Research with Recommendations for Modifications and Future Research , 1988 .

[9]  John E. Hunter,et al.  Fixed Effects vs. Random Effects Meta‐Analysis Models: Implications for Cumulative Research Knowledge , 2000 .

[10]  Chockalingam Viswesvaran,et al.  The Role of Social Support in the Process of Work Stress: A Meta-Analysis , 1999 .

[11]  D. Organ,et al.  A META-ANALYTIC REVIEW OF ATTITUDINAL AND DISPOSITIONAL PREDICTORS OF ORGANIZATIONAL CITIZENSHIP BEHAVIOR , 1995 .

[12]  Michael A. McDaniel,et al.  Refinements in validity generalization methods: Implications for the situational specificity hypothesis. , 1993 .

[13]  A. Field.  Meta-analysis of correlation coefficients: a Monte Carlo comparison of fixed- and random-effects methods. , 2001, Psychological methods.

[14]  R. C. Bose,et al.  Essays in probability and statistics , 1971 .

[15]  Fanny Caranikas-Walker,et al.  A meta-analytical structural equations analysis of a model of employee turnover. , 1992 .

[16]  Patricia B. Elmore,et al.  Correlational Meta-Analysis: Independent and Nonindependent Cases , 1992 .

[17]  Fred D. Davis,et al.  Disentangling behavioral intention and behavioral expectation , 1985 .

[18]  John E. Hunter,et al.  Comparison of Three Meta-Analysis Methods Revisited: An Analysis of Johnson, Mullen, and Salas (1995) , 1999 .

[19]  A. van Knippenberg,et al.  Habit versus planned behaviour: a field experiment. , 1998, The British journal of social psychology.

[20]  Larry V. Hedges,et al.  Fixed-Effects Models , 2022, The SAGE Encyclopedia of Research Design.

[21]  R. Rosenthal,et al.  Meta-analysis: recent developments in quantitative methods for literature reviews. , 2001, Annual review of psychology.

[22]  L. James,et al.  rwg: An assessment of within-group interrater agreement. , 1993 .

[23]  I. Ajzen,et al.  A Comparison of the Theory of Planned Behavior and the Theory of Reasoned Action , 1992 .

[24]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[25]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .