Meta-analysis in psychological research.

Meta-analysis is a research methodology that aims to quantitatively integrate the results of a set of empirical studies about a given topic. With this purpose, effect-size indices are obtained from the individual studies and the characteristics of the studies are coded in order to examine their relationships with the effect sizes. Statistical analysis in meta-analysis requires the weighting of each effect estimate as a function of its precision, by assuming a fixed- or a random-effects model. This paper outlines the steps required for carrying out the statistical analyses in a meta-analysis, the different statistical models that can be assumed, and the consequences of the assumptions in interpreting their results. The statistical analyses are illustrated with a real example.

[1]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[2]  Julio Sánchez-Meca,et al.  Homogeneity tests in meta-analysis: a Monte Carlo comparison of statistical power and Type I error , 1997 .

[3]  Juan Botella,et al.  Doing and reporting a meta-analysis , 2006 .

[4]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[5]  Julio Sánchez-Meca,et al.  Confidence intervals for the overall effect size in random-effects meta-analysis. , 2008, Psychological methods.

[6]  Wolfgang Viechtbauer,et al.  Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model , 2005 .

[7]  M. Pittler.  Systematic Reviews in Health Care: Meta‐analysis in Context , 2010 .

[8]  In-Sue Oh,et al.  Fixed- versus random-effects models in meta-analysis: model properties and an empirical comparison of differences in results. , 2009, The British journal of mathematical and statistical psychology.

[9]  Kurex Sidik,et al.  Robust variance estimation for random effects meta-analysis , 2006, Comput. Stat. Data Anal..

[10]  Michael R. Harwell.  An empirical study of the Hedges (1982) homogeneity test , 1997 .

[11]  Larry V. Hedges,et al.  Fixed-Effects Models , 2022, The SAGE Encyclopedia of Research Design.

[12]  David Moher,et al.  Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews , 2007, BMC medical research methodology.

[13]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[14]  Julian P T Higgins,et al.  Recent developments in meta‐analysis , 2008, Statistics in medicine.

[15]  Robert Rosenthal,et al.  WRITING META-ANALYTIC REVIEWS , 1995 .

[16]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[17]  A. Field,et al.  The Problems in Using Fixed-Effects Models of Meta-Analysis on Real-World Data , 2003 .

[18]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[19]  T. Husén,et al.  The International Encyclopedia of Education , 1994 .

[20]  Joachim Hartung,et al.  An Alternative Method for Meta‐Analysis , 1999 .

[21]  S. Sharp,et al.  Explaining heterogeneity in meta-analysis: a comparison of methods. , 1999 .

[22]  Harris Cooper,et al.  Research Synthesis and Meta-Analysis: A Step-by-Step Approach , 2009 .

[23]  Julio Sánchez-Meca,et al.  Psychological treatment of obsessive-compulsive disorder: a meta-analysis. , 2008, Clinical psychology review.

[24]  Julio Sánchez-Meca,et al.  Weighting by Inverse Variance or by Sample Size in Meta-Analysis: A Simulation Study , 1998 .

[25]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[26]  Julia H. Littell,et al.  Systematic Reviews and Meta-Analysis , 2008 .

[27]  Julio Sánchez-Meca,et al.  Effect-size indices for dichotomized outcomes in meta-analysis. , 2003, Psychological methods.

[28]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[29]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[30]  Julio Sánchez-Meca,et al.  Weighting by Inverse Variance or by Sample Size in Random-Effects Meta-Analysis , 2010 .

[31]  Feng Li,et al.  An Introduction to Metaanalysis , 2005 .

[32]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[33]  Kurex Sidik,et al.  On Constructing Confidence Intervals for a Standardized Mean Difference in Meta-analysis , 2003 .

[34]  Douglas G. Altman,et al.  Systematic Reviews in Health Care , 2001 .

[35]  Michele Tarsilla.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[36]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[37]  Simon G. Thompson,et al.  Meta‐Analysis of Clinical Trials , 2005 .

[38]  Stephen W. Raudenbush,et al.  Random effects models. , 1994 .

[39]  F. Schmidt.  Meta-Analysis , 2008 .

[40]  Harris Cooper,et al.  A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: the Study Design and Implementation Assessment Device (Study DIAD). , 2008, Psychological methods.

[41]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[42]  B. Spilker,et al.  Meta-Analysis for Explanation: A Casebook , 1993 .

[43]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .