Best-practice recommendations for estimating interaction effects using meta-analysis

One of the key advantages of meta-analysis (i.e., a quantitative literature review) over a narrative literature review is that it allows for formal tests of interaction effects—namely, whether the relationship between two variables is contingent upon the value of another (moderator) variable. Interaction effects play a central role in organizational science research because they highlight boundary conditions of a theory: Conditions under which relationships change in strength and/or direction. This article describes procedures for estimating interaction effects using meta-analysis, distills the technical literature for a general readership of organizational science researchers, and includes specific best-practice recommendations regarding actions researchers can take before and after data collection to improve the accuracy of substantive conclusions regarding interaction effects investigated meta-analytically. Copyright © 2010 John Wiley & Sons, Ltd.

[1]  Catherine M. Dalton,et al.  Debunking Myths and Urban Legends About Meta-Analysis , 2011 .

[2]  Herman Aguinis,et al.  Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact , 2011 .

[3]  Douglas G. Bonett,et al.  Varying coefficient meta-analytic methods for alpha reliability. , 2010, Psychological methods.

[4]  Herman Aguinis,et al.  Best-practice recommendations for estimating interaction effects using moderated multiple regression , 2010 .

[5]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[6]  Steven Andrew Culpepper,et al.  Scale Coarseness as a Methodological Artifact , 2009 .

[7]  Douglas G Bonett,et al.  Meta-analytic interval estimation for standardized and unstandardized mean differences. , 2009, Psychological methods.

[8]  Harris Cooper,et al.  Research Synthesis and Meta-Analysis: A Step-by-Step Approach , 2009 .

[9]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[10]  In-Sue Oh,et al.  Fixed- versus random-effects models in meta-analysis: model properties and an empirical comparison of differences in results. , 2009, The British journal of mathematical and statistical psychology.

[11]  Dan J. Putka,et al.  The Multifaceted Nature of Measurement Artifacts and Its Implications for Estimating Construct-Level Relationships , 2009 .

[12]  Apa Publications,et al.  Reporting standards for research in psychology: why do we need them? What might they be? , 2008, The American psychologist.

[13]  James M. LeBreton,et al.  Answers to 20 Questions About Interrater Reliability and Interrater Agreement , 2008 .

[14]  Douglas G Bonett,et al.  Meta-analytic interval estimation for bivariate correlations. , 2008, Psychological methods.

[15]  John Andy Wood,et al.  Methodology for Dealing With Duplicate Study Effects in a Meta-Analysis , 2008 .

[16]  P. Bobko,et al.  Psychometric Accuracy and (the Continuing Need for) Quality Thinking in Meta-Analysis , 2008 .

[17]  Herman Aguinis,et al.  Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables , 2008 .

[18]  F. Schmidt.  Meta-Analysis , 2008 .

[19]  D. Bonett,et al.  Comments and recommendations regarding the hypothesis testing controversy , 2007 .

[20]  Rhonda K. Reger,et al.  A Content Analysis of the Content Analysis Literature in Organization Studies: Research Themes, Data Sources, and Methodological Refinements , 2007 .

[21]  Michael A. McDaniel,et al.  PUBLICATION BIAS: A CASE STUDY OF FOUR TEST VENDORS , 2006 .

[22]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[23]  A. Field.  Is the meta-analysis of correlation coefficients accurate when population correlations vary? , 2005, Psychological methods.

[24]  Larry V Hedges,et al.  The power of statistical tests for moderators in meta-analysis. , 2004, Psychological methods.

[25]  Ralf Schulze,et al.  Meta-Analysis: A Comparison of Approaches , 2004 .

[26]  D. Eden.  Replication, Meta-Analysis, Scientific Progress, and AMJ's Publication Policy , 2002 .

[27]  Herman Aguinis.  ESTIMATION OF SAMPLING VARIANCE OF CORRELATIONS IN META‐ANALYSIS , 2001 .

[28]  L. Hedges,et al.  The power of statistical tests in meta-analysis. , 2001, Psychological methods.

[29]  P. Lee,et al.  Publication bias in meta-analysis: its causes and consequences. , 2000, Journal of clinical epidemiology.

[30]  Herman Aguinis,et al.  Testing Moderator Variable Hypotheses Meta-Analytically: , 1998 .

[31]  Jack L. Vevea,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[32]  Herman Aguinis,et al.  Sampling variance in the correlation coefficient under indirect range restriction : Implications for validity generalization , 1997 .

[33]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[34]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .