Successfully Combining Meta-analysis and Structural Equation Modeling: Recommendations and Strategies

During the past two decades, organizational researchers have combined the techniques of meta-analysis (MA) and structural equation modeling (SEM) with the intention of building on the strengths of these approaches to address unique research questions. Though these integrative analyses can involve the use of SEM to conduct MA, the focus of the current article is on those situations in which meta-analytic correlations are used as input for testing structural models not previously evaluated in any single, primary study. The purpose of this paper is to provide a summary of the salient choices that must be made by researchers interested in integrating these methods and offering several recommendations for those undertaking such analytic strategies. Overall, the combination of MA and SEM offers researchers unique opportunities, but caution must be exercised when drawing inferences from results.

[1]  D. Mackinnon,et al.  Guidelines for the Investigation of Mediating Variables in Business Research , 2011, Journal of business and psychology.

[2]  Eric D. Heggestad,et al.  Polynomial Regression with Response Surface Analysis: A Powerful Approach for Examining Moderation and Overcoming Limitations of Difference Scores , 2010 .

[3]  C. Lance,et al.  What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research , 2010 .

[4]  Mike W.-L. Cheung,et al.  A Two-Stage Approach to Synthesizing Covariance Matrices in Meta-Analytic Structural Equation Modeling , 2009 .

[5]  Robert E. Ployhart,et al.  The “Quick Start Guide” for Conducting and Publishing Longitudinal Research , 2011 .

[6]  M. Cheung.  A model for integrating fixed-, random-, and mixed-effects meta-analyses into structural equation modeling. , 2008, Psychological methods.

[7]  Mike W-L Cheung,et al.  Meta-analytic structural equation modeling: a two-stage approach. , 2005, Psychological methods.

[8]  Rick H. Hoyle.  Model specification in structural equation modeling. , 2012 .

[9]  R. MacCallum,et al.  Some Factors Affecting the Success of Specification Searches in Covariance Structure Modeling. , 1988, Multivariate behavioral research.

[10]  Chu Hsiang Chang,et al.  To Aggregate or Not to Aggregate: Steps for Developing and Validating Higher-Order Multidimensional Constructs , 2011 .

[11]  R. Kline.  Principles and practice of structural equation modeling, 3rd ed. , 2011 .

[12]  Michael J. Strube,et al.  Validity Generalization: A Critical Review , 2004 .

[13]  P. Barrett.  Structural equation modelling : Adjudging model fit , 2007 .

[14]  J. Colquitt,et al.  Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research. , 2000, The Journal of applied psychology.

[15]  Noel A. Card.  Applied Meta-Analysis for Social Science Research , 2011 .

[16]  D. Ones,et al.  Theory testing: Combining psychometric meta-analysis and structural equations modeling , 1995 .

[17]  N. Kerr.  HARKing: Hypothesizing After the Results are Known , 1998, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[18]  Robert C. MacCallum,et al.  SPECIFICATION SEARCHES IN COVARIANCE STRUCTURE MODELING , 1986 .

[19]  Rick H. Hoyle,et al.  Handbook of structural equation modeling , 2012 .

[20]  John R. Hollenbeck,et al.  The Assessment of Goal Commitment: A Measurement Model Meta-Analysis. , 2001, Organizational behavior and human decision processes.

[21]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[22]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[23]  David G. Allen,et al.  MECHANISMS LINKING REALISTIC JOB PREVIEWS WITH TURNOVER: A META‐ANALYTIC PATH ANALYSIS , 2011 .

[24]  Patrick J. Rosopa,et al.  The Relative Validity of Inferences About Mediation as a Function of Research Design Characteristics , 2008 .

[25]  W. Dunlap,et al.  Testing Interaction Effects in LISREL: Examination and Illustration of Available Procedures , 2001 .

[26]  R. Landis,et al.  Methodological and conceptual challenges in conducting and interpreting meta-analyses. , 2003 .

[27]  Therese D. Pigott,et al.  How Many Studies Do You Need? , 2010 .

[28]  Dennis L. Jackson.  Revisiting Sample Size and Number of Parameter Estimates: Some Support for the N:q Hypothesis , 2003 .

[29]  Geoffrey M. Maruyama,et al.  Basics of structural equation modeling , 1997 .

[30]  Jill C. Bradley,et al.  Workplace safety: a meta-analysis of the roles of person and situation factors. , 2009, The Journal of applied psychology.

[31]  S. Robbins,et al.  Intervention Effects on College Performance and Retention as Mediated by Motivational, Emotional, and Social Control Factors: Integrated Meta-Analytic Path Analyses , 2009, The Journal of applied psychology.

[32]  Frederick L. Oswald,et al.  On the robustness, bias, and stability of statistics from meta-analysis of correlation coefficients : Some initial Monte Carlo findings , 1998 .

[33]  Rex B. Kline,et al.  Assumptions in structural equation modeling. , 2012 .

[34]  James M. LeBreton,et al.  Relative Importance Analysis: A Useful Supplement to Regression Analysis , 2011 .