Accuracy of Parameter Estimates and Confidence Intervals in Moderated Mediation Models

Currently, the most popular analytical method for testing moderated mediation is the regression approach, which is based on observed variables and assumes no measurement error. It is generally acknowledged that measurement errors result in biased estimates of regression coefficients. What has drawn relatively less attention is that the confidence intervals produced by regression are also biased when the variables are measured with errors. Therefore, we extend the latent moderated structural equations (LMS) method—which corrects for measurement errors when estimating latent interaction effects—to the study of the moderated mediation of latent variables. Simulations were conducted to compare the regression approach and the LMS approach. The results show that the LMS method produces accurate estimated effects and confidence intervals. By contrast, regression not only substantially underestimates the effects but also produces inaccurate confidence intervals. It is likely that the statistically significant moderated mediation effects that have been reported in previous studies using regression include biased estimated effects and confidence intervals that do not include the true values.

[1]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[2]  David P. Mackinnon,et al.  Demonstration and evaluation of a method for assessing mediated moderation , 2006, Behavior research methods.

[3]  Clement A. Stone,et al.  The robustness of estimates of total indirect effects in covariance structure models estimated by maximum , 1990 .

[4]  Bengt O. Muthén,et al.  Quasi-Maximum Likelihood Estimation of Structural Equation Models With Multiple Interaction and Quadratic Effects , 2007 .

[5]  W. Dunlap,et al.  Testing Interaction Effects in LISREL: Examination and Illustration of Available Procedures , 2001 .

[6]  M. Evans A Monte Carlo study of the effects of correlated method variance in moderated multiple regression analysis , 1985 .

[7]  L. Hayduk,et al.  Latent Variable Interaction and Quadratic Effect Estimation: A Two-Step Technique Using Structural Equation Analysis , 1996 .

[8]  J. Shaver Testing for Mediating Variables in Management Research: Concerns, Implications, and Alternative Strategies , 2005 .

[9]  D. A. Kenny,et al.  Estimating the nonlinear and interactive effects of latent variables. , 1984 .

[10]  C. Judd,et al.  When moderation is mediated and mediation is moderated. , 2005, Journal of personality and social psychology.

[11]  Kristopher J Preacher,et al.  Conditional process modeling: Using structural equation modeling to examine contingent causal processes. , 2013 .

[12]  Karl G. Jöreskog,et al.  Interaction and nonlinear modeling: Issues and approaches. , 1998 .

[13]  H. Moosbrugger,et al.  Estimating Nonlinear Effects Using a Latent Moderated Structural Equations Approach , 2017 .

[14]  Kristopher J Preacher,et al.  Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions , 2007, Multivariate behavioral research.

[15]  Kenneth A. Bollen,et al.  An alternative two stage least squares (2SLS) estimator for latent variable equations , 1996 .

[16]  Alison Ledgerwood,et al.  The trade-off between accuracy and precision in latent variable models of mediation processes. , 2011, Journal of personality and social psychology.

[17]  Philippe Jacquart,et al.  On making causal claims: A review and recommendations , 2010 .

[18]  Kenneth A. Bollen,et al.  Two-stage least squares estimation of interaction effects. , 1998 .

[19]  H. Marsh,et al.  Structural equation models of latent interaction and quadratic effects. , 2013 .

[20]  Fan Yang,et al.  Nonlinear structural equation models: The Kenny-Judd model with Interaction effects , 1996 .

[21]  M. Stoolmiller,et al.  Detecting Latent Interaction Effects in Behavioral Data , 2003 .

[22]  D. Bandalos The Effects of Item Parceling on Goodness-of-Fit and Parameter Estimate Bias in Structural Equation Modeling , 2002 .

[23]  A. Hayes Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[24]  Gordon W. Cheung,et al.  Testing Mediation and Suppression Effects of Latent Variables , 2008 .

[25]  Helfried Moosbrugger,et al.  Maximum likelihood estimation of latent interaction effects with the LMS method , 2000 .

[26]  E. F. Stone-Romero,et al.  Relative power of moderated multiple regression and the comparison of subgroup correlation coefficients for detecting moderating effects. , 1994 .

[27]  K. Bollen,et al.  DIRECT AND INDIRECT EFFECTS: CLASSICAL AND BOOTSTRAP ESTIMATES OF VARIABILITY , 1990 .

[28]  Maria Petrescu Marketing research using single-item indicators in structural equation models , 2013 .

[29]  R. Folger,et al.  When is it Acceptable to Accept a Null Hypothesis: No Way, Jose? , 1998 .

[30]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[31]  Todd D Little,et al.  Why the items versus parcels controversy needn't be one. , 2013, Psychological methods.

[32]  Herman Aguinis,et al.  Statistical Power with Moderated Multiple Regression in Management Research , 1995 .

[33]  H. Marsh,et al.  Structural equation models of latent interactions: evaluation of alternative estimation strategies and indicator construction. , 2004, Psychological methods.

[34]  J. Edwards,et al.  Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis. , 2007, Psychological methods.

[35]  J. Schafer,et al.  A comparison of inclusive and restrictive strategies in modern missing data procedures. , 2001, Psychological methods.

[36]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[37]  Robert C MacCallum,et al.  Using Parcels to Convert Path Analysis Models Into Latent Variable Models , 2005, Multivariate behavioral research.

[38]  Thomas R. Carretta,et al.  The Role of Measurement Error in Familiar Statistics , 2006 .

[39]  James Jaccard,et al.  Measurement error in the analysis of interaction effects between continuous predictors using multiple regression: Multiple indicator and structural equation approaches. , 1995 .

[40]  Bengt Muthén,et al.  Latent variable interactions , 2015 .

[41]  George A. Marcoulides,et al.  Interaction and Nonlinear Effects in Structural Equation Modeling , 1998 .

[42]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[43]  A. Hayes An Index and Test of Linear Moderated Mediation , 2015, Multivariate behavioral research.

[44]  H. Marsh,et al.  Why item parcels are (almost) never appropriate: two wrongs do not make a right--camouflaging misspecification with item parcels in CFA models. , 2013, Psychological methods.

[45]  Herman Aguinis,et al.  Statistical power problems with moderated multiple regression in management research. , 1995 .

[46]  S. Finney,et al.  Item parceling issues in structural equation modeling , 2001 .

[47]  L. E. Jones,et al.  Analysis of multiplicative combination rules when the causal variables are measured with error. , 1983 .

[48]  James Algina,et al.  A Note on Estimating the Jöreskog-Yang Model for Latent Variable Interaction Using LISREL 8.3 , 2001 .

[49]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[50]  Herman Aguinis,et al.  Methodological Artifacts in Moderated Multiple Regression and Their Effects on Statistical Power , 1997 .

[51]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[52]  David P Mackinnon,et al.  Resampling and Distribution of the Product Methods for Testing Indirect Effects in Complex Models , 2008, Structural equation modeling : a multidisciplinary journal.

[53]  Stephen G West,et al.  Estimating Latent Variable Interactions With Nonnormal Observed Data: A Comparison of Four Approaches , 2012, Multivariate behavioral research.

[54]  Freda Kemp Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences , 2003 .