Mediation Effects In 2-1-1 Multilevel Model: Evaluation Of Alternative Estimation Methods

We compared six common methods in estimating the 2-1-1 (level-2 independent, level-1 mediator, level-1 dependent) multilevel mediation model with a random slope. They were the Bayesian with informative priors, the Bayesian with non-informative priors, the Monte-Carlo, the distribution of the product, the bias-corrected, and the bias-uncorrected parametric percentile residual bootstrap. The Bayesian method with informative priors was superior in relative mean square error (RMSE), power, interval width, and interval imbalance. The prior variance and prior mean were also varied and examined. Decreasing the prior variance increased the power, reduced RMSE and interval width when the prior mean was the true value, but decreasing the prior variance reduced the power when the prior mean was set incorrectly. The influence of misspecification of prior information of the b coefficient on multilevel mediation analysis was greater than that on coefficient a. An illustrate example with the Bayesian multilevel mediation was provided.

[1]  Daniel M. McNeish.  Multilevel Mediation With Small Samples: A Cautionary Note on the Multilevel Structural Equation Modeling Framework , 2017 .

[2]  Kristopher J Preacher,et al.  Moderated Mediation Analysis Using Bayesian Methods , 2015 .

[3]  Laura M. Stapleton,et al.  The Performance of Methods to Test Upper-Level Mediation in the Presence of Nonnormal Data , 2008, Multivariate behavioral research.

[4]  Ying Yuan,et al.  Bayesian mediation analysis. , 2009, Psychological methods.

[5]  Kristopher J Preacher,et al.  Alternative Methods for Assessing Mediation in Multilevel Data: The Advantages of Multilevel SEM , 2011 .

[6]  Kristopher J Preacher,et al.  Testing Multilevel Mediation Using Hierarchical Linear Models , 2008 .

[7]  Wen Zhonglin,et al.  The Impact Mechanism of Work Team Leaders’ Psychological Capital on Followers’ Organizational Citizenship Behavior: A Multilevel Model , 2013 .

[8]  方杰,et al.  中介效应的点估计和区间估计：乘积分布法、非参数Bootstrap和MCMC法 , 2012 .

[9]  Matthew S. Fritz,et al.  Distribution of the product confidence limits for the indirect effect: Program PRODCLIN , 2007, Behavior research methods.

[10]  Laura M. Stapleton,et al.  A Comparison of Methods to Test for Mediation in Multisite Experiments , 2005, Multivariate behavioral research.

[11]  Zhang Min-Qiang,et al.  Multilevel Mediation Based on Hierarchical Linear Model , 2010 .

[12]  David P Mackinnon,et al.  Explanation of Two Anomalous Results in Statistical Mediation Analysis , 2012, Multivariate behavioral research.

[13]  Laura M. Stapleton,et al.  A Comparison of Single Sample and Bootstrap Methods to Assess Mediation in Cluster Randomized Trials , 2006, Multivariate behavioral research.

[14]  Michael Scharkow,et al.  The Relative Trustworthiness of Inferential Tests of the Indirect Effect in Statistical Mediation Analysis , 2013, Psychological science.

[15]  David P MacKinnon,et al.  RMediation: An R package for mediation analysis confidence intervals , 2011, Behavior research methods.

[16]  Emery Schubert,et al.  Analysing playing using the note-time playing path , 2011, Behavior research methods.

[17]  Victoria Savalei,et al.  Assessing Mediational Models: Testing and Interval Estimation for Indirect Effects , 2010, Multivariate behavioral research.

[18]  Kristopher J Preacher,et al.  Advantages of Monte Carlo Confidence Intervals for Indirect Effects , 2012 .

[19]  Sarah Depaoli,et al.  Improving Transparency and Replication in Bayesian Statistics: The WAMBS-Checklist , 2017, Psychological methods.

[20]  W. Q. Meeker,et al.  The Product of Two Normally Distributed Random Variables , 1982 .

[21]  D. Mackinnon,et al.  Multilevel Modeling of Individual and Group Level Mediated Effects , 2001, Multivariate behavioral research.

[22]  Jinsong Chen,et al.  An Empirical Evaluation of Mediation Effect Analysis With Manifest and Latent Variables Using Markov Chain Monte Carlo and Alternative Estimation Methods , 2014 .

[23]  David P. MacKinnon,et al.  Monte Carlo Confidence Intervals for Complex Functions of Indirect Effects , 2016 .

[24]  Sarah Depaoli,et al.  A Bayesian Approach to Multilevel Structural Equation Modeling With Continuous and Dichotomous Outcomes , 2015 .

[25]  Zhang Min-qiang,et al.  Assessing Point and Interval Estimation for the Mediating Effect: Distribution of the Product, Nonparametric Bootstrap and Markov Chain Monte Carlo Methods , 2013 .

[26]  Roy Levy,et al.  Power in Bayesian Mediation Analysis for Small Sample Research , 2017, Structural equation modeling : a multidisciplinary journal.

[27]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[28]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[29]  S. D. Winter,et al.  A Systematic Review of Bayesian Articles in Psychology: The Last 25 Years , 2017, Psychological methods.

[30]  Daniel J. Bauer,et al.  Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: new procedures and recommendations. , 2006, Psychological methods.

[31]  Carl F. Falk,et al.  Inference and Interval Estimation Methods for Indirect Effects With Latent Variable Models , 2015 .

[32]  W Holmes Finch,et al.  Estimation of Random Coefficient Multilevel Models in the Context of Small Numbers of Level 2 Clusters , 2019, Educational and psychological measurement.

[33]  Kristopher J Preacher,et al.  A general multilevel SEM framework for assessing multilevel mediation. , 2010, Psychological methods.