Monte Carlo based statistical power analysis for mediation models: methods and software

The existing literature on statistical power analysis for mediation models often assumes data normality and is based on a less powerful Sobel test instead of the more powerful bootstrap test. This study proposes to estimate statistical power to detect mediation effects on the basis of the bootstrap method through Monte Carlo simulation. Nonnormal data with excessive skewness and kurtosis are allowed in the proposed method. A free R package called bmem is developed to conduct the power analysis discussed in this study. Four examples, including a simple mediation model, a multiple-mediator model with a latent mediator, a multiple-group mediation model, and a longitudinal mediation model, are provided to illustrate the proposed method.

[1]  M. Reiser,et al.  Power Analysis for Complex Mediational Designs Using Monte Carlo Methods , 2010, Structural equation modeling : a multidisciplinary journal.

[2]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[3]  A. Hayes.  Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[4]  E. Vittinghoff,et al.  Sample size calculations for evaluating mediation , 2009, Statistics in medicine.

[5]  Louise Hunt,et al.  Abuse of power. , 2020, Nursing times.

[6]  Matthew S. Fritz,et al.  PSYCHOLOGICAL SCIENCE Research Article Required Sample Size to Detect the Mediated Effect , 2022 .

[7]  Michael Scharkow,et al.  The Relative Trustworthiness of Inferential Tests of the Indirect Effect in Statistical Mediation Analysis , 2013, Psychological science.

[8]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[9]  L. Harlow,et al.  What if there were no significance tests , 1997 .

[10]  D. A. Kenny,et al.  Power Anomalies in Testing Mediation , 2014, Psychological science.

[11]  Timo Oertzen,et al.  Efficient Hessian computation using sparse matrix derivatives in RAM notation , 2014, Behavior research methods.

[12]  Mike W.-L. Cheung,et al.  Comparison of Approaches to Constructing Confidence Intervals for Mediating Effects Using Structural Equation Models , 2007 .

[13]  S. Maxwell,et al.  Bias in cross-sectional analyses of longitudinal mediation. , 2007, Psychological methods.

[14]  B. Muthén,et al.  How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power , 2002 .

[15]  Wei Zhang,et al.  The Effect of Skewness and Kurtosis on Mean and Covariance Structure Analysis , 2005 .

[16]  Ke-Hai Yuan,et al.  Local Influence and Robust Procedures for Mediation Analysis , 2010, Multivariate behavioral research.

[17]  J. H. Steiger,et al.  The Problem Is Epistemology, Not Statistics: Replace Significance Tests by Confidence Intervals and Quantify Accuracy of Risky Numerical Predictions , 2002 .

[18]  L E Daly,et al.  Confidence intervals and sample sizes: don't throw out all your old sample size tables. , 1991, BMJ.

[19]  T. Micceri.  The unicorn, the normal curve, and other improbable creatures. , 1989 .

[20]  M. Green.  Confidence limits. , 1972, Lancet.

[21]  David P Mackinnon,et al.  Explanation of Two Anomalous Results in Statistical Mediation Analysis , 2012, Multivariate behavioral research.

[22]  M. Sobel.  Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[23]  Kristopher J Preacher,et al.  SPSS and SAS procedures for estimating indirect effects in simple mediation models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[24]  P. Shrout,et al.  Mediation in experimental and nonexperimental studies: new procedures and recommendations. , 2002, Psychological methods.

[25]  Lijuan Wang,et al.  Methods for Mediation Analysis with Missing Data , 2012, Psychometrika.

[26]  Zhiyong Zhang,et al.  Estimating and Testing Mediation Effects with Censored Data , 2011 .

[27]  Cuiling Wang,et al.  Power and sample size calculations for evaluating mediation effects in longitudinal studies , 2016, Statistical methods in medical research.

[28]  T. Mark Beasley.  Power of Product Tests of Mediation as a Function of Mediator Collinearity , 2012 .

[29]  C. D. Vale,et al.  Simulating multivariate nonnormal distributions , 1983 .

[30]  Lijuan Wang,et al.  Statistical power analysis for growth curve models using SAS , 2009, Behavior research methods.

[31]  D. Mackinnon.  Introduction to Statistical Mediation Analysis , 2008 .