New recommendations for testing indirect effects in mediational models: The need to report and test component paths.

In light of current concerns with replicability and reporting false-positive effects in psychology, we examine Type I errors and power associated with 2 distinct approaches for the assessment of mediation, namely the component approach (testing individual parameter estimates in the model) and the index approach (testing a single mediational index). We conduct simulations that examine both approaches and show that the most commonly used tests under the index approach risk inflated Type I errors compared with the joint-significance test inspired by the component approach. We argue that the tendency to report only a single mediational index is worrisome for this reason and also because it is often accompanied by a failure to critically examine the individual causal paths underlying the mediational model. We recommend testing individual components of the indirect effect to argue for the presence of an indirect effect and then using other recommended procedures to calculate the size of that effect. Beyond simple mediation, we show that our conclusions also apply in cases of within-participant mediation and moderated mediation. We also provide a new R-package that allows for an easy implementation of our recommendations. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

[1]  Victoria Savalei,et al.  Assessing Mediational Models: Testing and Interval Estimation for Indirect Effects , 2010, Multivariate behavioral research.

[2]  Matthew S. Fritz,et al.  Mediation analysis. , 2019, Annual review of psychology.

[3]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[4]  P. Shrout,et al.  Mediation in experimental and nonexperimental studies: new procedures and recommendations. , 2002, Psychological methods.

[5]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[6]  Klaus Fiedler,et al.  What mediation analysis can (not) do , 2011 .

[7]  C. Judd,et al.  When moderation is mediated and mediation is moderated. , 2005, Journal of personality and social psychology.

[8]  Kristopher J Preacher,et al.  Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions , 2007, Multivariate behavioral research.

[9]  Christopher D. Chambers,et al.  Redefine statistical significance , 2017, Nature Human Behaviour.

[10]  M. Siegrist,et al.  Fluency of pharmaceutical drug names predicts perceived hazardousness, assumed side effects and willingness to buy , 2014, Journal of health psychology.

[11]  Arild Waaler,et al.  Relative Trustworthiness , 2005, Formal Aspects in Security and Trust.

[12]  D. Mackinnon Introduction to Statistical Mediation Analysis , 2008 .

[13]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[14]  Amanda K Montoya,et al.  Two-condition within-participant statistical mediation analysis: A path-analytic framework. , 2017, Psychological methods.

[15]  D. A. Kenny,et al.  Process Analysis , 1981 .

[16]  David P. MacKinnon,et al.  A General Model for Testing Mediation and Moderation Effects , 2009, Prevention Science.

[17]  J. Edwards,et al.  Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis. , 2007, Psychological methods.

[18]  Kristopher J Preacher,et al.  Advantages of Monte Carlo Confidence Intervals for Indirect Effects , 2012 .

[19]  Kristopher J Preacher,et al.  Effect size measures for mediation models: quantitative strategies for communicating indirect effects. , 2011, Psychological methods.

[20]  Beatrijs Moerkerke,et al.  A cautionary note on the power of the test for the indirect effect in mediation analysis , 2015, Front. Psychol..

[21]  David P MacKinnon,et al.  RMediation: An R package for mediation analysis confidence intervals , 2011, Behavior research methods.

[22]  Matthew S. Fritz,et al.  Distribution of the product confidence limits for the indirect effect: Program PRODCLIN , 2007, Behavior research methods.

[23]  M. Sobel Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[24]  D. A. Kenny,et al.  Power Anomalies in Testing Mediation , 2014, Psychological science.

[25]  A. Hayes Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[26]  Arnold K. Ho,et al.  “You’re One of Us”: Black Americans’ Use of Hypodescent and Its Association With Egalitarianism , 2017, Journal of personality and social psychology.

[27]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[28]  D. A. Kenny,et al.  Estimating and testing mediation and moderation in within-subject designs. , 2001, Psychological methods.

[29]  David P Mackinnon,et al.  Explanation of Two Anomalous Results in Statistical Mediation Analysis , 2012, Multivariate behavioral research.

[30]  Matthew S. Fritz,et al.  PSYCHOLOGICAL SCIENCE Research Article Required Sample Size to Detect the Mediated Effect , 2022 .

[31]  G. Cumming,et al.  The New Statistics , 2014, Psychological science.

[32]  A. Hayes An Index and Test of Linear Moderated Mediation , 2015, Multivariate behavioral research.

[33]  Gary H. McClelland,et al.  Nasty data: Unruly, ill-mannered observations can ruin your analysis. , 2000 .

[34]  Michael Scharkow,et al.  The Relative Trustworthiness of Inferential Tests of the Indirect Effect in Statistical Mediation Analysis , 2013, Psychological science.

[35]  D. Mackinnon,et al.  A Simulation Study of Mediated Effect Measures. , 1995, Multivariate behavioral research.

[36]  C. Judd,et al.  Mediation and moderation , 2014 .

[37]  J. Krueger,et al.  The Heuristic Value of p in Inductive Statistical Inference , 2017, Front. Psychol..