A default Bayesian hypothesis test for mediation

In order to quantify the relationship between multiple variables, researchers often carry out a mediation analysis. In such an analysis, a mediator (e.g., knowledge of a healthy diet) transmits the effect from an independent variable (e.g., classroom instruction on a healthy diet) to a dependent variable (e.g., consumption of fruits and vegetables). Almost all mediation analyses in psychology use frequentist estimation and hypothesis-testing techniques. A recent exception is Yuan and MacKinnon (Psychological Methods, 14, 301–322, 2009), who outlined a Bayesian parameter estimation procedure for mediation analysis. Here we complete the Bayesian alternative to frequentist mediation analysis by specifying a default Bayesian hypothesis test based on the Jeffreys–Zellner–Siow approach. We further extend this default Bayesian test by allowing a comparison to directional or one-sided alternatives, using Markov chain Monte Carlo techniques implemented in JAGS. All Bayesian tests are implemented in the R package BayesMed (Nuijten, Wetzels, Matzke, Dolan, & Wagenmakers, 2014).

[1]  James O. Berger,et al.  Chapter 4: Consequences and Criticisms of the Likelihood Principle and the Relative Lielihood Principle , 1988 .

[2]  J. Forster,et al.  The Whetstone and the Alum Block: Balanced Objective Bayesian Comparison of Nested Models for Discrete Data , 2013, 1310.0661.

[3]  M. J. Bayarri,et al.  Calibration of ρ Values for Testing Precise Null Hypotheses , 2001 .

[4]  S. Moolgavkar,et al.  A Method for Computing Profile-Likelihood- Based Confidence Intervals , 1988 .

[5]  Richard D. Morey,et al.  Simple relation between Bayesian order-restricted and point-null hypothesis tests , 2014 .

[6]  Matthew S. Fritz,et al.  Mediation analysis. , 2019, Annual review of psychology.

[7]  Eric-Jan Wagenmakers,et al.  Bayesian tests to quantify the result of a replication attempt. , 2014, Journal of experimental psychology. General.

[8]  R. Wolpert,et al.  Likelihood Principle , 2022, The SAGE Encyclopedia of Research Design.

[9]  Jie W Weiss,et al.  Bayesian Statistical Inference for Psychological Research , 2008 .

[10]  M. Lee,et al.  Statistical Evidence in Experimental Psychology , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[11]  Z. Dienes,et al.  Alcohol increases hypnotic susceptibility , 2013, Consciousness and Cognition.

[12]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[13]  L. Wasserman,et al.  A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion , 1995 .

[14]  Anthony O'Hagan,et al.  Kendall's Advanced Theory of Statistics: Vol. 2B, Bayesian Inference. , 1996 .

[15]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[16]  E. Wagenmakers.  A practical solution to the pervasive problems ofp values , 2007, Psychonomic bulletin & review.

[17]  J. Rouder,et al.  Default Bayes Factors for Model Selection in Regression , 2012, Multivariate behavioral research.

[18]  Jeffrey N. Rouder,et al.  Default Bayes factors for ANOVA designs , 2012 .

[19]  Jeffrey N. Rouder,et al.  Bayes factor approaches for testing interval null hypotheses. , 2011, Psychological methods.

[20]  Explore Configuring,et al.  A Simulation Study to , 2004 .

[21]  J. Raaijmakers,et al.  How to quantify support for and against the null hypothesis: A flexible WinBUGS implementation of a default Bayesian t test , 2009, Psychonomic bulletin & review.

[22]  E. Wagenmakers,et al.  A Bayesian Perspective on Hypothesis Testing , 2006, Psychological science.

[23]  M. Sobel.  Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[24]  J. Berger,et al.  Testing Precise Hypotheses , 1987 .

[25]  Z. Diénès.  Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference , 2008 .

[26]  J. Q. Smith,et al.  1. Bayesian Statistics 4 , 1993 .

[27]  A. O'Hagan,et al.  Kendall's Advanced Theory of Statistics, Vol. 2b: Bayesian Inference. , 1996 .

[28]  H. Jeffreys,et al.  Theory of probability , 1896 .

[29]  Z. Dienes.  Bayesian Versus Orthodox Statistics: Which Side Are You On? , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[30]  E. Wagenmakers,et al.  Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method , 2010, Cognitive Psychology.

[31]  H. Hoijtink,et al.  Bayesian Evaluation of Informative Hypotheses. , 2008 .

[32]  I. J. Myung,et al.  Applying Occam’s razor in modeling cognition: A Bayesian approach , 1997 .

[33]  E. Wagenmakers,et al.  Model Comparison and the Principle of Parsimony , 2015 .

[34]  D. Mackinnon,et al.  A Simulation Study of Mediated Effect Measures. , 1995, Multivariate behavioral research.

[35]  Eric-Jan Wagenmakers,et al.  An encompassing prior generalization of the Savage-Dickey density ratio , 2010, Comput. Stat. Data Anal..

[36]  Zoltan Dienes,et al.  Bidirectional Transfer between Metaphorical Related Domains in Implicit Learning of Form-Meaning Connections , 2013, PloS one.

[37]  J. Dickey,et al.  The Weighted Likelihood Ratio, Sharp Hypotheses about Chances, the Order of a Markov Chain , 1970 .

[38]  G. C. Pomraning.  A Method for Computing , 1965 .

[39]  E. Wagenmakers,et al.  A Default Bayesian Hypothesis Test for ANOVA Designs , 2012 .

[40]  Joachim Vandekerckhove,et al.  Oxford Handbook of Computational and Mathematical Psychology , 2014 .

[41]  A. Zellner,et al.  Posterior odds ratios for selected regression hypotheses , 1980 .

[42]  Herbert Hoijtink,et al.  Inequality constrained analysis of variance: a Bayesian approach. , 2005, Psychological methods.

[43]  Jonathan J. Forster,et al.  Default Bayesian model determination methods for generalised linear mixed models , 2010, Comput. Stat. Data Anal..

[44]  L. Guerra,et al.  Objective Bayes Factors for Informative Hypotheses: “Completing” the Informative Hypothesis and “Splitting” the Bayes Factors , 2008 .

[45]  L. Goldberg,et al.  The PHLAME (Promoting Healthy Lifestyles: Alternative Models’ Effects) Firefighter Study: Outcomes of Two Models of Behavior Change , 2007, Journal of occupational and environmental medicine.

[46]  Ying Yuan,et al.  Bayesian mediation analysis. , 2009, Psychological methods.

[47]  Michèle B. Nuijten,et al.  BayesMed : Default bayesian hypothesis tests for correlation, partial correlation, and mediation (R package version 1.0.0.) , 2014 .

[48]  E. Wagenmakers,et al.  A default Bayesian hypothesis test for correlations and partial correlations , 2012, Psychonomic bulletin & review.

[49]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[50]  E. Wagenmakers,et al.  Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). , 2011, Journal of personality and social psychology.

[51]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[52]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[53]  Zoltan Dienes,et al.  Subliminal understanding of negation: Unconscious control by subliminal processing of word pairs , 2013, Consciousness and Cognition.

[54]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[55]  D. Lindley.  A STATISTICAL PARADOX , 1957 .

[56]  J. Hintze,et al.  Violin plots : A box plot-density trace synergism , 1998 .

[57]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[58]  A. Raftery,et al.  Estimating Bayes Factors via Posterior Simulation with the Laplace—Metropolis Estimator , 1997 .

[59]  M. Clyde,et al.  Mixtures of g Priors for Bayesian Variable Selection , 2008 .