Bayesian evaluation of behavior change interventions: a brief introduction and a practical example

ABSTRACT Introduction Evaluating effects of behavior change interventions is a central interest in health psychology and behavioral medicine. Researchers in these fields routinely use frequentist statistical methods to evaluate the extent to which these interventions impact behavior and the hypothesized mediating processes in the population. However, calls to move beyond the exclusive use of frequentist reasoning are now widespread in psychology and allied fields. We suggest adding Bayesian statistical methods to the researcher’s toolbox of statistical methods. Objectives We first present the basic principles of the Bayesian approach to statistics and why they are useful for researchers in health psychology. We then provide a practical example on how to evaluate intervention effects using Bayesian methods, with a focus on Bayesian hierarchical modeling. We provide the necessary materials for introductory-level readers to follow the tutorial. Conclusion: Bayesian analytical methods are now available to researchers through easy-to-use software packages, and we recommend using them to evaluate the effectiveness of interventions for their conceptual and practical benefits.

[1]  David J. Hand,et al.  Deconstructing Statistical Questions , 1994 .

[2]  Alexander Etz,et al.  Introduction to Bayesian Inference for Psychology , 2018, Psychonomic bulletin & review.

[3]  M. Campbell,et al.  Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework , 2016, PloS one.

[4]  A. Gelman Induction and Deduction in Baysian Data Analysis , 2011 .

[5]  Sarah Depaoli,et al.  Mixture class recovery in GMM under varying degrees of class separation: frequentist versus Bayesian estimation. , 2013, Psychological methods.

[6]  Felix D. Schönbrodt,et al.  Bayes factor design analysis: Planning for compelling evidence , 2016, Psychonomic Bulletin & Review.

[7]  Cosma Rohilla Shalizi,et al.  Philosophy and the practice of Bayesian statistics. , 2010, The British journal of mathematical and statistical psychology.

[8]  MaRSS Lab,et al.  The New Statistics , 2017 .

[9]  F. Dablander,et al.  How to become a Bayesian in eight easy steps: An annotated reading list , 2018, Psychonomic bulletin & review.

[10]  Joseph Hilbe,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2009 .

[11]  H. Wickham,et al.  A Grammar of Data Manipulation , 2015 .

[12]  StatisticsHarvard,et al.  Avoiding model selection in Bayesian social research , 1994 .

[13]  Alexander Etz,et al.  Introduction to the Concept of Likelihood and Its Applications , 2018 .

[14]  Robert West,et al.  Using Bayes factors for testing hypotheses about intervention effectiveness in addictions research , 2016, Addiction.

[15]  D. Lakens,et al.  Justify Your Alpha: A Response to “Redefine Statistical Significance” , 2017 .

[16]  Sarah Depaoli,et al.  A Bayesian Approach to Multilevel Structural Equation Modeling With Continuous and Dichotomous Outcomes , 2015 .

[17]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[18]  David Gal,et al.  Abandon Statistical Significance , 2017, The American Statistician.

[19]  T. Vasankari,et al.  Randomised controlled feasibility study of a school-based multi-level intervention to increase physical activity and decrease sedentary behaviour among vocational school students , 2017, International Journal of Behavioral Nutrition and Physical Activity.

[20]  Blair T. Johnson,et al.  Enhancing Reporting of Behavior Change Intervention Evaluations , 2014, Journal of acquired immune deficiency syndromes.

[21]  Deborah G Mayo,et al.  The error-statistical philosophy and the practice of Bayesian statistics: comments on Gelman and Shalizi: 'Philosophy and the practice of Bayesian statistics'. , 2013, The British journal of mathematical and statistical psychology.

[22]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[23]  Scott D. Brown,et al.  A simple introduction to Markov Chain Monte–Carlo sampling , 2016, Psychonomic bulletin & review.

[24]  T. Vasankari,et al.  ‘Let’s Move It’ – a school-based multilevel intervention to increase physical activity and reduce sedentary behaviour among older adolescents in vocational secondary schools: a study protocol for a cluster-randomised trial , 2016, BMC Public Health.

[25]  R. Nickerson,et al.  Null hypothesis significance testing: a review of an old and continuing controversy. , 2000, Psychological methods.

[26]  Nathaniel D. Phillips,et al.  YaRrr! The Pirate’s Guide to R , 2017 .

[27]  N. Lazar,et al.  The ASA Statement on p-Values: Context, Process, and Purpose , 2016 .

[28]  G. Gigerenzer Mindless statistics , 2004 .

[29]  Richard McElreath,et al.  Statistical Rethinking: A Bayesian Course with Examples in R and Stan , 2015 .

[30]  E. Deci,et al.  Self-Determination Theory Applied to Health Contexts , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[31]  Sharon Bertsch McGrayne,et al.  The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy , 2011 .

[32]  Sarah Depaoli,et al.  Improving Transparency and Replication in Bayesian Statistics: The WAMBS-Checklist , 2017, Psychological methods.

[33]  Deborah G. Mayo,et al.  Statistical Inference as Severe Testing , 2018 .

[34]  David B. Dunson,et al.  Bayesian data analysis, third edition , 2013 .

[35]  Sarah Depaoli,et al.  An introduction to Bayesian statistics in health psychology , 2017, Health psychology review.

[36]  Statistics with R , 2018 .

[37]  Frank L. Endres SIMPLE: An Introduction. , 1974 .

[38]  Matthew C. Makel,et al.  Replications in Psychology Research , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[39]  Thom Baguley,et al.  Prior approval: the growth of Bayesian methods in psychology. , 2013, The British journal of mathematical and statistical psychology.

[40]  A. O’Cathain,et al.  Process evaluation of complex interventions: Medical Research Council guidance , 2015, BMJ : British Medical Journal.

[41]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[42]  Christopher D. Chambers,et al.  Redefine statistical significance , 2017, Nature Human Behaviour.

[43]  S. D. Winter,et al.  A Systematic Review of Bayesian Articles in Psychology: The Last 25 Years , 2017, Psychological methods.

[44]  A. Gelman,et al.  Beyond subjective and objective in statistics , 2015, 1508.05453.

[45]  B. Haig Tests of Statistical Significance Made Sound , 2017, Educational and psychological measurement.

[46]  N. Bolger,et al.  Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research , 2013 .

[47]  T. Yarkoni,et al.  Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning , 2017, Perspectives on psychological science : a journal of the Association for Psychological Science.

[48]  Z. Diénès Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference , 2008 .

[49]  B. Efron A 250-year argument: Belief, behavior, and the bootstrap , 2012 .

[50]  E. Wagenmakers,et al.  Three Insights from a Bayesian Interpretation of the One-Sided P Value , 2017, Educational and psychological measurement.

[51]  Alexander J. Rothman,et al.  International Journal of Behavioral Nutrition and Physical Activity , 2004 .

[52]  R. van de Schoot,et al.  Analyzing small data sets using Bayesian estimation: the case of posttraumatic stress symptoms following mechanical ventilation in burn survivors , 2015, European journal of psychotraumatology.

[53]  Paul-Christian Bürkner,et al.  brms: An R Package for Bayesian Multilevel Models Using Stan , 2017 .

[54]  Christian P. Robert,et al.  The expected demise of the Bayes factor , 2015, 1506.08292.

[55]  N. Bolger,et al.  Within-subject mediation analysis for experimental data in cognitive psychology and neuroscience , 2017, Behavior Research Methods.

[56]  Deborah G. Mayo,et al.  Discussion: Bayesian Methods: Applied? Yes. Philosophical Defense? In Flux , 2013 .

[57]  A. Giuliani There is nothing more practical than a good theory , 2017 .

[58]  Donald R. Williams,et al.  Rethinking Robust Statistics with Modern Bayesian Methods , 2017 .

[59]  Gerd Gigerenzer,et al.  Surrogate Science , 2015 .

[60]  Alexander Etz,et al.  Using Bayes Factors to Get the Most out of Linear Regression: A Practical Guide Using R , 2015 .

[61]  J. Kruschke Bayesian estimation supersedes the t test. , 2013, Journal of experimental psychology. General.

[62]  Paul-Christian Bürkner,et al.  Ordinal Regression Models in Psychology: A Tutorial , 2019, Advances in Methods and Practices in Psychological Science.

[63]  R. West,et al.  Using Bayesian statistics in health psychology: a comment on Depaoli et al. (2017) , 2017, Health psychology review.

[64]  T. Vasankari,et al.  A systematic review of school-based interventions targeting physical activity and sedentary behaviour among older adolescents , 2015, International review of sport and exercise psychology.

[65]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[66]  J. Curley,et al.  Curating Research Assets in Behavioral Sciences : A Tutorial on the Git Version Control System , 2017 .

[67]  Heike Freud,et al.  Error And The Growth Of Experimental Knowledge , 2016 .

[68]  J. Kruschke What to believe: Bayesian methods for data analysis , 2010, Trends in Cognitive Sciences.

[69]  E. Deci,et al.  Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness , 2017 .

[70]  Andrew I. Dale,et al.  The theory that would not die , 2012 .

[71]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[72]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[73]  Richard D. Morey,et al.  Is There a Free Lunch in Inference? , 2016, Top. Cogn. Sci..

[74]  David Kaplan,et al.  The Sage handbook of quantitative methodology for the social sciences , 2004 .

[75]  Jeffrey N. Rouder,et al.  The fallacy of placing confidence in confidence intervals , 2015, Psychonomic bulletin & review.

[76]  E. Arjas,et al.  Non‐parametric Bayesian Hazard Regression for Chronic Disease Risk Assessment , 2015 .

[77]  Joachim Vandekerckhove,et al.  Editorial: Bayesian methods for advancing psychological science , 2018, Psychonomic bulletin & review.

[78]  John P. A. Ioannidis,et al.  A manifesto for reproducible science , 2017, Nature Human Behaviour.

[79]  Robert E Kass,et al.  Statistical Inference: The Big Picture. , 2011, Statistical science : a review journal of the Institute of Mathematical Statistics.