Is mindfulness research methodology improving over time? A systematic review

Background Despite an exponential growth in research on mindfulness-based interventions, the body of scientific evidence supporting these treatments has been criticized for being of poor methodological quality. Objectives The current systematic review examined the extent to which mindfulness research demonstrated increased rigor over the past 16 years regarding six methodological features that have been highlighted as areas for improvement. These feature included using active control conditions, larger sample sizes, longer follow-up assessment, treatment fidelity assessment, and reporting of instructor training and intent-to-treat (ITT) analyses. Data sources We searched PubMed, PsychInfo, Scopus, and Web of Science in addition to a publically available repository of mindfulness studies. Study eligibility criteria Randomized clinical trials of mindfulness-based interventions for samples with a clinical disorder or elevated symptoms of a clinical disorder listed on the American Psychological Association’s list of disorders with recognized evidence-based treatment. Study appraisal and synthesis methods Independent raters screened 9,067 titles and abstracts, with 303 full text reviews. Of these, 171 were included, representing 142 non-overlapping samples. Results Across the 142 studies published between 2000 and 2016, there was no evidence for increases in any study quality indicator, although changes were generally in the direction of improved quality. When restricting the sample to those conducted in Europe and North America (continents with the longest history of scientific research in this area), an increase in reporting of ITT analyses was found. When excluding an early, high-quality study, improvements were seen in sample size, treatment fidelity assessment, and reporting of ITT analyses. Conclusions and implications of key findings Taken together, the findings suggest modest adoption of the recommendations for methodological improvement voiced repeatedly in the literature. Possible explanations for this and implications for interpreting this body of research and conducting future studies are discussed.

[1]  Simon B. Goldberg.  Why mindfulness belongs in counseling psychology: A synergistic clinical and research agenda , 2018 .

[2]  Simon B. Goldberg,et al.  Observational Study on a Mindfulness Training for Smokers within a Smoking Cessation Program , 2017, Mindfulness.

[3]  M. Farias,et al.  What is mindfulness-based therapy good for? , 2016, The lancet. Psychiatry.

[4]  Sarah Liebherz,et al.  How to assess the quality of psychotherapy outcome studies: A systematic review of quality assessment criteria , 2016, Psychotherapy research : journal of the Society for Psychotherapy Research.

[5]  Z. Segal,et al.  Efficacy of Mindfulness-Based Cognitive Therapy in Prevention of Depressive Relapse: An Individual Patient Data Meta-analysis From Randomized Trials. , 2016, JAMA psychiatry.

[6]  R. Steele,et al.  Reporting of Positive Results in Randomized Controlled Trials of Mindfulness-Based Mental Health Interventions , 2016, PloS one.

[7]  Elisabeth Schramm,et al.  Mindfulness-based cognitive therapy for depression , 2016, The Lancet.

[8]  R. Davidson,et al.  Conceptual and methodological issues in research on mindfulness and meditation. , 2015, The American psychologist.

[9]  Sona Dimidjian,et al.  Prospects for a clinical science of mindfulness-based intervention. , 2015, The American psychologist.

[10]  Lisa Miller,et al.  Mindfulness Interventions with Youth: A Meta-Analysis , 2015 .

[11]  Y. Smulders,et al.  Publication Pressure and Scientific Misconduct in Medical Scientists , 2014, Journal of empirical research on human research ethics : JERHRE.

[12]  Katherine A. MacLean,et al.  No Sustained Attention Differences in a Longitudinal Randomized Trial Comparing Mindfulness Based Stress Reduction versus Active Control , 2014, PloS one.

[13]  Simon B. Goldberg,et al.  Randomized Trial on Mindfulness Training for Smokers Targeted to a Disadvantaged Population , 2014, Substance use & misuse.

[14]  J. A. Haythornthwaite,et al.  Meditation Programs for Psychological Stress and Well-being: A Systematic Review and Meta-analysis , 2014, Deutsche Zeitschrift für Akupunktur.

[15]  Jaclyn M. Williams,et al.  Mindfulness-oriented recovery enhancement for chronic pain and prescription opioid misuse: results from an early-stage randomized controlled trial. , 2014, Journal of consulting and clinical psychology.

[16]  Guillaume Fortin,et al.  Mindfulness-based therapy: a comprehensive meta-analysis. , 2013, Clinical psychology review.

[17]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[18]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[19]  Jon Kabat-Zinn,et al.  Some reflections on the origins of MBSR, skillful means, and the trouble with maps , 2011 .

[20]  J. Kristeller,et al.  Mindfulness-Based Eating Awareness Training for Treating Binge Eating Disorder: The Conceptual Foundation , 2010, Eating disorders.

[21]  D. Black,et al.  Mindfulness Research Guide: a New Paradigm for Managing Empirical Health Information , 2010, Mindfulness.

[22]  Sophie Chen,et al.  How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological Studies , 2010, Commun. Stat. Simul. Comput..

[23]  R. McHugh,et al.  Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: The promise of transdiagnostic interventions. , 2009, Behaviour research and therapy.

[24]  R. Baer.  Mindfulness Training as a Clinical Intervention: A Conceptual and Empirical Review , 2003 .

[25]  Scott R. Bishop,et al.  What Do We Really Know About Mindfulness-Based Stress Reduction? , 2002, Psychosomatic medicine.

[26]  Z. Segal,et al.  Prevention of relapse/recurrence in major depression by mindfulness-based cognitive therapy. , 2000, Journal of consulting and clinical psychology.

[27]  J M Lachin,et al.  Statistical considerations in the intent-to-treat principle. , 2000, Controlled clinical trials.

[28]  S. Hayes,et al.  Acceptance and Commitment Therapy: An Experiential Approach to Behavior Change , 1999 .

[29]  Frederick A. Stich,et al.  A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes." , 1997 .

[30]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[31]  J. Rossi,et al.  Statistical power of psychological research: what have we gained in 20 years? , 1990, Journal of consulting and clinical psychology.

[32]  J. Kabat-Zinn,et al.  An outpatient program in behavioral medicine for chronic pain patients based on the practice of mindfulness meditation: theoretical considerations and preliminary results. , 1982, General hospital psychiatry.

[33]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[34]  Jacob Cohen,et al.  The statistical power of abnormal-social psychological research: a review. , 1962, Journal of abnormal and social psychology.

[35]  S. Maxwell,et al.  Is psychology suffering from a replication crisis? What does "failure to replicate" really mean? , 2015, The American psychologist.

[36]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[37]  C. Glenn Begley,et al.  Raise standards for preclinical cancer research , 2012 .

[38]  Zac E. Imel,et al.  The validation of an active control intervention for Mindfulness Based Stress Reduction (MBSR). , 2012, Behaviour research and therapy.

[39]  D. Cicchetti.  Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .