Beyond the Trial: Systematic Review of Real-World Uptake and Engagement With Digital Self-Help Interventions for Depression, Low Mood, or Anxiety

Background Digital self-help interventions (including online or computerized programs and apps) for common mental health issues have been shown to be appealing, engaging, and efficacious in randomized controlled trials. They show potential for improving access to therapy and improving population mental health. However, their use in the real world, ie, as implemented (disseminated) outside of research settings, may differ from that reported in trials, and implementation data are seldom reported. Objective This study aimed to review peer-reviewed articles reporting user uptake and/or ongoing use, retention, or completion data (hereafter usage data or, for brevity, engagement) from implemented pure self-help (unguided) digital interventions for depression, anxiety, or the enhancement of mood. Methods We conducted a systematic search of the Scopus, Embase, MEDLINE, and PsychINFO databases for studies reporting user uptake and/or usage data from implemented digital self-help interventions for the treatment or prevention of depression or anxiety, or the enhancement of mood, from 2002 to 2017. Additionally, we screened the reference lists of included articles, citations of these articles, and the titles of articles published in Internet Interventions, Journal of Medical Internet Research (JMIR), and JMIR Mental Health since their inception. We extracted data indicating the number of registrations or downloads and usage of interventions. Results After the removal of duplicates, 970 papers were identified, of which 10 met the inclusion criteria. Hand searching identified 1 additional article. The included articles reported on 7 publicly available interventions. There was little consistency in the measures reported. The number of registrants or downloads ranged widely, from 8 to over 40,000 per month. From 21% to 88% of users engaged in at least minimal use (eg, used the intervention at least once or completed one module or assessment), whereas 7-42% engaged in moderate use (completing between 40% and 60% of modular fixed-length programs or continuing to use apps after 4 weeks). Indications of completion or sustained use (completion of all modules or the last assessment or continuing to use apps after six weeks or more) varied from 0.5% to 28.6%. Conclusions Available data suggest that uptake and engagement vary widely among the handful of implemented digital self-help apps and programs that have reported this, and that usage may vary from that reported in trials. Implementation data should be routinely gathered and reported to facilitate improved uptake and engagement, arguably among the major challenges in digital health.

[1]  T. Penzel,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2020, Springer Reference Medizin.

[2]  Elad Yom-Tov,et al.  Predicting user adherence to behavioral eHealth interventions in the real world: examining which aspects of intervention design matter most. , 2018, Translational behavioral medicine.

[3]  John Torous,et al.  Needed Innovation in Digital Health and Smartphone Applications for Mental Health: Transparency and Trust. , 2017, JAMA psychiatry.

[4]  C. B. Taylor,et al.  A Randomized Controlled Trial of a Smartphone App for Posttraumatic Stress Disorder Symptoms , 2017, Journal of consulting and clinical psychology.

[5]  Vineet Chopra,et al.  Internet-Delivered Health Interventions That Work: Systematic Review of Meta-Analyses and Evaluation of Website Availability , 2017, Journal of medical Internet research.

[6]  C. Botella,et al.  Maximizing the Impact of e-Therapy and Serious Gaming: Time for a Paradigm Shift , 2020, Front. Psychiatry.

[7]  N. Titov,et al.  Internet-delivered treatment for older adults with anxiety and depression: implementation of the Wellbeing Plus Course in routine clinical care and comparison with research trial outcomes , 2016, BJPsych Open.

[8]  Patrick Crutchley,et al.  Seeing the “Big” Picture: Big Data Methods for Exploring Relationships Between Usage, Language, and Outcome in Internet Intervention Data , 2016, Journal of medical Internet research.

[9]  S. O'brian,et al.  International Phase II clinical trial of CBTPsych: A standalone Internet social anxiety treatment for adults who stutter. , 2016, Journal of fluency disorders.

[10]  Mark Begale,et al.  Uptake and usage of IntelliCare: A publicly available suite of mental health and well-being apps , 2016, Internet interventions.

[11]  Adam Lobel,et al.  A randomized controlled trial comparing two cognitive-behavioral programs for adolescent girls with subclinical depression: A school-based program (Op Volle Kracht) and a computerized program (SPARX). , 2016, Behaviour research and therapy.

[12]  Julia E Hoffman,et al.  Feasibility, acceptability, and potential efficacy of the PTSD Coach app: A pilot randomized controlled trial with community trauma survivors. , 2016, Psychological trauma : theory, research, practice and policy.

[13]  Antje Winkel,et al.  Textbook Of Clinical Trials , 2016 .

[14]  Brian G. Smith,et al.  Terms of engagement: Analyzing public engagement with organizations through social media , 2015, Comput. Hum. Behav..

[15]  Charles R. Graham,et al.  Measuring student engagement in technology-mediated learning: A review , 2015, Comput. Educ..

[16]  Francisco J. García-Peñalvo,et al.  Discovering usage behaviors and engagement in an Educational Virtual World , 2015, Comput. Hum. Behav..

[17]  Beth K. Jaworski,et al.  mHealth in the Wild: Using Novel Data to Examine the Reach, Use, and Impact of PTSD Coach , 2015, JMIR mental health.

[18]  Heleen Riper,et al.  Internet and Computer-Based Cognitive Behavioral Therapy for Anxiety and Depression in Youth: A Meta-Analysis of Randomized Controlled Outcome Trials , 2015, PloS one.

[19]  B. Klein,et al.  Posttreatment Attrition and Its Predictors, Attrition Bias, and Treatment Efficacy of the Anxiety Online Programs , 2014, Journal of medical Internet research.

[20]  H. Baumeister,et al.  The impact of guidance on Internet-based mental health interventions — A systematic review , 2014 .

[21]  S. O'brian,et al.  A standalone Internet cognitive behavior therapy treatment for social anxiety in adults who stutter: CBTpsych. , 2014, Journal of fluency disorders.

[22]  B. Klein,et al.  Pretreatment Attrition and Formal Withdrawal During Treatment and Their Predictors: An Exploratory Study of the Anxiety Online Data , 2014, Journal of medical Internet research.

[23]  M. Tiburcio,et al.  A four-year experience with a Web-based self-help intervention for depressive symptoms in Mexico. , 2014, Revista panamericana de salud publica = Pan American journal of public health.

[24]  Derek Richards,et al.  Computer-based psychological treatments for depression: a systematic review and meta-analysis. , 2012, Clinical psychology review.

[25]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[26]  Bruce Neal,et al.  A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies , 2011, Journal of medical Internet research.

[27]  E. Stice,et al.  Moving from efficacy to effectiveness trials in prevention research. , 2011, Behaviour research and therapy.

[28]  Michelle G. Craske,et al.  Computer Therapy for the Anxiety and Depressive Disorders Is Effective, Acceptable and Practical Health Care: A Meta-Analysis , 2010, PloS one.

[29]  H. Christensen,et al.  Adherence in Internet Interventions for Anxiety and Depression: Systematic Review , 2009, Journal of medical Internet research.

[30]  Kathleen M Griffiths,et al.  Predictors of Adherence by Adolescents to a Cognitive Behavior Therapy Website in School and Community-Based Settings , 2009, Journal of medical Internet research.

[31]  H. Christensen,et al.  Predictors of adherence among community users of a cognitive behavior therapy website , 2008, Patient preference and adherence.

[32]  H. Christensen,et al.  Comparative randomised trial of online cognitive–behavioural therapy and an information website for depression: 12-month outcomes , 2008, British Journal of Psychiatry.

[33]  H. Christensen,et al.  Free range users and one hit wonders: community users of an Internet-based cognitive behaviour therapy program. , 2006, The Australian and New Zealand journal of psychiatry.

[34]  Kathleen M Griffiths,et al.  A Comparison of Changes in Anxiety and Depression Symptoms of Spontaneous Users and Trial Participants of a Cognitive Behavior Therapy Website , 2004, Journal of medical Internet research.

[35]  H. Christensen,et al.  Delivering interventions for depression by using the internet: randomised controlled trial , 2004, BMJ : British Medical Journal.

[36]  Kathleen M Griffiths,et al.  Web-based Cognitive Behavior Therapy: Analysis of Site Usage and Changes in Depression and Anxiety Scores , 2002, Journal of medical Internet research.