User Experience of Cognitive Behavioral Therapy Apps for Depression: An Analysis of App Functionality and User Reviews

Background Hundreds of mental health apps are available to the general public. With increasing pressures on health care systems, they offer a potential way for people to support their mental health and well-being. However, although many are highly rated by users, few are evidence-based. Equally, our understanding of what makes apps engaging and valuable to users is limited. Objective The aim of this paper was to analyze functionality and user opinions of mobile apps purporting to support cognitive behavioral therapy for depression and to explore key factors that have an impact on user experience and support engagement. Methods We systematically identified apps described as being based on cognitive behavioral therapy for depression. We then conducted 2 studies. In the first, we analyzed the therapeutic functionality of apps. This corroborated existing work on apps’ fidelity to cognitive behavioral therapy theory, but we also extended prior work by examining features designed to support user engagement. Engagement features found in cognitive behavioral therapy apps for depression were compared with those found in a larger group of apps that support mental well-being in a more general sense. Our second study involved a more detailed examination of user experience, through a thematic analysis of publicly available user reviews of cognitive behavioral therapy apps for depression. Results We identified 31 apps that purport to be based on cognitive behavioral therapy for depression. Functionality analysis (study 1) showed that they offered an eclectic mix of features, including many not based on cognitive behavioral therapy practice. Cognitive behavioral therapy apps used less varied engagement features compared with 253 other mental well-being apps. The analysis of 1287 user reviews of cognitive behavioral therapy apps for depression (study 2) showed that apps are used in a wide range of contexts, both replacing and augmenting therapy, and allowing users to play an active role in supporting their mental health and well-being. Users, including health professionals, valued and used apps that incorporated both core cognitive behavioral therapy and non-cognitive behavioral therapy elements, but concerns were also expressed regarding the unsupervised use of apps. Positivity was seen as important to engagement, for example, in the context of automatic thoughts, users expressed a preference to capture not just negative but also positive ones. Privacy, security, and trust were crucial to the user experience. Conclusions Cognitive behavioral therapy apps for depression need to improve with respect to incorporating evidence-based cognitive behavioral therapy elements. Equally, a positive user experience is dependent on other design factors, including consideration of varying contexts of use. App designers should be able to clearly identify the therapeutic basis of their apps, but they should also draw on evidence-based strategies to support a positive and engaging user experience. The most effective apps are likely to strike a balance between evidence-based cognitive behavioral therapy strategies and evidence-based design strategies, including the possibility of eclectic therapeutic techniques.

[1]  A. Brent-Smith On Going behind the Scenes , 1925 .

[2]  J. Norcross Handbook of eclectic psychotherapy , 1986 .

[3]  J. Barendregt,et al.  Global burden of disease , 1997, The Lancet.

[4]  J. Norcross A Primer on Psychotherapy Integration. , 2005 .

[5]  S. Ilardi,et al.  On the Integration of Cognitive-Behavioral Therapy for Depression and Positive Psychology , 2006, Journal of Cognitive Psychotherapy.

[6]  Paul A. Pavlou,et al.  Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication , 2006, EC '06.

[7]  Enhancing Health and Emotion: Mindfulness as a Missing Link Between Cognitive Therapy and Positive Psychology , 2006, Journal of Cognitive Psychotherapy.

[8]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[9]  D. Dozois,et al.  Expectancy, homework compliance, and initial change in cognitive-behavioral therapy for anxiety. , 2007, Journal of consulting and clinical psychology.

[10]  Ricardo Araya,et al.  Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial , 2009, The Lancet.

[11]  Surinder Kaur,et al.  Primary‐care patients’ expectations and experiences of online cognitive behavioural therapy for depression: a qualitative study , 2009, Health expectations : an international journal of public participation in health care and health policy.

[12]  Thomas L. Patterson,et al.  The Relationship Between Homework Compliance and Therapy Outcomes: An Updated Meta-Analysis , 2010, Cognitive Therapy and Research.

[13]  Mark Matthews,et al.  In the mood: engaging teenagers in psychotherapy using mobile phones , 2011, CHI.

[14]  Justine Schneider,et al.  Meta-review of the effectiveness of computerised CBT in treating depression , 2011, BMC psychiatry.

[15]  David Coyle,et al.  Engagement with online mental health interventions: an exploratory clinical study of a treatment for depression , 2012, CHI.

[16]  Rachel Harrison,et al.  What are you complaining about?: a study of online reviews of mobile applications , 2013, BCS HCI.

[17]  A. Haines,et al.  The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis , 2013, PLoS medicine.

[18]  H. Christensen,et al.  Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review , 2013, Journal of medical Internet research.

[19]  G. Lewis,et al.  No pain, no gain: depressed clients' experiences of cognitive behavioural therapy. , 2013, The British journal of clinical psychology.

[20]  T. Furukawa,et al.  Is computerised CBT really helpful for adult depression?-A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity , 2013, BMC Psychiatry.

[21]  Hammad Khalid On identifying user complaints of iOS apps , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[22]  Rachel Harrison,et al.  Retrieving and analyzing mobile apps feature requests from online reviews , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[23]  Jakob E. Bardram,et al.  Designing mobile health technology for bipolar disorder: a field trial of the monarca system , 2013, CHI.

[24]  Seth M Noar,et al.  Efficacy of text messaging-based interventions for health promotion: a meta-analysis. , 2013, Social science & medicine.

[25]  Virginia Braun,et al.  Successful Qualitative Research: A practical guide for beginners , 2013, QMiP Bulletin.

[26]  Ann Blandford,et al.  Don't forget your pill!: designing effective medication reminder apps that support users' daily routines , 2014, CHI.

[27]  Praminda Caleb-Solly,et al.  Mental Health App Design: A Journey From Concept to Completion , 2015, MobileHCI Adjunct.

[28]  Ricardo Araya,et al.  Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial , 2015, BMJ : British Medical Journal.

[29]  Karina Lovell,et al.  Patient experience of computerised therapy for depression in primary care , 2015, BMJ Open.

[30]  P. Krebs,et al.  Health App Use Among US Mobile Phone Owners: A National Survey , 2015, JMIR mHealth and uHealth.

[31]  David C. Mohr,et al.  MedLink: A mobile intervention to address failure points in the treatment of depression in general medicine , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[32]  J. L. Bender,et al.  Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace , 2015, JMIR mHealth and uHealth.

[33]  Oksana Zelenko,et al.  Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps , 2015, JMIR mHealth and uHealth.

[34]  Gordon Parker,et al.  Breaking Open the Black Box: Isolating the Most Potent Features of a Web and Mobile Phone-Based Intervention for Depression, Anxiety, and Stress , 2015, JMIR mental health.

[35]  N. Kristensen,et al.  Implementing research results in clinical practice- the experiences of healthcare professionals , 2015, BMC Health Services Research.

[36]  Gerrit Niezen,et al.  Can Standards and Regulations Keep Up With Health Technology? , 2015, JMIR mHealth and uHealth.

[37]  John Torous,et al.  Towards a Framework for Evaluating Mobile Mental Health Apps. , 2015, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[38]  N. Rickard,et al.  Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments , 2016, JMIR mental health.

[39]  Mirco Musolesi,et al.  My Phone and Me: Understanding People's Receptivity to Mobile Notifications , 2016, CHI.

[40]  David C. Atkins,et al.  The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial , 2016, Journal of medical Internet research.

[41]  Stefan Rennick Egglestone,et al.  Health Technologies 'In the Wild': Experiences of Engagement with Computerised CBT , 2016, CHI.

[42]  Ann Blandford,et al.  Qualitative HCI Research: Going Behind the Scenes , 2016, Synthesis Lectures on Human-Centered Informatics.

[43]  Lori Wozney,et al.  A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression , 2016, PloS one.

[44]  John Torous,et al.  The efficacy of smartphone‐based mental health interventions for depressive symptoms: a meta‐analysis of randomized controlled trials , 2017, World psychiatry : official journal of the World Psychiatric Association.

[45]  Caryn Kseniya Rubanovich,et al.  Health App Use Among Individuals With Symptoms of Depression and Anxiety: A Survey Study With Thematic Coding , 2017, JMIR mental health.

[46]  Kai Zheng,et al.  Mobile apps for mood tracking: an analysis of features and user reviews , 2017, AMIA.

[47]  Mark Matthews,et al.  Quantifying the Changeable Self: The Role of Self-Tracking in Coming to Terms With and Managing Bipolar Disorder , 2017, Hum. Comput. Interact..

[48]  S. Kertz,et al.  A Review of Free iPhone Applications Designed to Target Anxiety and Worry , 2017 .

[49]  Cecily Morrison,et al.  mHealth for Maternal Mental Health: Everyday Wisdom in Ethical Design , 2017, CHI.

[50]  P. Cuijpers,et al.  Anxiety: There is an app for that. A systematic review of anxiety apps , 2017, Depression and anxiety.

[51]  Christopher T. Barry,et al.  Evidence-Based Apps? A Review of Mental Health Mobile Applications in a Psychotherapy Context , 2017 .

[52]  Bongshin Lee,et al.  Self-tracking for Mental Wellness: Understanding Expert Perspectives and Student Experiences , 2017, CHI.

[53]  P. Stallard,et al.  Mental Health Mobile Apps for Preadolescents and Adolescents: A Systematic Review , 2017, Journal of medical Internet research.

[54]  John Torous,et al.  Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. , 2017, Journal of affective disorders.

[55]  Rebecca C Rossom,et al.  IntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety , 2017, Journal of medical Internet research.

[56]  David Kreindler,et al.  Supporting Homework Compliance in Cognitive Behavioural Therapy: Essential Features of Mobile Apps , 2017, JMIR mental health.

[57]  Gerhard Andersson,et al.  Efficacy of Self-guided Internet-Based Cognitive Behavioral Therapy in the Treatment of Depressive Symptoms: A Meta-analysis of Individual Participant Data , 2017, JAMA psychiatry.

[58]  Sean A. Munson,et al.  Examining Menstrual Tracking to Inform the Design of Personal Informatics Tools , 2017, CHI.