What Works and What Doesn’t Work? A Systematic Review of Digital Mental Health Interventions for Depression and Anxiety in Young People

Background: A major challenge in providing mental health interventions for young people is making such interventions accessible and appealing to those most in need. Online and app-based forms of therapy for mental health are burgeoning. It is therefore crucial to identify features that are most effective and engaging for young users. Objectives: This study reports a systematic review and meta-analysis of digital mental health interventions and their effectiveness in addressing anxiety and depression in young people to determine factors that relate to outcomes, adherence, and engagement with such interventions. Methods: A mixed methods approach was taken, including a meta-analysis of 9 randomized controlled trials that compared use of a digital intervention for depression in young people to a no-intervention control group, and 6 comparing the intervention to an active control condition. A thematic analysis and narrative synthesis of 41 studies was also performed. Results: The pooled effect size of digital mental health interventions on depression in comparison to a no-intervention control was small (Cohen’s d = 0.33, 95% CI 0.11 to 0.55), while the pooled effect size of studies comparing an intervention group to an active control showed no significant differences (Cohen’s d = 0.14, 95% CI -.04 to 0.31). Pooled effect sizes were higher when supervision was involved (studies with no-intervention controls: Cohen’s d = 0.52, 95% CI 0.23 to 0.80; studies with active control: Cohen’s d = 0.49, 95% CI -0.11, 1.01). Engagement and adherence rates were low. Qualitative analysis revealed that users liked interventions with a game-like feel and relatable, interactive content. Educational materials were perceived as boring, and users were put off by non-appealing interfaces and technical glitches. Conclusions: Digital interventions work better than no intervention to improve depression in young people when results of different studies are pooled together. However, these interventions may only be of clinical significance when use is highly supervised. Digital interventions do not work better than active alternatives regardless of the level of support. Future interventions need to move beyond the use of digital educational materials, considering other ways to attract and engage young people and to ensure relevance and appeal.

[1]  Y. Ono,et al.  School mental healthcare services using internet‐based cognitive behaviour therapy for young male athletes in Japan , 2019, Early intervention in psychiatry.

[2]  G. Murray,et al.  Moderated online social therapy for depression relapse prevention in young people: pilot study of a ‘next generation’ online intervention , 2018, Early intervention in psychiatry.

[3]  D. Maybery,et al.  Prevalence of mental illness within families in a regional child‐focussed mental health service , 2018, International journal of mental health nursing.

[4]  John Torous,et al.  Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. , 2017, Journal of affective disorders.

[5]  H. Yuen,et al.  Internet-based cognitive behavioural therapy for young people with suicide-related behaviour (Reframe-IT): a randomised controlled trial , 2017, Evidence Based Journals.

[6]  S. Ameratunga,et al.  MEMO: an mHealth intervention to prevent the onset of depression in adolescents a double‐blind, randomised, placebo‐controlled trial , 2017, Journal of child psychology and psychiatry, and allied disciplines.

[7]  A. Glowinski,et al.  Phone-Based Interventions in Adolescent Psychiatry: A Perspective and Proof of Concept Pilot Study With a Focus on Depression and Autism , 2017, JMIR research protocols.

[8]  C. Whittington,et al.  Annual Research Review: Digital health interventions for children and young people with mental health problems – a systematic and meta‐review , 2017, Journal of child psychology and psychiatry, and allied disciplines.

[9]  S. Michie,et al.  Factors Influencing Usability of a Smartphone App to Reduce Excessive Alcohol Consumption: Think Aloud and Interview Studies , 2017, Front. Public Health.

[10]  A. Tiwari,et al.  Effectiveness of a culturally attuned Internet‐based depression prevention program for Chinese adolescents: A randomized controlled trial , 2016, Depression and anxiety.

[11]  ‘Pesky gNATs’: investigating the feasibility of a novel computerized CBT intervention for adolescents with anxiety and/or depression in a Tier 3 CAMHS setting , 2016, The Cognitive Behaviour Therapist.

[12]  Amy Singleton,et al.  Online social networking and psychological experiences: The perceptions of young people with mental health difficulties , 2016, Comput. Hum. Behav..

[13]  R. Wiers,et al.  Emotional working memory training as an online intervention for adolescent anxiety and depression: A randomised controlled trial , 2016, Australian journal of psychology.

[14]  R. Hickman,et al.  Assessing the Critical Parameters of eSMART-MH: A Promising Avatar-Based Digital Therapeutic Intervention to Reduce Depressive Symptoms. , 2016, Perspectives in psychiatric care.

[15]  J. Kable,et al.  Diminished effort on a progressive ratio task in both unipolar and bipolar depression. , 2016, Journal of affective disorders.

[16]  Lori Wozney,et al.  A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression , 2016, PloS one.

[17]  Alvaro E. Carrasco Acceptability of an adventure video game in the treatment of female adolescents with symptoms of depression , 2016 .

[18]  H. Christensen,et al.  mHealth in psychiatry: time for methodological change , 2016, Evidence-Based Mental Health.

[19]  D. Borsboom,et al.  A Prospective Study on How Symptoms in a Network Predict the Onset of Depression , 2016, Psychotherapy and Psychosomatics.

[20]  K. Berry,et al.  Client and Therapist Attachment Styles and Working Alliance. , 2016, Clinical psychology & psychotherapy.

[21]  J. Pirkis,et al.  Can an Internet‐based intervention reduce suicidal ideation, depression and hopelessness among secondary school students: results from a pilot study , 2016, Early intervention in psychiatry.

[22]  A. Loonen,et al.  Circuits regulating pleasure and happiness in major depression. , 2016, Medical hypotheses.

[23]  T. Meade,et al.  Adolescents’ health-related quality of life (HRQoL) changes over time: a three year longitudinal study , 2016, Health and Quality of Life Outcomes.

[24]  M. Coles,et al.  Adolescent Mental Health Literacy: Young People's Knowledge of Depression and Social Anxiety Disorder. , 2016, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[25]  Mingfu Liu,et al.  Evaluation of a spirituality informed e-mental health tool as an intervention for major depressive disorder in adolescents and young adults – a randomized controlled pilot trial , 2015, BMC Complementary and Alternative Medicine.

[26]  Sarah Bendall,et al.  The safety and acceptability of delivering an online intervention to secondary students at risk of suicide: findings from a pilot study , 2015, Early intervention in psychiatry.

[27]  D. Anstiss,et al.  ‘Reach Out, Rise Up’: The efficacy of text messaging in an intervention package for anxiety and depression severity in young people , 2015 .

[28]  J. Proudfoot,et al.  Computerised CBT for depressed adolescents: Randomised controlled trial. , 2015, Behaviour research and therapy.

[29]  S. Zubrick,et al.  The Mental Health of Children and Adolescents: Report on the second Australian Child and Adolescent Survey of Mental Health and Wellbeing , 2015 .

[30]  B. Melnyk,et al.  Feasibility, Acceptability, and Preliminary Effects of the COPE Online Cognitive-Behavioral Skill-Building Program on Mental Health Outcomes and Academic Performance in Freshmen College Students: A Randomized Controlled Pilot Study. , 2015, Journal of child and adolescent psychiatric nursing : official publication of the Association of Child and Adolescent Psychiatric Nurses, Inc.

[31]  P. Batterham,et al.  A Web-Based Adolescent Positive Psychology Program in Schools: Randomized Controlled Trial , 2015, Journal of medical Internet research.

[32]  Oksana Zelenko,et al.  Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps , 2015, JMIR mHealth and uHealth.

[33]  Adam G. Horwitz,et al.  Online suicide risk screening and intervention with college students: a pilot randomized controlled trial. , 2015, Journal of consulting and clinical psychology.

[34]  T. Wilens,et al.  College Students: Mental Health Problems and Treatment Considerations , 2015, Academic Psychiatry.

[35]  I. Hickie,et al.  It's one 'smart' solution: Using new and emerging technologies to support the mental health and wellbeing of young men , 2014 .

[36]  P. Batterham,et al.  Evaluation of an online psychoeducation intervention to promote mental health help seeking attitudes and intentions among young adults: randomised controlled trial. , 2014, Journal of affective disorders.

[37]  S. Davies Annual Report of the Chief Medical Officer: Public Mental Health Priorities: Investing in the Evidence , 2014 .

[38]  J. Buitelaar,et al.  Mental health in Dutch adolescents: a TRAILS report on prevalence, severity, age of onset, continuity and co-morbidity of DSM disorders , 2014, Psychological Medicine.

[39]  G. Parker,et al.  Feasibility and Effectiveness of a Web-Based Positive Psychology Program for Youth Mental Health: Randomized Controlled Trial , 2014, Journal of medical Internet research.

[40]  H. Riper,et al.  Effectiveness of a Web-Based Solution-Focused Brief Chat Treatment for Depressed Adolescents and Young Adults: Randomized Controlled Trial , 2014, Journal of medical Internet research.

[41]  N. Rüsch,et al.  What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies , 2014, Psychological Medicine.

[42]  S. Whiteside,et al.  Case Examples of Enhancing Pediatric OCD Treatment With a Smartphone Application , 2014 .

[43]  Kathleen M Griffiths,et al.  Uptake and adherence of a self-directed internet-based mental health intervention with tailored e-mail reminders in senior high schools in Norway , 2014, BMC Psychiatry.

[44]  B. V. Van Voorhees,et al.  Understanding Adolescent Response to a Technology-Based Depression Prevention Program , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[45]  Michael E. Levin,et al.  Feasibility of a Prototype Web-Based Acceptance and Commitment Therapy Prevention Program for College Students , 2014, Journal of American college health : J of ACH.

[46]  H. Christensen,et al.  Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review , 2013, Journal of medical Internet research.

[47]  G. Patton,et al.  A mobile phone application for the assessment and management of youth mental health problems in primary care: health service outcomes from a randomised controlled trial of mobiletype , 2013, BMC Family Practice.

[48]  K. Stasiak,et al.  When ‘e’ therapy enters the hospital: Examination of the feasibility and acceptability of SPARX (a cCBT programme) in an adolescent inpatient unit , 2013 .

[49]  C. Bell,et al.  Randomized Clinical Trial of a Primary Care Internet-based Intervention to Prevent Adolescent Depression: One-year Outcomes. , 2013, Journal of the Canadian Academy of Child and Adolescent Psychiatry = Journal de l'Academie canadienne de psychiatrie de l'enfant et de l'adolescent.

[50]  P. McGrath,et al.  Predictors of Participant Retention in a Guided Online Self-Help Program for University Students: Prospective Cohort Study , 2013, Journal of medical Internet research.

[51]  H. Christensen,et al.  Adherence to the MoodGYM program: outcomes and predictors for an adolescent school-based population. , 2013, Journal of affective disorders.

[52]  Aine Horgan,et al.  An evaluation of an online peer support forum for university students with depressive symptoms. , 2013, Archives of psychiatric nursing.

[53]  K. Stasiak,et al.  A Pilot Double Blind Randomized Placebo Controlled Trial of a Prototype Computer-Based Cognitive Behavioural Therapy Program for Adolescents with Symptoms of Depression , 2012, Behavioural and Cognitive Psychotherapy.

[54]  Joanne C. Carey,et al.  A randomized trial of teen online problem solving: efficacy in improving caregiver outcomes after brain injury. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[55]  Byron C. Wallace,et al.  Closing the Gap between Methodologists and End-Users: R as a Computational Back-End , 2012 .

[56]  A. Parks,et al.  Disseminating Self-Help: Positive Psychology Exercises in an Online Trial , 2012, Journal of medical Internet research.

[57]  P. Cuijpers,et al.  Effectiveness of an Online Group Course for Depression in Adolescents and Young Adults: A Randomized Trial , 2012, Journal of medical Internet research.

[58]  Mathijs F. G. Lucassen,et al.  The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial , 2012, BMJ : British Medical Journal.

[59]  D. Rickwood,et al.  Psychology Research and Behavior Management the Role of Self-help in the Treatment of Mild Anxiety Disorders in Young People: an Evidence-based Review , 2022 .

[60]  L. Robinson,et al.  Adolescent help-seeking for psychological distress, depression, and anxiety using an Internet program , 2012 .

[61]  Shanthi Ameratunga,et al.  MEMO—A Mobile Phone Depression Prevention Intervention for Adolescents: Development Process and Postprogram Findings on Acceptability From a Randomized Controlled Trial , 2012, Journal of medical Internet research.

[62]  G. Eysenbach CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions , 2011, Journal of medical Internet research.

[63]  J. Sterne,et al.  The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials , 2011, BMJ : British Medical Journal.

[64]  J. Kenardy,et al.  A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. , 2011, Journal of consulting and clinical psychology.

[65]  P. Cuijpers,et al.  Supportive Accountability: A Model for Providing Human Support to Enhance Adherence to eHealth Interventions , 2011, Journal of medical Internet research.

[66]  Michelle G. Craske,et al.  Computer Therapy for the Anxiety and Depressive Disorders Is Effective, Acceptable and Practical Health Care: A Meta-Analysis , 2010, PloS one.

[67]  K. Merikangas,et al.  Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication--Adolescent Supplement (NCS-A). , 2010, Journal of the American Academy of Child and Adolescent Psychiatry.

[68]  I. Hickie,et al.  The internet as a setting for mental health service utilisation by young people , 2010, The Medical journal of Australia.

[69]  J Li,et al.  Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies , 2010, Psychological Medicine.

[70]  Maria J Grant,et al.  A typology of reviews: an analysis of 14 review types and associated methodologies. , 2009, Health information and libraries journal.

[71]  C. Gullion,et al.  Randomized Effectiveness Trial of an Internet, Pure Self-Help, Cognitive Behavioral Intervention for Depressive Symptoms in Young Adults , 2009, Cognitive behaviour therapy.

[72]  Kathleen M Griffiths,et al.  Predictors of Adherence by Adolescents to a Cognitive Behavior Therapy Website in School and Community-Based Settings , 2009, Journal of medical Internet research.

[73]  Philippa Collin,et al.  Providing online support for young people with mental health difficulties: challenges and opportunities explored , 2008, Early intervention in psychiatry.

[74]  Ronald E. Dahl,et al.  Sad Kids, Sad Media? Applying Mood Management Theory to Depressed Adolescents' Use of Media , 2008, Media psychology.

[75]  R. Gerrits,et al.  Master your mood online: A preventive chat group intervention for adolescents , 2007 .

[76]  M. Dixon-Woods,et al.  Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups , 2006 .

[77]  J. Dumville,et al.  Reporting attrition in randomised controlled trials , 2006, BMJ : British Medical Journal.

[78]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[79]  J. Henry,et al.  The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. , 2005, The British journal of clinical psychology.

[80]  Vicki A. Anderson,et al.  Development of Executive Functions Through Late Childhood and Adolescence in an Australian Sample , 2001, Developmental neuropsychology.

[81]  L. Radloff The CES-D Scale , 1977 .