Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials

Background Mental health problems are a crucial global public health concern. Owing to their cost-effectiveness and accessibility, conversational agent interventions (CAIs) are promising in the field of mental health care. Objective This study aims to present a thorough summary of the traits of CAIs available for a range of mental health problems, find evidence of efficacy, and analyze the statistically significant moderators of efficacy via a meta-analysis of randomized controlled trial. Methods Web-based databases (Embase, MEDLINE, PsycINFO, CINAHL, Web of Science, and Cochrane) were systematically searched dated from the establishment of the database to October 30, 2021, and updated to May 1, 2022. Randomized controlled trials comparing CAIs with any other type of control condition in improving depressive symptoms, generalized anxiety symptoms, specific anxiety symptoms, quality of life or well-being, general distress, stress, mental disorder symptoms, psychosomatic disease symptoms, and positive and negative affect were considered eligible. This study followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Data were extracted by 2 independent reviewers, checked by a third reviewer, and pooled using both random effect models and fixed effects models. Hedges g was chosen as the effect size. Results Of the 6900 identified records, a total of 32 studies were included, involving 6089 participants. CAIs showed statistically significant short-term effects compared with control conditions in improving depressive symptoms (g=0.29, 95% CI 0.20-0.38), generalized anxiety symptoms (g=0.29, 95% CI 0.21-0.36), specific anxiety symptoms (g=0.47, 95% CI 0.07-0.86), quality of life or well-being (g=0.27, 95% CI 0.16-0.39), general distress (g=0.33, 95% CI 0.20-0.45), stress (g=0.24, 95% CI 0.08-0.41), mental disorder symptoms (g=0.36, 95% CI 0.17-0.54), psychosomatic disease symptoms (g=0.62, 95% CI 0.14-1.11), and negative affect (g=0.28, 95% CI 0.05-0.51). However, the long-term effects of CAIs for the most mental health outcomes were not statistically significant (g=−0.04 to 0.39). Personalization and empathic response were 2 critical facilitators of efficacy. The longer duration of interaction with conversational agents was associated with the larger pooled effect sizes. Conclusions The findings show that CAIs are research-proven interventions that ought to be implemented more widely in mental health care. CAIs are effective and easily acceptable for those with mental health problems. The clinical application of this novel digital technology will conserve human health resources and optimize the allocation of mental health services. Trial Registration PROSPERO CRD42022350130; https://tinyurl.com/mvhk6w9p

[1]  M. Freeman The World Mental Health Report: transforming mental health for all , 2022, World psychiatry : official journal of the World Psychiatric Association.

[2]  C. Brindis,et al.  Young Adult Anxiety or Depressive Symptoms and Mental Health Service Utilization During the COVID-19 Pandemic , 2022, Journal of Adolescent Health.

[3]  Andrea K. Graham,et al.  An overview of and recommendations for more accessible digital mental health services , 2022, Nature Reviews Psychology.

[4]  Huaming Peng,et al.  Using AI chatbots to provide self-help depression interventions for university students: A randomized trial of effectiveness , 2022, Internet interventions.

[5]  M. Keshavan,et al.  The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality , 2021, World psychiatry : official journal of the World Psychiatric Association.

[6]  Li-Jun Jiang,et al.  Prevalence of depressive disorders and treatment in China: a cross-sectional epidemiological study. , 2021, The lancet. Psychiatry.

[7]  Alison M Darcy,et al.  A randomized controlled trial of a therapeutic relational agent for reducing substance misuse during the COVID-19 pandemic , 2021, Drug and Alcohol Dependence.

[8]  Y. Shiban,et al.  Computer-Assisted Avatar-Based Treatment for Dysfunctional Beliefs in Depressive Inpatients: A Pilot Study , 2021, Frontiers in Psychiatry.

[9]  Mark Sagar,et al.  A Digital Human for Delivering a Remote Loneliness and Stress Intervention to At-Risk Younger and Older Adults During the COVID-19 Pandemic: Pilot Randomized Controlled Trial. , 2021, JMIR mental health.

[10]  Angela Joerin,et al.  Artificial Intelligence–Based Chatbot for Anxiety and Depression in University Students: Pilot Randomized Controlled Trial , 2021, JMIR formative research.

[11]  M. Hunt,et al.  Efficacy of Zemedy, a Mobile Digital Therapeutic for the Self-management of Irritable Bowel Syndrome: Crossover Randomized Controlled Trial , 2021, JMIR mHealth and uHealth.

[12]  Sooah Jang,et al.  Mobile app-based chatbot to deliver cognitive behavioral therapy and psychoeducation for adults with attention deficit: A development and feasibility/usability study , 2021, Int. J. Medical Informatics.

[13]  S. Potvin,et al.  One-year randomized trial comparing virtual reality-assisted therapy to cognitive–behavioral therapy for patients with treatment-resistant schizophrenia , 2021, npj Schizophrenia.

[14]  D. D. de Quervain,et al.  Effectiveness of a stand-alone, smartphone-based virtual reality exposure app to reduce fear of heights in real-life: a randomized trial , 2021, npj Digital Medicine.

[15]  Feicheng Ma,et al.  Effects of Message Framing on Cancer Prevention and Detection Behaviors, Intentions, and Attitudes: Systematic Review and Meta-analysis , 2021, Journal of medical Internet research.

[16]  Bei Xu,et al.  Survey on psychotherapy chatbots , 2020, Concurr. Comput. Pract. Exp..

[17]  Lenhart K. Schubert,et al.  Aging and Engaging: A Pilot Randomized Controlled Trial of an Online Conversational Skills Coach for Older Adults. , 2020, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[18]  J. Boivin,et al.  Promoting fertility awareness and preconception health using a chatbot: a randomized controlled trial. , 2020, Reproductive biomedicine online.

[19]  Kate Loveys,et al.  The Effect of Multimodal Emotional Expression on Responses to a Digital Human during a Self-Disclosure Conversation: a Computational Analysis of User Language , 2020, Journal of Medical Systems.

[20]  S. Evans,et al.  Online psychological interventions to reduce symptoms of depression, anxiety, and general distress in those with chronic health conditions: a systematic review and meta-analysis of randomized controlled trials , 2020, Psychological Medicine.

[21]  S. Landau,et al.  Impact on mental health care and on mental health service users of the COVID-19 pandemic: a mixed methods survey of UK mental health care staff , 2020, Social Psychiatry and Psychiatric Epidemiology.

[22]  Jae-Jin Kim,et al.  Efficacy of mobile app-based interactive cognitive behavioral therapy using a chatbot for panic disorder , 2020, Int. J. Medical Informatics.

[23]  T. Kowatsch,et al.  A Smartphone-Based Health Care Chatbot to Promote Self-Management of Chronic Pain (SELMA): Pilot Randomized Controlled Trial , 2019, JMIR mHealth and uHealth.

[24]  Ling Zhang,et al.  Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed , 2020, The Lancet Psychiatry.

[25]  Gale M. Lucas,et al.  Effectiveness of an Empathic Chatbot in Combating Adverse Effects of Social Exclusion on Mood , 2020, Frontiers in Psychology.

[26]  H. Christensen,et al.  Suicide prevention using self-guided digital interventions: a systematic review and meta-analysis of randomised controlled trials. , 2020, The Lancet. Digital health.

[27]  Shafiq R. Joty,et al.  Conversational Agents in Health Care: Scoping Review and Conceptual Analysis , 2020, Journal of medical Internet research.

[28]  Roger K. Moore,et al.  Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study , 2019, Journal of medical Internet research.

[29]  Dori M. Steinberg,et al.  Dose-response research in digital health interventions: Concepts, considerations, and challenges. , 2019, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[30]  Judith Moskowitz,et al.  Use of the Chatbot “Vivibot” to Deliver Positive Psychology Skills and Promote Well-Being Among Young People After Cancer Treatment: Randomized Controlled Feasibility Trial , 2019, JMIR mHealth and uHealth.

[31]  Per Carlbring,et al.  The efficacy of app‐supported smartphone interventions for mental health problems: a meta‐analysis of randomized controlled trials , 2019, World psychiatry : official journal of the World Psychiatric Association.

[32]  W. Mansell,et al.  Conversational Agents in the Treatment of Mental Health Problems: Mixed-Method Systematic Review , 2019, JMIR mental health.

[33]  Enrico Coiera,et al.  The Personalization of Conversational Agents in Health Care: Systematic Review , 2019, Journal of medical Internet research.

[34]  Emily G Lattie,et al.  Digital Mental Health Interventions for Depression, Anxiety, and Enhancement of Psychological Well-Being Among College Students: Systematic Review , 2019, Journal of medical Internet research.

[35]  Per Carlbring,et al.  Effectiveness of Self-guided App-Based Virtual Reality Cognitive Behavior Therapy for Acrophobia: A Randomized Clinical Trial. , 2019, JAMA psychiatry.

[36]  G. Andersson,et al.  Automated virtual reality exposure therapy for spider phobia vs. in-vivo one-session treatment: A randomized non-inferiority trial. , 2019, Behaviour research and therapy.

[37]  Debaleena Chattopadhyay,et al.  Virtual Humans in Health-Related Interventions: A Meta-Analysis , 2019, CHI Extended Abstracts.

[38]  J. Halamka,et al.  Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape , 2019, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[39]  Russell Fulmer,et al.  Using Psychological Artificial Intelligence (Tess) to Relieve Symptoms of Depression and Anxiety: Randomized Controlled Trial , 2018, JMIR mental health.

[40]  Monique Simons,et al.  The Effect of Physical Activity Interventions Comprising Wearables and Smartphone Applications on Physical Activity: a Systematic Review and Meta-analysis , 2018, Sports Medicine - Open.

[41]  Mel Slater,et al.  Automated psychological therapy using immersive virtual reality for treatment of fear of heights: a single-blind, parallel-group, randomised controlled trial , 2018, The lancet. Psychiatry.

[42]  Shinichiro Suganuma,et al.  An Embodied Conversational Agent for Unguided Internet-Based Cognitive Behavior Therapy in Preventative Mental Health: Feasibility and Acceptability Pilot Trial , 2018, JMIR mental health.

[43]  L. McHugh,et al.  Chatbot-Delivered Cognitive Defusion versus Cognitive Restructuring for Negative Self-Referential Thoughts: A Pilot Study , 2018, The Psychological Record.

[44]  Jessica A. Chen,et al.  Conversational agents in healthcare: a systematic review , 2018, J. Am. Medical Informatics Assoc..

[45]  K. O'Connor,et al.  Virtual reality therapy for refractory auditory verbal hallucinations in schizophrenia: A pilot clinical trial , 2018, Schizophrenia Research.

[46]  Alan E Kazdin,et al.  Annual Research Review: Expanding mental health services through novel models of intervention delivery. , 2018, Journal of child psychology and psychiatry, and allied disciplines.

[47]  R. Morris,et al.  Towards an Artificially Empathic Conversational Agent for Mental Health Applications: System Design and User Perceptions , 2018, Journal of medical Internet research.

[48]  Adam S. Miner,et al.  Psychological, Relational, and Emotional Effects of Self-Disclosure After Conversations With a Chatbot , 2018, The Journal of communication.

[49]  Saskia M Kelders,et al.  Self-Guided Web-Based Interventions: Scoping Review on User Needs and the Potential of Embodied Conversational Agents to Address Them , 2017, Journal of medical Internet research.

[50]  Kien Hoa Ly,et al.  A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods , 2017, Internet interventions.

[51]  K. Fitzpatrick,et al.  Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial , 2017, JMIR mental health.

[52]  Ho Ming Lau,et al.  Embodied Conversational Agents in Clinical Psychology: A Scoping Review , 2017, Journal of medical Internet research.

[53]  M. Hegel,et al.  Randomized Controlled Trial of a Computerized Interactive Media-Based Problem Solving Treatment for Depression. , 2017, Behavior therapy.

[54]  V. Patel,et al.  The Impact of Digital Technology on Psychological Treatments and Their Dissemination. , 2018, Focus.

[55]  David G. Novick,et al.  Young Merlin: an embodied conversational agent in virtual reality , 2016, ICMI.

[56]  Servicio Geológico Colombiano Sgc Atlas Geológico de Colombia 2015 - Planchas 5-01, 5-02, 5-03, 5-04, 5-05, 5-06, 5-07, 5-08, 5-09, 5-10, 5-11, 5-12, 5-13, 5-14, 5-15, 5-16, 5-17, 5-18, 5-19, 5-20, 5-21, 5-22, 5-23, 5-24, 5-25, 5-26. Escala 1:500.000. Producto. Versión 2015 , 2015 .

[57]  John Clochesy,et al.  Avatar-based depression self-management technology: promising approach to improve depressive symptoms among young adults. , 2013, Applied nursing research : ANR.

[58]  M. Hegel,et al.  Electronic Problem-Solving Treatment: Description and Pilot Study of an Interactive Media Treatment for Depression , 2012, JMIR research protocols.

[59]  Takeshi Ogawa,et al.  An in vivo MRI Template Set for Morphometry, Tissue Segmentation, and fMRI Localization in Rats , 2011, Front. Neuroinform..

[60]  J. Sterne,et al.  The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials , 2011, BMJ : British Medical Journal.

[61]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[62]  H. Christensen Computerised therapy for psychiatric disorders , 2007, The Lancet.

[63]  Rosalind W. Picard,et al.  Establishing the computer-patient working alliance in automated health behavior change interventions. , 2005, Patient education and counseling.

[64]  Julian P T Higgins,et al.  Controlling the risk of spurious findings from meta‐regression , 2004, Statistics in medicine.

[65]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[66]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[67]  M. Kock,et al.  Room A, 10/17/2000 2: 00 PM - 4: 00 PM (PS) Short- and Long-Term Analgesic Effect of Intraoperative Intravenous or Epidural Ketamine Administration A-938 , 2000 .

[68]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[69]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[70]  C. Begg,et al.  Operating characteristics of a rank correlation test for publication bias. , 1994, Biometrics.

[71]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[72]  G. Andersson,et al.  Therapist-led and self-led one-session virtual reality exposure therapy for public speaking anxiety with consumer hardware and software: A randomized controlled trial. , 2019, Journal of anxiety disorders.

[73]  Jack L. Vevea,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .