Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review

Background Chronic and mental health conditions are increasingly prevalent worldwide. As devices in our everyday lives offer more and more voice-based self-service, voice-based conversational agents (VCAs) have the potential to support the prevention and management of these conditions in a scalable manner. However, evidence on VCAs dedicated to the prevention and management of chronic and mental health conditions is unclear. Objective This study provides a better understanding of the current methods used in the evaluation of health interventions for the prevention and management of chronic and mental health conditions delivered through VCAs. Methods We conducted a systematic literature review using PubMed MEDLINE, Embase, PsycINFO, Scopus, and Web of Science databases. We included primary research involving the prevention or management of chronic or mental health conditions through a VCA and reporting an empirical evaluation of the system either in terms of system accuracy, technology acceptance, or both. A total of 2 independent reviewers conducted the screening and data extraction, and agreement between them was measured using Cohen kappa. A narrative approach was used to synthesize the selected records. Results Of 7170 prescreened papers, 12 met the inclusion criteria. All studies were nonexperimental. The VCAs provided behavioral support (n=5), health monitoring services (n=3), or both (n=4). The interventions were delivered via smartphones (n=5), tablets (n=2), or smart speakers (n=3). In 2 cases, no device was specified. A total of 3 VCAs targeted cancer, whereas 2 VCAs targeted diabetes and heart failure. The other VCAs targeted hearing impairment, asthma, Parkinson disease, dementia, autism, intellectual disability, and depression. The majority of the studies (n=7) assessed technology acceptance, but only few studies (n=3) used validated instruments. Half of the studies (n=6) reported either performance measures on speech recognition or on the ability of VCAs to respond to health-related queries. Only a minority of the studies (n=2) reported behavioral measures or a measure of attitudes toward intervention-targeted health behavior. Moreover, only a minority of studies (n=4) reported controlling for participants’ previous experience with technology. Finally, risk bias varied markedly. Conclusions The heterogeneity in the methods, the limited number of studies identified, and the high risk of bias show that research on VCAs for chronic and mental health conditions is still in its infancy. Although the results of system accuracy and technology acceptance are encouraging, there is still a need to establish more conclusive evidence on the efficacy of VCAs for the prevention and management of chronic and mental health conditions, both in absolute terms and in comparison with standard health care.

[1]  Simon M. Lin,et al.  Readiness for voice assistants to support healthcare delivery during a health crisis and pandemic , 2020, npj Digital Medicine.

[2]  Amanda Lazar,et al.  Use of Intelligent Voice Assistants by Older Adults with Low Technology Use , 2020, ACM Trans. Comput. Hum. Interact..

[3]  Florian v Wangenheim,et al.  Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review , 2020, Journal of medical Internet research.

[4]  Shafiq R. Joty,et al.  Conversational Agents in Health Care: Scoping Review and Conceptual Analysis , 2020, Journal of medical Internet research.

[5]  Miguel Angel Ferrer-Ballester,et al.  Alzheimer's disease and automatic speech analysis: A review , 2020, Expert Syst. Appl..

[6]  Simon M. Lin,et al.  A scoping review of patient-facing, behavioral health interventions with voice assistant technology targeting self-management and healthy lifestyle behaviors. , 2020, Translational behavioral medicine.

[7]  James F. Boswell,et al.  A narrative review of alliance formation and outcome in text-based telepsychotherapy. , 2020 .

[8]  Florian von Wangenheim,et al.  Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review (Preprint) , 2020 .

[9]  Kerstin Denecke,et al.  Technical Metrics Used to Evaluate Health Care Chatbots: Scoping Review , 2020, Journal of medical Internet research.

[10]  Muhammad Asif Razzaq,et al.  Medical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions , 2020, Applied Sciences.

[11]  Daniela Mapelli,et al.  Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study , 2020, Journal of medical Internet research.

[12]  Rachel Cunningham,et al.  Examining Potential Usability and Health Beliefs Among Young Adults Using a Conversational Agent for HPV Vaccine Counseling , 2020, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[13]  Kangsoo Kim,et al.  Effects of Patient Care Assistant Embodiment and Computer Mediation on User Experience , 2019, 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR).

[14]  Yongqing Xu,et al.  Antegrade intramedullary nail versus plate fixation in the treatment of humeral shaft fractures , 2019, Medicine.

[15]  Adam S. Miner,et al.  Key Considerations for Incorporating Conversational AI in Psychotherapy , 2019, Front. Psychiatry.

[16]  Stefan Greuter,et al.  Social Games Are Fun: Exploring Social Interactions on Smart Speaker Platforms for People with Disabilities , 2019, CHI PLAY.

[17]  Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts , 2019, CHI PLAY.

[18]  Tingshao Zhu,et al.  Acoustic differences between healthy and depressed people: a cross-situation study , 2019, BMC Psychiatry.

[19]  Bernd T. Meyer,et al.  "Computer, Test My Hearing": Accurate Speech Audiometry with Smart Speakers , 2019, INTERSPEECH.

[20]  Cristiano André da Costa,et al.  Survey of conversational agents in health , 2019, Expert Syst. Appl..

[21]  Harald Baumeister,et al.  The Next Generation: Chatbots in Clinical Psychology and Psychotherapy to Foster Mental Health – A Scoping Review , 2019, Verhaltenstherapie.

[22]  Cui Tao,et al.  Early Usability Assessment of a Conversational Agent for HPV Vaccination , 2019, ITCH.

[23]  Amit P. Sheth,et al.  kBot: Knowledge-Enabled Personalized Chatbot for Asthma Self-Management , 2019, 2019 IEEE International Conference on Smart Computing (SMARTCOMP).

[24]  Eugene Cho,et al.  Hey Google, Can I Ask You Something in Private? , 2019, CHI.

[25]  Margot Brereton,et al.  Use of voice activated interfaces by people with intellectual disability , 2018, OZCHI.

[26]  Mattia Prosperi,et al.  A systematic review of the effectiveness of mobile apps for monitoring and management of mental health symptoms or disorders. , 2018, Journal of psychiatric research.

[27]  Bingjie Liu,et al.  Should Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot , 2018, Cyberpsychology Behav. Soc. Netw..

[28]  Arlene E. Chung,et al.  Health and Fitness Apps for Hands-Free Voice-Activated Assistants: Content Analysis , 2018, JMIR mHealth and uHealth.

[29]  Afan Galih Salman,et al.  Android based voice assistant for blind people , 2018, Library Hi Tech News.

[30]  Jessica A. Chen,et al.  Conversational agents in healthcare: a systematic review , 2018, J. Am. Medical Informatics Assoc..

[31]  Teresa K. O'Leary,et al.  Patient and Consumer Safety Risks When Using Conversational Assistants for Medical Information: An Observational Study of Siri, Alexa, and Google Assistant , 2018, Journal of medical Internet research.

[32]  Enrico Coiera,et al.  Measuring User Experience in Conversational Interfaces: A Comparison of Six Questionnaires , 2018 .

[33]  Arsénio Reis,et al.  Using intelligent personal assistants to assist the elderlies An evaluation of Amazon Alexa, Google Assistant, Microsoft Cortana, and Apple Siri , 2018, 2018 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW).

[34]  Leah Findlater,et al.  "Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities , 2018, CHI.

[35]  Nick Wilson,et al.  Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice , 2018, PloS one.

[36]  Matthew B Hoy Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants , 2018, Medical reference services quarterly.

[37]  Adam S. Miner,et al.  Talking to Machines About Personal Mental Health Problems. , 2017, JAMA.

[38]  Liliana Ferreira,et al.  CARMIE: A Conversational Medication Assistant for Heart Failure , 2017, Int. J. E Health Medical Commun..

[39]  Jeffrey M. Voas,et al.  “Alexa, Can I Trust You?” , 2017, Computer.

[40]  Satoshi Nakamura,et al.  Detecting Dementia Through Interactive Computer Avatars , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[41]  T. Kowatsch,et al.  Text-based Healthcare Chatbots Supporting Patient and Health Professional Teams: Preliminary Results of a Randomized Controlled Trial on Childhood Obesity , 2017 .

[42]  R. Calvo,et al.  Application of Synchronous Text-Based Dialogue Systems in Mental Health Interventions: Systematic Review , 2017, Journal of medical Internet research.

[43]  Luis A. Guerrero,et al.  Alexa vs. Siri vs. Cortana vs. Google Assistant: A Comparison of Speech-Based Natural User Interfaces , 2017 .

[44]  M. Copelli,et al.  Thought disorder measured as random speech structure classifies negative symptoms and schizophrenia diagnosis 6 months in advance , 2017, npj Schizophrenia.

[45]  Adam S. Miner,et al.  Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health. , 2016, JAMA internal medicine.

[46]  Daphne Zohar,et al.  Digital medicine's march on chronic disease , 2016, Nature Biotechnology.

[47]  Elgar Fleisch,et al.  MobileCoach: A novel open source platform for the design of evidence-based, scalable and low-cost behavioral health interventions: Overview and preliminary evaluation in the public health context , 2015, 2015 Wireless Telecommunications Symposium (WTS).

[48]  Kim-Phuong L. Vu,et al.  Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space , 2015, Int. J. Hum. Comput. Interact..

[49]  R. Hatcher,et al.  Development and validation of a 6-item working alliance questionnaire for repeated administrations during psychotherapy. , 2015, Psychological assessment.

[50]  Emily Gerth-Guyette,et al.  Impact of mHealth Chronic Disease Management on Treatment Adherence and Patient Outcomes: A Systematic Review , 2015, Journal of medical Internet research.

[51]  Kim-Phuong L. Vu,et al.  Voice Activated Personal Assistant: Acceptability of Use in the Public Space , 2014, HCI.

[52]  C. Vandelanotte,et al.  Are Health Behavior Change Interventions That Use Online Social Networks Effective? A Systematic Review , 2014, Journal of medical Internet research.

[53]  Viswanath Venkatesh,et al.  Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology , 2012, MIS Q..

[54]  D. Moher,et al.  The nuts and bolts of PROSPERO: an international prospective register of systematic reviews , 2012, Systematic Reviews.

[55]  Timothy W. Bickmore,et al.  A reusable framework for health counseling dialogue systems based on a behavioral medicine ontology , 2011, J. Biomed. Informatics.

[56]  David Moher,et al.  CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomised Trials , 2010, PLoS medicine.

[57]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, Journal of pharmacology & pharmacotherapeutics.

[58]  Richard J. Holden,et al.  The Technology Acceptance Model: Its past and its future in health care , 2010, J. Biomed. Informatics.

[59]  James F. Allen,et al.  Speech recognition in a dialog system for patient health monitoring , 2009, 2009 IEEE International Conference on Bioinformatics and Biomedicine Workshop.

[60]  M. Leach,et al.  Rapport: a key to treatment success. , 2005, Complementary therapies in clinical practice.

[61]  Rosalind W. Picard,et al.  Establishing the computer-patient working alliance in automated health behavior change interventions. , 2005, Patient education and counseling.

[62]  P. Bower,et al.  Patient-centred consultations and outcomes in primary care: a review of the literature. , 2002, Patient education and counseling.

[63]  J. Garske,et al.  Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review. , 2000, Journal of consulting and clinical psychology.

[64]  B. J. Fogg,et al.  Persuasive computers: perspectives and research directions , 1998, CHI.

[65]  N. Black CONSORT , 1996, The Lancet.

[66]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[67]  A. Horvath,et al.  The role of the therapeutic alliance in psychotherapy. , 1993, Journal of consulting and clinical psychology.

[68]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[69]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[70]  Kyle Taylor,et al.  Smartphone ownership is growing rapidly around the world, but not always equally , 2019 .

[71]  Yi Shang,et al.  Development and evaluation of a healthy coping voice interface application using the Google home for elderly patients with type 2 diabetes , 2018, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[72]  Janet Wiles,et al.  Hello Harlie: Enabling Speech Monitoring Through Chat-Bot Conversations , 2016, HIC.

[73]  Katja Jasinskaja,et al.  Elaboration and Explanation ⋆ , 2011 .