Assessing the Usability of a Chatbot for Mental Health Care

The aim of this paper is to assess the usability of a chatbot for mental health care within a social enterprise. Chatbots are becoming more prevalent in our daily lives, as we can now use them to book flights, manage savings, and check the weather. Chatbots are increasingly being used in mental health care, with the emergence of “virtual therapists”. In this study, the usability of a chatbot named iHelpr has been assessed. iHelpr has been developed to provide guided self-assessment, and tips for the following areas: stress, anxiety, depression, sleep, and self esteem. This study used a questionnaire developed by Chatbottest, and the System Usability Scale to assess the usability of iHelpr. The participants in this study enjoyed interacting with the chatbot, and found it easy to use. However, the study highlighted areas that need major improvements, such as Error Management and Intelligence. A list of recommendations has been developed to improve the usability of the iHelpr chatbot.

[1]  Maurice Mulvenna,et al.  Back to the Future: Lessons from Knowledge Engineering Methodologies for Chatbot Design and Development , 2018 .

[2]  Gemma Tombs,et al.  Sharing Secrets with Robots , 2014 .

[3]  Ramón López-Cózar,et al.  Affective Conversational Agents: The Role of Personality and Emotion in Spoken Interactions , 2011 .

[4]  Manolya Kavakli,et al.  Towards the Development of A Virtual Counselor to Tackle Students' Exam Stress , 2012, J. Integr. Des. Process. Sci..

[5]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[6]  K. Coperich,et al.  Continuous Improvement Study of Chatbot Technologies using a Human Factors Methodology , .

[7]  Eva Hornecker artec Association for the Advancement of Computing in Education ( AACE ) . Distributed via the Web by permission of AACE Coupling Physical Artifacts and Abstract Representations , 1998 .

[8]  Michael F. McTear,et al.  Best Practices for Designing Chatbots in Mental Healthcare – A Case Study on iHelpr , 2018 .

[9]  David Cameron,et al.  Towards a chatbot for digital counselling , 2017, BCS HCI.

[10]  Asbjørn Følstad,et al.  Chatbots and the new world of HCI , 2017, Interactions.

[11]  Andreas Paepcke,et al.  Conversational Agents and Mental Health: Theory-Informed Assessment of Language and Affect , 2016, HAI.

[12]  Sheldon Cohen,et al.  PERCEIVED STRESS SCALE , 2014 .

[13]  K. Fitzpatrick,et al.  Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial , 2017, JMIR mental health.

[14]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[15]  Enrico Coiera,et al.  Measuring User Experience in Conversational Interfaces: A Comparison of Six Questionnaires , 2018 .