UvA-DARE ( Digital Academic Repository ) Talk and Tools : The best of both worlds in mobile user interfaces for E-coaching

In this paper, a user interface paradigm, called Talk-and-Tools, is presented for automated e-coaching. The paradigm is based on the idea that people interact in two ways with their environment: symbolically and physically. The main goal is to show how the paradigm can be applied in the design of interactive systems that offer an acceptable coaching process. As a proof of concept, an e-coaching system is implemented that supports an insomnia therapy on a smartphone. A human coach was replaced by a cooperative virtual coach that is able to interact with a human coachee. In the interface of the system, we distinguish between a set of personalized conversations (“Talk”) and specialized modules that form a coherent structure of input and output facilities (“Tools”). Conversations contained a minimum of variation to exclude unpredictable behavior but included the necessary mechanisms for variation to offer personalized consults and support. A variety of system and user tests was conducted to validate the use of the system. After a 6-week therapy, some users spontaneously reported the experience of building a relationship with the e-coach. It is concluded that the addition of a conversational component fills an important gap in the design of current mobile systems.

[1]  Leonard Bolc,et al.  Natural language question answering systems , 1980 .

[2]  Robbert-Jan Beun,et al.  On the Generation of Coherent Dialogue: A Computational Approach , 2001 .

[3]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[4]  Timothy W. Bickmore,et al.  A reusable framework for health counseling dialogue systems based on a behavioral medicine ontology , 2011, J. Biomed. Informatics.

[5]  Elgar Fleisch,et al.  MobileCoach: A novel open source platform for the design of evidence-based, scalable and low-cost behavioral health interventions: Overview and preliminary evaluation in the public health context , 2015, 2015 Wireless Telecommunications Symposium (WTS).

[6]  Corine H. G. Horsch,et al.  Mobile Phone-Delivered Cognitive Behavioral Therapy for Insomnia: A Randomized Waitlist Controlled Trial , 2017, Journal of medical Internet research.

[7]  S. Kyle,et al.  A randomized, placebo-controlled trial of online cognitive behavioral therapy for chronic insomnia disorder delivered via an automated media-rich web application. , 2012, Sleep.

[8]  Michael F. McTear,et al.  Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear , 2002, CL.

[9]  Jane Greene,et al.  Solution-Focused Coaching: Managing People in a Complex World , 2003 .

[10]  R. Stelter A Guide to Third Generation Coaching: Narrative-Collaborative Theory and Practice , 2013 .

[11]  J. Sallis,et al.  Physical Activity and Behavioral Medicine , 1998 .

[12]  Robbert-Jan Beun,et al.  Persuasive strategies in mobile insomnia therapy: alignment, adaptation, and motivational support , 2013, Personal and Ubiquitous Computing.

[13]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[14]  Norah Vincent,et al.  Logging on for better sleep: RCT of the effectiveness of online treatment for insomnia. , 2009, Sleep.

[15]  Corine H. G. Horsch,et al.  UvA-DARE ( Digital Academic Repository ) Adherence to technology-mediated insomnia treatment : a meta-analysis , interviews , and focus groups , 2017 .

[16]  Daniel J Buysse,et al.  Psychological and behavioral treatment of insomnia:update of the recent evidence (1998-2004). , 2006, Sleep.

[17]  David Griol,et al.  The Conversational Interface: Talking to Smart Devices , 2016 .

[18]  Robert F. Simmons,et al.  Computational Linguistics Natural Language Question- Answering Systems: 1969 , 2022 .

[19]  Terry Winograd,et al.  Procedures As A Representation For Data In A Computer Program For Understanding Natural Language , 1971 .

[20]  Barbara J. Grosz,et al.  Natural-Language Processing , 1982, Artificial Intelligence.

[21]  Lee M Ritterband,et al.  Efficacy of an Internet-based behavioral intervention for adults with insomnia. , 2009, Archives of general psychiatry.

[22]  Anthony M. Grant,et al.  THE IMPACT OF LIFE COACHING ON GOAL ATTAINMENT, METACOGNITION AND MENTAL HEALTH , 2003 .

[23]  Rosa Yáñez Gómez,et al.  Heuristic Evaluation on Mobile Interfaces: A New Checklist , 2014, TheScientificWorldJournal.

[24]  P. Haynes,et al.  Insomnia: A Clinical Guide to Assessment and Treatment , 2004 .

[25]  Alex 'Sandy' Pentland,et al.  Sleep, mood and sociability in a healthy population , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Robbert-Jan Beun,et al.  Modeling Interaction in Automated E-Coaching - A Case from Insomnia Therapy , 2014 .

[27]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[28]  Candace L. Sidner,et al.  COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction , 2001, AI Mag..

[29]  N. Anderssen Physical Activity and Behavioral Medicine , 1999, Journal of health psychology.

[30]  Edwin Hutchins,et al.  Metaphors for Interface Design , 1987 .

[31]  James F. Allen Natural language understanding (2nd ed.) , 1995 .

[32]  James F. Allen Natural language understanding , 1987, Bejnamin/Cummings series in computer science.

[33]  B. J. Fogg,et al.  A behavior model for persuasive design , 2009, Persuasive '09.

[34]  Johannes Pittermann Spoken Dialogue Technology: Toward the Conversational User Interface by Michael F. McTear , 2005, Comput. Linguistics.

[35]  Robbert-Jan Beun,et al.  Improving Adherence in Automated e-Coaching - A Case from Insomnia Therapy , 2016, PERSUASIVE.

[36]  Mark A. Neerincx,et al.  Towards the usage of persuasive strategies in a virtual sleep coach , 2012 .

[37]  Corine H. G. Horsch,et al.  Adherence to Technology-mediated Insomnia Treatment , 2015 .

[38]  Clarisse Sieckenius de Souza,et al.  The Semiotic Engineering of User Interface Languages , 1993, Int. J. Man Mach. Stud..

[39]  Harry Bunt,et al.  Interpretation and Generation of Dialogue with Multidimensional Context Models , 2010, COST 2102 Training School.

[40]  A virtual sleepcoach for people suffering from insomnia , 2016 .

[41]  Robbert-Jan Beun,et al.  Automated Dialogue Generation for Behavior Intervention on Mobile Devices , 2015, EUSPN/ICTH.

[42]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[43]  Michael F. McTear,et al.  Spoken Dialogue Technology , 2004, Springer London.

[44]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[45]  C. van der Mast,et al.  An online lifestyle diary with a persuasive computer assistant providing feedback on self-management. , 2009, Technology and health care : official journal of the European Society for Engineering and Medicine.

[46]  Mirco Musolesi,et al.  SenSocial: a middleware for integrating online social networks and mobile sensing data streams , 2014, Middleware.

[47]  P. Wallis Believable Conversational Agents : Introducing the Intention Map , 2022 .

[48]  Michel C. A. Klein,et al.  Towards Fully Automated Psychotherapy for Adults - BAS - Behavioral Activation Scheduling Via Web and Mobile Phone , 2010, HEALTHINF.

[49]  Filip Smit,et al.  Self-help treatment for insomnia through television and book: a randomized trial. , 2009, Patient education and counseling.

[50]  Robbert-Jan Beun,et al.  Testing for mobile e-health interventions , 2016, SAC.

[51]  Harry Bunt,et al.  The DenK-architecture: A fundamental approach to user-interfaces , 2004, Artificial Intelligence Review.