BLISS: An Agent for Collecting Spoken Dialogue Data about Health and Well-being

An important objective in health-technology is the ability to gather information about people’s well-being. Structured interviews can be used to obtain this information, but are time-consuming and not scalable. Questionnaires provide an alternative way to extract such information, though typically lack depth. In this paper, we present our first prototype of the BLISS agent, an artificial intelligent agent which intends to automatically discover what makes people happy and healthy. The goal of Behaviour-based Language-Interactive Speaking Systems (BLISS) is to understand the motivations behind people’s happiness by conducting a personalized spoken dialogue based on a happiness model. We built our first prototype of the model to collect 55 spoken dialogues, in which the BLISS agent asked questions to users about their happiness and well-being. Apart from a description of the BLISS architecture, we also provide details about our dataset, which contains over 120 activities and 100 motivations and is made available for usage.

[1]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[2]  L. M. Hobbs.  AUTOMATIC GENERATION OF , 1987 .

[3]  Alan W. Black,et al.  Unit selection in a concatenative speech synthesis system using a large speech database , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[4]  Lou Boves,et al.  A spoken dialog system for the Dutch public transport information service , 1997, Int. J. Speech Technol..

[5]  Esther Klabbers,et al.  Computing prosodic properties in a data-to-speech system , 1997 .

[6]  Emiel Krahmer,et al.  From data to speech: a general approach , 2001, Natural Language Engineering.

[7]  M. Seligman.  Positive psychology, positive prevention, and positive therapy. , 2002 .

[8]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[9]  John Fox,et al.  Automatic generation of spoken dialogue from medical plans and ontologies , 2006, J. Biomed. Informatics.

[10]  Timothy Bickmore,et al.  Health dialog systems for patients and consumers , 2006, J. Biomed. Informatics.

[11]  Kôiti Hasida,et al.  Towards an ISO Standard for Dialogue Act Annotation , 2010, LREC.

[12]  Daniel Povey,et al.  The Kaldi Speech Recognition Toolkit , 2011 .

[13]  M. Seligman.  Flourish: A Visionary New Understanding of Happiness and Well-being , 2011 .

[14]  J. Knottnerus,et al.  How should we define health? , 2011, BMJ : British Medical Journal.

[15]  Walter Daelemans,et al.  Pattern for Python , 2012, J. Mach. Learn. Res..

[16]  David DeVault,et al.  A Mixed-Initiative Conversational Dialogue System for Healthcare , 2012, SIGDIAL Conference.

[17]  T. Kardol.  Zora, een zelflerende robot in de praktijk , 2015 .

[18]  Manfred Tscheligi,et al.  The Persuasive Potential Questionnaire (PPQ): Challenges, Drawbacks, and Lessons Learned , 2016, PERSUASIVE.

[19]  Dirk Heylen,et al.  Flipper 2.0: A Pragmatic Dialogue Engine for Embodied Conversational Agents , 2018, IVA.

[20]  Jason Weston,et al.  Personalizing Dialogue Agents: I have a dog, do you have pets too? , 2018, ACL.

[21]  Dirk Heylen,et al.  Council of Coaches - A Novel Holistic Behavior Change Coaching Approach , 2018, ICT4AWE.

[22]  Ester Martínez-Martín,et al.  Personal Robot Assistants for Elderly Care: An Overview , 2018, Personal Assistants.

[23]  Slava Shechtman,et al.  Sequence to Sequence Neural Speech Synthesis with Prosody Modification Capabilities , 2019, 10th ISCA Workshop on Speech Synthesis (SSW 10).

[24]  Filip Radlinski,et al.  Coached Conversational Preference Elicitation: A Case Study in Understanding Movie Preferences , 2019, SIGdial.

[25]  Lenhart K. Schubert,et al.  Dialogue Design and Management for Multi-Session Casual Conversation with Older Adults , 2019, IUI Workshops.