Towards Emotionally Sensitive Conversational Interfaces for E-therapy

In this paper, we enhance systems interacting in healthcare domains by means of incorporating emotionally sensitive spoken conversational interfaces. The emotion recognizer is integrated in these systems as an intermediate phase between natural language understanding and dialog management in the architecture of a spoken dialog system. The prediction of the user’s emotional state, carried out for each user turn in the dialog, makes it possible to adapt the system dynamically selecting the next system response taking into account this valuable information. We have applied our proposal to develop an emotionally sensitive conversational system adapted to patients suffering from chronic pulmonary diseases, and provide a discussion of the positive influence of our proposal in the perceived quality.

[1]  John H. L. Hansen,et al.  Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition , 1996, Speech Commun..

[2]  R. Friedman,et al.  An automated telephone-based smoking cessation education and counseling system. , 1999, Patient education and counseling.

[3]  M W Gillman,et al.  Randomized Trial of a “Talking Computer” to Improve Adults' Eating Habits , 2001, American journal of health promotion : AJHP.

[4]  Ramesh Farzanfar,et al.  Telephone-linked care for physical activity: A qualitative evaluation of the use patterns of an information technology program for patients , 2005, J. Biomed. Informatics.

[5]  Robert C. Hubal,et al.  Informed consent procedures: An experimental test using a virtual character in a dialog systems training application , 2006, J. Biomed. Informatics.

[6]  Constantine Kotropoulos,et al.  Emotional speech recognition: Resources, features, and methods , 2006, Speech Commun..

[7]  Ramesh Farzanfar,et al.  How to write health dialog for a talking computer , 2006, J. Biomed. Informatics.

[8]  Nathanael Chambers,et al.  Chester: Towards a personal medication advisor , 2006, J. Biomed. Informatics.

[9]  S. Antoniu.  Outcomes of adult domiciliary oxygen therapy in pulmonary diseases , 2006, Expert review of pharmacoeconomics & outcomes research.

[10]  Timothy Bickmore,et al.  Health dialog systems for patients and consumers , 2006, J. Biomed. Informatics.

[11]  Ruili Wang,et al.  Ensemble methods for spoken emotion recognition in call-centres , 2007, Speech Commun..

[12]  David Griol,et al.  Acquiring and Evaluating a Dialog Corpus through a Dialog Simulation Technique , 2007, SIGdial.

[13]  Ramón López-Cózar,et al.  Influence of contextual information in emotion annotation for spoken dialogue systems , 2008, Speech Commun..

[14]  Jindal Sk.  Oxygen therapy: important considerations. , 2008 .

[15]  Oscar Saz-Torralba,et al.  Tools and Technologies for Computer-Aided Speech and Language Therapy , 2009, Speech Commun..

[16]  Tim Polzehl,et al.  Emotion detection in dialog systems: Applications, strategies and challenges , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[17]  Timothy W. Bickmore,et al.  Maintaining reality: Relational agents for antipsychotic medication adherence , 2010, Interact. Comput..

[18]  Fakhri Karray,et al.  Survey on speech emotion recognition: Features, classification schemes, and databases , 2011, Pattern Recognit..

[19]  Björn W. Schuller,et al.  Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge , 2011, Speech Commun..

[20]  Laverne Estanol,et al.  Performance of three new-generation pulse oximeters during motion and low perfusion in volunteers. , 2012, Journal of clinical anesthesia.

[21]  Roberto Pieraccini.  The Voice in the Machine: Building Computers That Understand Speech , 2012 .