Can a Virtual Listener Replace a Human Listener in Active Listening Conversation?

The elderly who live alone are increasing rapidly in these years. For their mental health, it is reported useful to maintain their social life with others. Active listening is a communication technique that the listener listens to the speaker carefully and attentively by confirming or asking for more details about what they heard. Our project is aiming to develop a computer graphics animated agent who can engage active listening dialog with the elderly users. However, there is a research issue exists in this task: whether the CG animated virtual listener can be really perceived as a human active listeners even if they perform the same behaviors. This paper presents the experiment results in investigating this issue. We conducted an experiment which collects active listening teleconferences in two conditions, human-human and human-agent. In the human-agent condition, the human listener's video is substituted with a CG character performing the same behaviors. We then compared the impression in these two conditions base on the evaluation done by the participants themselves. The results showed that generally there were no significant differences between these two conditions. This means that a virtual listener can engage active listening at the level similar to human listeners if their behaviors are appropriately modeled.

[1]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[2]  Maja Pantic,et al.  The SEMAINE corpus of emotionally coloured character interactions , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[3]  Hedda Lausberg,et al.  Methods in Gesture Research: , 2009 .

[4]  Hung-Hsuan Huang,et al.  Toward a memory assistant companion for the individuals with mild memory impairment , 2012, 2012 IEEE 11th International Conference on Cognitive Informatics and Cognitive Computing.

[5]  Marc Schröder,et al.  Piecing Together the Emotion Jigsaw , 2004, MLMI.

[6]  Timothy W. Bickmore,et al.  Hospital Buddy: A Persistent Emotional Support Companion Agent for Hospital Patients , 2012, IVA.

[7]  L. Tickle-Degnen,et al.  The Nature of Rapport and Its Nonverbal Correlates , 1990 .

[8]  Marc Schröder,et al.  Annotating meaning of listener vocalizations for speech synthesis , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[9]  Louis-Philippe Morency,et al.  Virtual Rapport 2.0 , 2011, IVA.

[10]  G. Hofstede,et al.  Cultures and Organizations: Software of the Mind , 1991 .