Toward a Virtual Companion for the Elderly: Exploring the Behaviors that Potentially Achieve Rapport in Human Communication

The elderly who live alone are increasing rapidly in these years. For their mental health, it is reported useful to maintain their social life with others. This work is aiming to develop a companion agent who can engage long-term relationship with the elderly users. This paper presents our first step to explore the rapport occurred in a human-human communication which is considered to be essential in keeping social relationship with others. We analyzed the corpus collected in a human-human dyadic conversation experiment from three view points, the speaker (potential user), the listener, and the third person who did not participate the conversation. Encouraging results that may provide the hints of agent development were found in the analysis: the attitude of the conversation can have an influence on the speaker’s mood, the mood of the speaker can be potentially observed by another person, and the third person can detect speaker’s attitude.

[1]  Louis-Philippe Morency,et al.  Virtual Rapport 2.0 , 2011, IVA.

[2]  G. Hofstede,et al.  Cultures and Organizations: Software of the Mind , 1991 .

[3]  L. Tickle-Degnen,et al.  The Nature of Rapport and Its Nonverbal Correlates , 1990 .

[4]  Marc Schröder,et al.  Piecing Together the Emotion Jigsaw , 2004, MLMI.

[5]  Timothy W. Bickmore,et al.  Hospital Buddy: A Persistent Emotional Support Companion Agent for Hospital Patients , 2012, IVA.

[6]  Marc Schröder,et al.  Annotating meaning of listener vocalizations for speech synthesis , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[7]  Gert Jan Hofstede,et al.  Cultures and Organizations: Software of the Mind, 3rd ed. , 2010 .

[8]  Hung-Hsuan Huang,et al.  Toward a memory assistant companion for the individuals with mild memory impairment , 2012, 2012 IEEE 11th International Conference on Cognitive Informatics and Cognitive Computing.

[9]  Maja Pantic,et al.  The SEMAINE corpus of emotionally coloured character interactions , 2010, 2010 IEEE International Conference on Multimedia and Expo.