Intelligent Expressions of Emotions

We propose an architecture of an embodied conversational agent that takes into account two aspects of emotions: the emotions triggered by an event (the felt emotions) and the expressed emotions (the displayed ones), which may differ in real life. In this paper, we present a formalization of emotion eliciting-events based on a model of the agent’s mental state composed of beliefs, choices, and uncertainties. This model enables to identify the emotional state of an agent at any time. We also introduce a computational model based on fuzzy logic that computes facial expressions of emotions blending. Finally, examples of facial expressions resulting from the implementation of our model are shown.

[1]  P. Ekman Unmasking The Face , 1975 .

[2]  J. N. Bassili Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[3]  K Gouta,et al.  [Emotion recognition: facial components associated with various emotions]. , 2000, Shinrigaku kenkyu : The Japanese journal of psychology.

[4]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[5]  Catherine Pelachaud,et al.  From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent , 2003, Int. J. Hum. Comput. Stud..

[6]  T. D. Bui,et al.  Creating Emotions and Facial Expressions for Embodied Agents , 2004 .

[7]  W. Stroebe,et al.  Introduction to social psychology: A European perspective , 1988 .

[8]  Ana Paiva,et al.  Heroes, villians, magicians, …: dramatis personae in a virtual story creation environment , 2001, IUI '01.

[9]  Paul J. W. ten Hagen,et al.  Emotion Disc and Emotion Squares: Tools to Explore the Facial Expression Space , 2003, Comput. Graph. Forum.

[10]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[11]  Hans-Peter Seidel,et al.  Mixed feelings: expression of non-basic emotions in a muscle-based talking head , 2005, Virtual Reality.

[12]  Catherine Pelachaud,et al.  Computational Model of Believable Conversational Agents , 2003, Communication in Multiagent Systems.

[13]  L. F. Barrett,et al.  Handbook of Emotions , 1993 .

[14]  Roddy Cowie,et al.  Emotion Recognition and Synthesis Based on MPEG‐4 FAPs , 2002 .

[15]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[16]  J. Mccroskey,et al.  Nonverbal Behavior in Interpersonal Relations , 1987 .

[17]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[18]  W. S. Reilly,et al.  Believable Social and Emotional Agents. , 1996 .

[19]  Igor S. Pandzic,et al.  MPEG-4 Facial Animation , 2002 .

[20]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[21]  Peter Salovey,et al.  Current directions in emotional intelligence research , 2000 .

[22]  Philippe Bretier,et al.  ARTIMIS: Natural Dialogue Meets Rational Agency , 1997, IJCAI.

[23]  Marc-Philippe Huget,et al.  Communication in Multiagent Systems , 2003 .