Generation and visualization of emotional states in virtual characters

This paper presents an affective model that determines the emotional state of a character according to the personality traits and the experienced emotions. We consider an emotional state as the layer between personality and emotion. The proposed affective model offers a mapping between emotions and emotional states. To evidence emotional states of a virtual character, we can attribute them facial expressions based on their associated emotions. Facial expressions for intermediate emotions are generated automatically from expressions for universal emotions. The experiments show coherent emotional states produced by a simulated story. They also present how the corresponding emotions were represented through dynamic and static facial expressions. Finally, the obtained results demonstrate the satisfactory recognition by a group of people unfamiliar with the work described. Copyright © 2008 John Wiley & Sons, Ltd.

[1]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[2]  Patrick Gebhard,et al.  ALMA: a layered model of affect , 2005, AAMAS '05.

[3]  Francisco J. Serón,et al.  Real-Time Facial Expression Recognition for Natural Interaction , 2007, IbPRIA.

[4]  P. Ekman Emotion in the human face , 1982 .

[5]  Fernando Pereira,et al.  MPEG-4 facial animation technology: survey, implementation, and results , 1999, IEEE Trans. Circuits Syst. Video Technol..

[6]  Cynthia Whissell,et al.  THE DICTIONARY OF AFFECT IN LANGUAGE , 1989 .

[7]  J. Russell MEASURES OF EMOTION , 1989 .

[8]  Binh Pham,et al.  Personality and Emotion-Based High-Level Control of Affective Story Characters , 2007, IEEE Transactions on Visualization and Computer Graphics.

[9]  Sumedha Kshirsagar,et al.  A multilayer personality model , 2002, SMARTGRAPH '02.

[10]  Kostas Karpouzis,et al.  Parameterized Facial Expression Synthesis Based on MPEG-4 , 2002, EURASIP J. Adv. Signal Process..

[11]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[12]  John Yen,et al.  FLAME—Fuzzy Logic Adaptive Model of Emotions , 2000, Autonomous Agents and Multi-Agent Systems.

[13]  Mel Slater,et al.  Building Expression into Virtual Characters , 2006, Eurographics.

[14]  Patrick Gebhard,et al.  Are Computer-Generated Emotions and Moods Plausible to Humans? , 2006, IVA.

[15]  Authors' Biographies , 2005 .

[16]  Nadia Magnenat-Thalmann,et al.  Generic personality and emotion simulation for conversational agents: Research Articles , 2004 .

[17]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.