Mood and Its Mapping onto Facial Expressions

This paper presents a method for the representation of mood in FACS-based facial expressions. To achieve this, a mapping of FACS Action Units (AUs) into the Pleasure-Arousal-Dominance (PAD) space is done. The PAD space is used as our mood model. From this mapping a set of rules are obtained, which compute the activation areas and intensities of each AU in the PAD. To validate these rules, we conducted an experiment, shedding light on the AUs combinations that result in recognizable expressions of certain mood.

[1]  Brent Lance,et al.  Glances, glares, and glowering: how should a virtual human express emotion through gaze? , 2009, Autonomous Agents and Multi-Agent Systems.

[2]  Katherine B. Martin,et al.  Facial Action Coding System , 2015 .

[3]  R. Aylett,et al.  Animating Expressive Characters for Social Interaction , 2008 .

[4]  A. Mehrabian.  Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[5]  Patrick Gebhard,et al.  ALMA: a layered model of affect , 2005, AAMAS '05.

[6]  David Stuart Robertson,et al.  Enacting the Distributed Business Workflows Using BPEL4WS on the Multi-agent Platform , 2005, MATES.

[7]  David Moore,et al.  12. Designing avatars for social interactions , 2008 .

[8]  Elisabeth André,et al.  Simplified facial animation control utilizing novel input devices: a comparative study , 2009, IUI.

[9]  Nadia Magnenat-Thalmann,et al.  Applying Affect Recognition in Serious Games: The PlayMancer Project , 2009, MIG.

[10]  F. Strack,et al.  The influence of mood on the intensity of emotional responses: Disentangling feeling and knowing , 2001 .

[11]  Sascha Ossowski,et al.  Representing Emotion and Mood States for Virtual Agents , 2011, MATES.

[12]  P. Ekman.  Darwin's contributions to our understanding of emotional expressions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Linda L. Caldwell,et al.  Movies and mood: an exploration of the critical variables related to mood states , 1998 .

[14]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[15]  Nadia Magnenat-Thalmann,et al.  Making Them Remember—Emotional Virtual Characters with Memory , 2009, IEEE Computer Graphics and Applications.

[16]  Patrick Gebhard.  Emotionalisierung interaktiver virtueller Charaktere: ein mehrschichtiges Computermodell zur Erzeugung und Simulation von Gefühlen in Echtzeit , 2009 .

[17]  Mark Burkitt,et al.  The Mood and Memory of Believable Adaptable Socially Intelligent Characters , 2008, IVA.

[18]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[19]  Carlos Ramos,et al.  Personality, Emotion, and Mood in Agent-Based Group Decision Making , 2011, IEEE Intelligent Systems.

[20]  Jean-claude Martin,et al.  Appraising emotional events during a real-time interactive game , 2009, AFFINE '09.

[21]  Gary Faigin,et al.  The Artistʼs Complete Guide to Facial Expression , 1990 .

[22]  Paul F. M. J. Verschure,et al.  Live Soundscape Composition Based on Synthetic Emotions , 2003, IEEE Multim..