Front View vs. Side View of Facial and Postural Expressions of Emotions in a Virtual Character

In 3D virtual environments and social scenes, virtual characters are not always visible from a front view. Nonverbal expressions of emotions should be designed so as to be properly perceived when viewed from multiple angles. Our platform enables the design of facial expressions including 3D expressive wrinkles and 3D postures. It was used to generate stimuli for studying the impact of front versus side views on the perception of blends of facial and postural expressions of emotions. Results observed in previous studies for front views of incongruent images are confirmed for side views. Furthermore, subjects were less confident in their ratings for side views images than for front view images.

[1]  Massimo Piccardi,et al.  Fusing Face and Body Display for Bi-modal Emotion Recognition: Single Frame Analysis and Multi-frame Post Integration , 2005, ACII.

[2]  Ying Li,et al.  Robust Symbolic Dual-View Facial Expression Recognition With Skin Wrinkles: Local Versus Global Approach , 2010, IEEE Transactions on Multimedia.

[3]  Beatrice de Gelder,et al.  Real Faces, Real Emotions: Perceiving Facial Expressions in Naturalistic Contexts of Voices, Bodies, and Scenes , 2011 .

[4]  Jean-Claude Martin,et al.  Combining Facial and Postural Expressions of Emotions in a Virtual Character , 2009, IVA.

[5]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Hyniewska,et al.  Expression of affects in Embodied Conversational Agents , 2010 .

[8]  Scherer.  Emotion and emotional competence: conceptual and theoretical issues for modeling , 2010 .

[9]  Jean-Claude Martin,et al.  Impact of Expressive Wrinkles on Perception of a Virtual Character's Facial Expressions of Emotions , 2009, IVA.

[10]  M. Katz,et al.  The Psychology of depression : contemporary theory and research , 1974 .

[11]  Jonathan Gratch,et al.  INFLUENCE OF AUTONOMIC SIGNALS ON PERCEPTION OF EMOTIONS IN EMBODIED AGENTS , 2010, Appl. Artif. Intell..

[12]  J. Hietanen,et al.  Judgment of other people's facial expressions of emotions is influenced by their concurrent affective hand movements. , 2008, Scandinavian journal of psychology.

[13]  Jean-Claude Martin,et al.  Gesture and emotion: Can basic gestural form features discriminate emotions? , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[14]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[15]  H. Wallbott.  Bodily expression of emotion , 1998 .

[16]  S. Baron-Cohen,et al.  The Cambridge Mindreading (CAM) Face-Voice Battery: Testing Complex Emotion Recognition in Adults with and without Asperger Syndrome , 2006, Journal of autism and developmental disorders.

[17]  P. Ekman.  Unmasking The Face , 1975 .

[18]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[19]  B. Stuart,et al.  Nonverbal Behavior and Psychopathology , 2008 .

[20]  Klaus R. Scherer,et al.  Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus , 2007, ACII.

[21]  Marco Schaerf,et al.  Realistic Modeling of Animatable Faces in MPEG-4 , 2004 .

[22]  Yu Zhang,et al.  Realistic and efficient wrinkle simulation using an anatomy-based face model with adaptive refinement , 2005, International 2005 Computer Graphics.

[23]  Jean-claude Martin,et al.  Appraising emotional events during a real-time interactive game , 2009, AFFINE '09.

[24]  Andrea Kleinsmith,et al.  Cross-cultural differences in recognizing affect from body posture , 2006, Interact. Comput..

[25]  Stefano Berretti,et al.  Local 3D Shape Analysis for Facial Expression Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[26]  Mark C. Coulson.  Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[27]  Wojciech Matusik,et al.  Multi-scale capture of facial geometry and motion , 2007, ACM Trans. Graph..

[28]  P. Ekman.  Emotions revealed , 2004, BMJ.

[29]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .