Exploring the Effect of Motion Type and Emotions on the Perception of Gender in Virtual Humans

In this article, we investigate the perception of gender from the motion of virtual humans under different emotional conditions and explore the effect of emotional bias on gender perception (e.g., anger being attributed to males more than females). As motion types can present different levels of physiological cues, we also explore how two types of motion (walking and conversations) are affected by emotional bias. Walking typically displays more physiological cues about gender (e.g., hip sway) and therefore is expected to be less affected by emotional bias. To investigate these effects, we used a corpus of captured facial and body motions from four male and four female actors, performing basic emotions through conversation and walk. We expected that the appearance of the model would also influence gender perception; therefore, we displayed both male and female motions on two virtual models of different sex. Two experiments were then conducted to assess gender judgments from these motions. In both experiments, participants were asked to rate how male or female they considered the motions to be under different emotional states, then classified the emotions to determine how accurately they were portrayed by actors. Overall, both experiments showed that gender ratings were affected by the displayed emotion. However, we found that conversations were influenced by gender stereotypes to a greater extent than walking motions. This was particularly true for anger, which was perceived as male on both male and female motions, and sadness, which was perceived as less male when portrayed by male actors. We also found a slight effect of the model when observing gender on different types of virtual models. These results have implications for the design and animation of virtual humans.

[1]  Boaz M. Ben-David,et al.  A resource of validated affective and neutral sentences to assess identification of emotion in spoken language after a brain injury , 2011, Brain injury.

[2]  A. Johnston,et al.  Comparing Solid-Body with Point-Light Animations , 2003, Perception.

[3]  A. Fischer Sex Differences in Emotionality: Fact or Stereotype? , 1993 .

[4]  Y. Trope,et al.  Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions , 2012, Science.

[5]  Marie L. Smith,et al.  Transmission of Facial Expressions of Emotion Co-Evolved with Their Efficient Decoding in the Brain: Behavioral and Brain Evidence , 2009, PloS one.

[6]  J. N. Bassili Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[7]  Fabio Pianesi,et al.  A first evaluation study of a database of kinetic facial expressions (DaFEx) , 2005, ICMI '05.

[8]  D. Keltner,et al.  The Gender Stereotyping of Emotions , 2000 .

[9]  Jessica K. Hodgins,et al.  The saliency of anomalies in animated human characters , 2010, TAP.

[10]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[11]  Reginald B. Adams,et al.  Facial appearance, gender, and emotion expression. , 2004, Emotion.

[12]  Ludovic Hoyet,et al.  Emotion Capture: Emotionally Expressive Characters for Games , 2013, MIG.

[13]  Jean-Claude Martin,et al.  Combining Facial and Postural Expressions of Emotions in a Virtual Character , 2009, IVA.

[14]  J. Hodgins,et al.  Anthropomorphism influences perception of computer-animated characters' actions. , 2007, Social cognitive and affective neuroscience.

[15]  Jessica K. Hodgins,et al.  Evaluating the effect of motion and body shape on the perceived sex of virtual characters , 2009, TAP.

[16]  A. Johnston,et al.  Categorizing sex and identity from the biological motion of faces , 2001, Current Biology.

[17]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[18]  Antony S R Manstead,et al.  Gender and culture differences in emotion. , 2004, Emotion.

[19]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[20]  P. Ekman An argument for basic emotions , 1992 .

[21]  T. K. Srull,et al.  A Dual process model of impression formation , 1988 .

[22]  B. Fink,et al.  The Role of Human Body Movements in Mate Selection , 2010, Evolutionary psychology : an international journal of evolutionary approaches to psychology and behavior.

[23]  Frank E. Pollick,et al.  He throws like a girl (but only when he’s sad): Emotion affects sex-decoding of biological motion displays , 2011, Cognition.

[24]  R. Unger Toward a redefinition of sex and gender. , 1979 .

[25]  Ekaterina P. Volkova,et al.  Emotion categorization of body expressions in narrative scenarios , 2014, Front. Psychol..

[26]  Betty J. Mohler,et al.  Recognizing your own motions on virtual avatars: is it me or not? , 2013, SAP.

[27]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[28]  N. Campbell,et al.  Facial movement varies by sex and is related to attractiveness , 2007 .

[29]  Elizabeth A. Crane,et al.  Motion Capture and Emotion: Affect Detection in Whole Body Movement , 2007, ACII.

[30]  Jessica K. Hodgins,et al.  The perception of finger motions , 2010, APGV '10.

[31]  K. Deaux,et al.  Sorry, Wrong Number—A Reply to Gentile's Call , 1993 .

[32]  J. Cutting Generation of Synthetic Male and Female Walkers through Manipulation of a Biomechanical Invariant , 1978, Perception.

[33]  Kerri L. Johnson,et al.  Perceiving Sex Directly and Indirectly , 2005, Psychological science.

[34]  M. D. Meijer The contribution of general features of body movement to the attribution of emotions , 1989 .