Evaluating the effect of emotion on gender recognition in virtual humans

In this paper, we investigate the ability of humans to determine the gender of conversing characters, based on facial and body cues for emotion. We used a corpus of simultaneously captured facial and body motions from four male and four female actors. In our Gender Rating task, participants were asked to rate how male or female they considered the motions to be, under different emotional states. In our Emotion Recognition task, participants were asked to classify the emotions, in order to determine how accurately perceived those emotions were. We found that gender perception was affected by emotion, where certain emotions facilitated gender determination while others masked it. We also found that there was no correlation between how accurate an emotion was portrayed and how much gender information was present in that motion. Finally, we found that the model used to display the motion did not affect gender perception of motion but did alter emotion recognition.

[1]  Jessica K. Hodgins,et al.  Perception of Human Motion With Different Geometric Models , 1998, IEEE Trans. Vis. Comput. Graph..

[2]  Carol O'Sullivan,et al.  Movements and voices affect perceived sex of virtual conversers , 2010, APGV '10.

[3]  P. Ekman.  An argument for basic emotions , 1992 .

[4]  Boaz M. Ben-David,et al.  A resource of validated affective and neutral sentences to assess identification of emotion in spoken language after a brain injury , 2011, Brain injury.

[5]  Marie L. Smith,et al.  Transmission of Facial Expressions of Emotion Co-Evolved with Their Efficient Decoding in the Brain: Behavioral and Brain Evidence , 2009, PloS one.

[6]  M. D. Meijer.  The contribution of general features of body movement to the attribution of emotions , 1989 .

[7]  T. K. Srull,et al.  A Dual process model of impression formation , 1988 .

[8]  Frank E. Pollick,et al.  He throws like a girl (but only when he’s sad): Emotion affects sex-decoding of biological motion displays , 2011, Cognition.

[9]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[10]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[11]  A. Johnston,et al.  Comparing Solid-Body with Point-Light Animations , 2003, Perception.

[12]  N. Campbell,et al.  Facial movement varies by sex and is related to attractiveness , 2007 .

[13]  K. Deaux,et al.  Sorry, Wrong Number—A Reply to Gentile's Call , 1993 .

[14]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[15]  P. Devine.  Stereotypes and prejudice: Their automatic and controlled components. , 1989 .

[16]  Jean-Claude Martin,et al.  Combining Facial and Postural Expressions of Emotions in a Virtual Character , 2009, IVA.

[17]  J. Hodgins,et al.  Anthropomorphism influences perception of computer-animated characters' actions. , 2007, Social cognitive and affective neuroscience.

[18]  Fabio Pianesi,et al.  A first evaluation study of a database of kinetic facial expressions (DaFEx) , 2005, ICMI '05.

[19]  A. Fischer.  Sex Differences in Emotionality: Fact or Stereotype? , 1993 .

[20]  A. Johnston,et al.  Categorizing sex and identity from the biological motion of faces , 2001, Current Biology.

[21]  R. Unger.  Toward a redefinition of sex and gender. , 1979 .

[22]  J. N. Bassili.  Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[23]  Kristi M. Lewis.  When leaders display emotion: how followers respond to negative emotional expression of male and female leaders , 2000 .

[24]  Reginald B. Adams,et al.  Facial appearance, gender, and emotion expression. , 2004, Emotion.