Contributions of facial expressions and body language to the rapid perception of dynamic emotions

Correctly perceiving emotions in others is a crucial part of social interactions. We constructed a set of dynamic stimuli to determine the relative contributions of the face and body to the accurate perception of basic emotions. We also manipulated the length of these dynamic stimuli in order to explore how much information is needed to identify emotions. The findings suggest that even a short exposure time of 250 milliseconds provided enough information to correctly identify an emotion above the chance level. Furthermore, we found that recognition patterns from the face alone and the body alone differed as a function of emotion. These findings highlight the role of the body in emotion perception and suggest an advantage for angry bodies, which, in contrast to all other emotions, were comparable to the recognition rates from the face and may be advantageous for perceiving imminent threat from a distance.

[1]  Klaus R. Scherer,et al.  Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus , 2007, ACII.

[2]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[3]  D. Bowers,et al.  Differences in startle reactivity during the perception of angry and fearful faces. , 2007, Emotion.

[4]  Garrison W. Cottrell,et al.  Transmitting and Decoding Facial Expressions , 2005, Psychological science.

[5]  Max Weisbuch,et al.  On Perceiving Facial Expressions: the Role of Culture and Context , 2011 .

[6]  Beatrice de Gelder,et al.  Watch the face and look at the body! , 2008 .

[7]  K. Scherer,et al.  Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? , 2007, Emotion.

[8]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Mark C. Coulson.  Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[10]  Beatrice de Gelder,et al.  The Bodily Expressive Action Stimulus Test (BEAST). Construction and Validation of a Stimulus Basis for Measuring Perception of Whole Body Expression of Emotions , 2011, Front. Psychology.

[11]  H. Wagner.  On measuring performance in category judgment studies of nonverbal behavior , 1993 .

[12]  Mark C. Coulson,et al.  Attentional biases using the body in the crowd task: Are angry body postures detected more rapidly? , 2011, Cognition & emotion.

[13]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[14]  M. Mortillaro,et al.  Robust anger: Recognition of deteriorated dynamic bodily emotion expressions , 2014, Cognition & emotion.

[15]  Martijn Goudbeek,et al.  Perceived Gesture Dynamics in Nonverbal Expression of Emotion , 2013, Perception.

[16]  J. Grèzes,et al.  Emotional modulation of visual and motor areas by dynamic body expressions of anger , 2008, Social neuroscience.

[17]  K. Roelofs,et al.  Perception of Face and Body Expressions Using Electromyography, Pupillometry and Gaze Measures , 2013, Front. Psychology.

[18]  Skyler T. Hawk,et al.  "Worth a thousand words": absolute and relative decoding of nonlinguistic affect vocalizations. , 2009, Emotion.

[19]  H. Meeren,et al.  Beyond the face: exploring rapid influences of context on face processing. , 2006, Progress in brain research.

[20]  K. Scherer,et al.  Emotion expression in body action and posture. , 2012, Emotion.

[21]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[22]  A. Chaudhuri,et al.  The Many Faces of a Neutral Face: Head Tilt and Perception of Dominance and Emotion , 2003 .

[23]  Boris Suchan,et al.  BESST (Bochum Emotional Stimulus Set)—A pilot validation study of a stimulus set containing emotional bodies and faces from frontal and averted views , 2013, Psychiatry Research.

[24]  Y. Trope,et al.  Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions , 2012, Science.

[25]  Julie Grèzes,et al.  Specific and common brain regions involved in the perception of faces and bodies and the representation of their emotional expressions , 2009, Social neuroscience.

[26]  B. Gelder.  Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[27]  G. Pourtois,et al.  The perception and categorisation of emotional stimuli: A review , 2010 .

[28]  Ran R. Hassin,et al.  Angry, Disgusted, or Afraid? , 2008, Psychological science.

[29]  K. Scherer,et al.  Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus , 2010 .

[30]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[31]  A. Atkinson,et al.  Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures , 2007, Cognition.

[32]  Philippe G Schyns,et al.  Smile Through Your Fear and Sadness , 2009, Psychological science.

[33]  Swann Pichon,et al.  Similarities and differences in perceiving threat from dynamic faces and bodies. An fMRI study , 2011, NeuroImage.