Body expressions influence recognition of emotions in the face and voice.

The most familiar emotional signals consist of faces, voices, and whole-body expressions, but so far research on emotions expressed by the whole body is sparse. The authors investigated recognition of whole-body expressions of emotion in three experiments. In the first experiment, participants performed a body expression-matching task. Results indicate good recognition of all emotions, with fear being the hardest to recognize. In the second experiment, two alternative forced choice categorizations of the facial expression of a compound face-body stimulus were strongly influenced by the bodily expression. This effect was a function of the ambiguity of the facial expression. In the third experiment, recognition of emotional tone of voice was similarly influenced by task irrelevant emotional body expressions. Taken together, the findings illustrate the importance of emotional whole-body expressions in communication either when viewed on their own or, as is often the case in realistic circumstances, in combination with facial expressions and emotional voices.

[1]  Rebecca F. Schwarzlose,et al.  Separate face and body selectivity on the fusiform gyrus. , 2010, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Swann Pichon,et al.  Perceiving fear in dynamic body expressions , 2007, NeuroImage.

[3]  T. Paus,et al.  Brain networks involved in viewing angry hands or faces. , 2006, Cerebral cortex.

[4]  B. Gelder Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[5]  R. Dolan,et al.  Unconscious fear influences emotional awareness of faces and voices. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[6]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Teodora Gliga,et al.  Structural Encoding of Body and Face in Human Infants and Adults , 2005, Journal of Cognitive Neuroscience.

[8]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[9]  Paul Rozin,et al.  General and specific abilities to recognise negative emotions, especially disgust, as portrayed in the face and the body , 2005, Cognition & emotion.

[10]  N. Hadjikhani,et al.  Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[11]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[12]  M. Corbetta,et al.  Extrastriate body area in human occipital cortex responds to the performance of motor actions , 2004, Nature Neuroscience.

[13]  J. Stekelenburg,et al.  The neural correlates of perceiving human bodies: an ERP study on the body-inversion effect , 2004, Neuroreport.

[14]  N. Hadjikhani,et al.  Seeing Fearful Body Expressions Activates the Fusiform Cortex and Amygdala , 2003, Current Biology.

[15]  P. Bertelson,et al.  Multisensory integration, perception and ecological validity , 2003, Trends in Cognitive Sciences.

[16]  V. Stone,et al.  The Body-Inversion Effect , 2003, Psychological science.

[17]  R. Adolphs Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[18]  Jon Driver,et al.  Is cross-modal integration of emotional expressions independent of attentional resources? , 2001, Cognitive, affective & behavioral neuroscience.

[19]  N. Kanwisher,et al.  The Human Body , 2001 .

[20]  R. Dolan,et al.  Crossmodal binding of fear in voice and face , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[21]  J. Vroomen,et al.  The perception of emotions by ear and by eye , 2000 .

[22]  Richard J. Davidson,et al.  Exploring Hindu Indian Emotion Expressions: Evidence for Accurate Recognition by Americans and Indians , 2000, Psychological science.

[23]  B. Rossion,et al.  The time‐course of intermodal binding between seeing and hearing affective information , 2000, Neuroreport.

[24]  A W Young,et al.  Knowing no fear , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[25]  Jyrki Tuomainen,et al.  The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses , 1999, Neuroscience Letters.

[26]  D. Massaro,et al.  Perceiving affect from the voice and the face , 1996, Psychonomic bulletin & review.

[27]  A. Pick,et al.  Intermodal perception of happy and angry expressive behaviors by seven-month-old infants. , 1992, Child development.

[28]  D. Perrett,et al.  Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images , 1991 .

[29]  D R Proffitt,et al.  Perception of biomechanical motions by infants: implementation of various processing constraints. , 1987, Journal of experimental psychology. Human perception and performance.

[30]  A. Walker-Andrews Intermodal perception of expressive behaviors: Relation of eye and voice? , 1986 .

[31]  J. Freyd,et al.  The mental representation of movement when static stimuli are viewed , 1983, Perception & psychophysics.

[32]  Wendy S. Grolnick,et al.  Discrimination of vocal expressions by young infants , 1983 .

[33]  A. Walker,et al.  Intermodal perception of expressive behaviors by human infants. , 1982, Journal of experimental child psychology.

[34]  Shelley Masion Rosenberg Bodily Communication , 1978 .

[35]  P. Ekman Differential communication of affect by head and body cues. , 1965, Journal of personality and social psychology.

[36]  P. Downing,et al.  Selectivity for the human body in the fusiform gyrus. , 2005, Journal of neurophysiology.

[37]  A. Lamba,et al.  Differential deficits in expression recognition in gene-carriers and patients with Huntington ’ s disease , 2003 .

[38]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[39]  R. Dawkins,et al.  Animal signals: information or manipulation? , 1978 .

[40]  J. Krebs,et al.  Behavioural ecology: An evolutionary approach , 1978 .

[41]  P. Ekman Pictures of Facial Affect , 1976 .

[42]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals , 1872 .