Body expressions influence recognition of emotions in the face and voice.

The most familiar emotional signals consist of faces, voices, and whole-body expressions, but so far research on emotions expressed by the whole body is sparse. The authors investigated recognition of whole-body expressions of emotion in three experiments. In the first experiment, participants performed a body expression-matching task. Results indicate good recognition of all emotions, with fear being the hardest to recognize. In the second experiment, two alternative forced choice categorizations of the facial expression of a compound face-body stimulus were strongly influenced by the bodily expression. This effect was a function of the ambiguity of the facial expression. In the third experiment, recognition of emotional tone of voice was similarly influenced by task irrelevant emotional body expressions. Taken together, the findings illustrate the importance of emotional whole-body expressions in communication either when viewed on their own or, as is often the case in realistic circumstances, in combination with facial expressions and emotional voices.

[1]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[2]  P. Ekman.  Differential communication of affect by head and body cues. , 1965, Journal of personality and social psychology.

[3]  P. Ekman.  Pictures of Facial Affect , 1976 .

[4]  R. Dawkins,et al.  Animal signals: information or manipulation? , 1978 .

[5]  J. Krebs,et al.  Behavioural Ecology: An Evolutionary Approach , 1978 .

[6]  A. Walker,et al.  Intermodal perception of expressive behaviors by human infants. , 1982, Journal of experimental child psychology.

[7]  Wendy S. Grolnick,et al.  Discrimination of vocal expressions by young infants , 1983 .

[8]  J. Freyd,et al.  The mental representation of movement when static stimuli are viewed , 1983, Perception & psychophysics.

[9]  A. Walker-Andrews.  Intermodal perception of expressive behaviors: Relation of eye and voice? , 1986 .

[10]  D R Proffitt,et al.  Perception of biomechanical motions by infants: implementation of various processing constraints. , 1987, Journal of experimental psychology. Human perception and performance.

[11]  M. Argyle.  Bodily communication, 2nd ed. , 1988 .

[12]  D. Perrett,et al.  Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images , 1991 .

[13]  A. Pick,et al.  Intermodal perception of happy and angry expressive behaviors by seven-month-old infants. , 1992, Child development.

[14]  D. Massaro,et al.  Perceiving affect from the voice and the face , 1996, Psychonomic bulletin & review.

[15]  H. Przuntek,et al.  Knowing no fear , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[16]  Jyrki Tuomainen,et al.  The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses , 1999, Neuroscience Letters.

[17]  J. Vroomen,et al.  The perception of emotions by ear and by eye , 2000 .

[18]  B. Rossion,et al.  The time‐course of intermodal binding between seeing and hearing affective information , 2000, Neuroreport.

[19]  Richard J. Davidson,et al.  Exploring Hindu Indian Emotion Expressions: Evidence for Accurate Recognition by Americans and Indians , 2000, Psychological science.

[20]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[21]  Jon Driver,et al.  Is cross-modal integration of emotional expressions independent of attentional resources? , 2001, Cognitive, affective & behavioral neuroscience.

[22]  N. Kanwisher,et al.  The Human Body , 2001 .

[23]  R. Dolan,et al.  Crossmodal binding of fear in voice and face , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[24]  R. Adolphs.  Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[25]  N. Hadjikhani,et al.  Seeing Fearful Body Expressions Activates the Fusiform Cortex and Amygdala , 2003, Current Biology.

[26]  V. Stone,et al.  The Body-Inversion Effect , 2003, Psychological science.

[27]  P. Bertelson,et al.  Multisensory integration, perception and ecological validity , 2003, Trends in Cognitive Sciences.

[28]  J. R Crawford,et al.  Differential deficits in expression recognition in gene-carriers and patients with Huntington’s disease , 2003, Neuropsychologia.

[29]  J. Stekelenburg,et al.  The neural correlates of perceiving human bodies: an ERP study on the body-inversion effect , 2004, Neuroreport.

[30]  M. Corbetta,et al.  Extrastriate body area in human occipital cortex responds to the performance of motor actions , 2004, Nature Neuroscience.

[31]  N. Hadjikhani,et al.  Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[32]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[33]  Catherine L. Reed,et al.  Perception of Faces and Bodies , 2004 .

[34]  Teodora Gliga,et al.  Structural Encoding of Body and Face in Human Infants and Adults , 2005, Journal of Cognitive Neuroscience.

[35]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[36]  P. Downing,et al.  Selectivity for the human body in the fusiform gyrus. , 2005, Journal of neurophysiology.

[37]  R. Dolan,et al.  Unconscious fear influences emotional awareness of faces and voices. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Paul Rozin,et al.  General and specific abilities to recognise negative emotions, especially disgust, as portrayed in the face and the body , 2005, Cognition & emotion.

[39]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Rebecca F. Schwarzlose,et al.  Separate Face and Body Selectivity on the Fusiform Gyrus , 2005, The Journal of Neuroscience.

[41]  T. Paus,et al.  Brain networks involved in viewing angry hands or faces. , 2006, Cerebral cortex.

[42]  B. Gelder.  Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[43]  Swann Pichon,et al.  Perceiving fear in dynamic body expressions , 2007, NeuroImage.