Amygdala integrates emotional expression and gaze direction in response to dynamic facial expressions

Neuroimaging studies suggest that the amygdala integrates emotional expression and gaze direction, but the findings are inconsistent. We hypothesized that the dynamic facial expressions, which are more salient stimuli than static facial expressions are, would reveal the integration of emotional expression and gaze direction in amygdala activity. To test this hypothesis, we presented dynamic and static facial expressions of anger and happiness looking toward and away from the subject, and we visualized brain activity during these presentations using functional magnetic resonance imaging (fMRI). After the image acquisition phase of the study, the subject's experienced emotion in response to each stimulus was investigated. The left amygdala showed an interaction between presentation condition and gaze direction, indicating higher activity in response to dynamic, but not static, expressions looking toward the subjects than to expressions looking away from them. This was true for both angry and happy expressions. This pattern corresponded with the intensity of emotional arousal. These results suggest that the amygdala integrates emotional expression and gaze direction in dynamic facial expressions and modulates emotional arousal.

[1]  Stephan Eliez,et al.  Amygdalar activation associated with positive and negative facial expressions , 2002, Neuroreport.

[2]  P. A. Kolers,et al.  Shape and color in apparent motion , 1976, Vision Research.

[3]  C. Kimble,et al.  Gaze and Emotional Expression: The Effects of Message Positivity-Negativity and Emotional Intensity. , 1980 .

[4]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[5]  J. Pardo,et al.  Aversive gustatory stimulation activates limbic circuits in humans. , 1998, Brain : a journal of neurology.

[6]  Karine Sergerie,et al.  The role of the amygdala in emotional processing: A quantitative meta-analysis of functional neuroimaging studies , 2008, Neuroscience & Biobehavioral Reviews.

[7]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[8]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[9]  C. Kleinke.  Gaze and eye contact: a research review. , 1986, Psychological bulletin.

[10]  E. Gordon,et al.  Arousal Dissociates Amygdala and Hippocampal Fear Responses: Evidence from Simultaneous fMRI and Skin Conductance Recording , 2001, NeuroImage.

[11]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[12]  Sakiko Yoshikawa,et al.  Amygdala activity in response to forward versus backward dynamic facial expressions , 2010, Brain Research.

[13]  Thomas E. Nichols,et al.  Activation of the medial prefrontal cortex and extended amygdala by individual ratings of emotional arousal: a fMRI study , 2003, Biological Psychiatry.

[14]  M. Bindemann,et al.  How do eye gaze and facial expression interact? , 2008 .

[15]  Sakiko Yoshikawa,et al.  The amygdala processes the emotional significance of facial expressions: an fMRI investigation using the interaction between expression and face direction , 2004, NeuroImage.

[16]  Nouchine Hadjikhani,et al.  Pointing with the eyes: The role of gaze in communicating danger , 2008, Brain and Cognition.

[17]  Andrew W Young,et al.  Anxiety-related bias in the classification of emotionally ambiguous facial expressions. , 2002, Emotion.

[18]  R. Kleck,et al.  Effects of direct and averted gaze on the perception of facially communicated emotion. , 2005, Emotion.

[19]  G. McCarthy,et al.  Dynamic perception of facial affect and identity in the human brain. , 2003, Cerebral Cortex.

[20]  N. Ambady,et al.  Effects of Gaze on Amygdala Sensitivity to Anger and Fear Faces , 2003, Science.

[21]  Sakiko Yoshikawa,et al.  Enhanced Experience of Emotional Arousal in Response to Dynamic Facial Expressions , 2007 .

[22]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[23]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[24]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[25]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[26]  M. Bradley,et al.  Emotion, Motivation, and Anxiety: Brain Mechanisms and Psychophysiology the Motivational Organization of Emotion Patterns of Human Emotion Emotion and Perception the Psychophysiology of Picture Processing Neural Imaging: Motivation in the Visual Cortex Motivational Circuits in the Brain , 2022 .

[27]  M. Mesulam,et al.  Dissociation of Neural Representation of Intensity and Affective Valuation in Human Gustation , 2003, Neuron.

[28]  G. Glover,et al.  Dissociated neural representations of intensity and valence in human olfaction , 2003, Nature Neuroscience.

[29]  J. Russell,et al.  The psychology of facial expression: Frontmatter , 1997 .

[30]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Theory , 2002, NeuroImage.

[31]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[32]  W. Sato,et al.  Spontaneous facial mimicry in response to dynamic facial expressions , 2005, Cognition.

[33]  K. LaBar,et al.  Garner interference reveals dependencies between emotional expression and gaze in face perception. , 2007, Emotion.

[34]  Patricia Pliner,et al.  Nonverbal Communication of Aggression , 1975 .

[35]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[36]  K. Amunts,et al.  Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps , 2005, Anatomy and Embryology.

[37]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[38]  Jari K. Hietanen,et al.  Seeing direct and averted gaze activates the approach–avoidance motivational brain systems , 2008, Neuropsychologia.

[39]  Tetsuro Matsuzawa,et al.  Primate Origins of Human Cognition and Behavior , 2001, Springer Japan.

[40]  J. Pardo,et al.  Emotion, olfaction, and the human amygdala: amygdala activation during aversive olfactory stimulation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[42]  A. J. Fridlund.  The psychology of facial expression: The new ethology of human facial expressions , 1997 .

[43]  J. Gabrieli,et al.  Event-Related Activation in the Human Amygdala Associates with Later Memory for Individual Emotional Experience , 2000, The Journal of Neuroscience.

[44]  Hiromitsu Kobayashi,et al.  Evolution of the Human Eye as a Device for Communication , 2008 .

[45]  P. Whalen.  Fear, Vigilance, and Ambiguity , 1998 .

[46]  Phoebe C. Ellsworth,et al.  Direct Gaze as a Social Stimulus: The Example of Aggression , 1975 .

[47]  K. Scherer,et al.  Interaction effects of perceived gaze direction and dynamic facial expression: Evidence for appraisal theories of emotion , 2007 .

[48]  Clinton D. Kilts,et al.  Dissociable Neural Pathways Are Involved in the Recognition of Emotion in Static and Dynamic Facial Expressions , 2003, NeuroImage.

[49]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[50]  P. Ellsworth,et al.  Visual Behavior in Social Interaction , 1972 .

[51]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[52]  E. Naito,et al.  Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. , 2004, Brain research. Cognitive brain research.

[53]  川島 隆太.  First International Conference on Functional Mapping of the Human Brain , 1994 .

[54]  John M Hoffman,et al.  Ecstasy and Agony: Activation of the Human Amygdala in Positive and Negative Emotion , 2002, Psychological science.

[55]  G. McCarthy,et al.  Perception of dynamic changes in facial affect and identity in autism. , 2007, Social cognitive and affective neuroscience.