Integration of gaze direction and facial expression in patients with unilateral amygdala damage.

Affective and social processes play a major role in everyday life, but appropriate methods to assess disturbances in these processes after brain lesions are still lacking. Past studies have shown that amygdala damage can impair recognition of facial expressions, particularly fear, as well as processing of gaze direction; but the mechanisms responsible for these deficits remain debated. Recent accounts of human amygdala function suggest that it is a critical structure involved in self-relevance appraisal. According to such accounts, responses to a given facial expression may vary depending on concomitant gaze direction and perceived social meaning. Here we investigated facial emotion recognition and its interaction with gaze in patients with unilateral amygdala damage (n = 19), compared to healthy controls (n = 10), using computer-generated dynamic face stimuli expressing variable intensities of fear, anger or joy, with different gaze directions (direct versus averted). If emotion perception is influenced by the self-relevance of expression based on gaze direction, a fearful face with averted gaze should be more relevant than the same expression with direct gaze because it signals danger near the observer; whereas anger with direct gaze should be more relevant than with averted gaze because it directly threatens the observer. Our results confirm a critical role for the amygdala in self-relevance appraisal, showing an interaction between gaze and emotion in healthy controls, a trend for such interaction in left-damaged patients but not in right-damaged patients. Impaired expression recognition was generally more severe for fear, but with a greater deficit for right versus left damage. These findings do not only provide new insights on human amygdala function, but may also help design novel neuropsychological tests sensitive to amygdala dysfunction in various patient populations.

[1]  Karine Sergerie,et al.  The role of the amygdala in emotional processing: A quantitative meta-analysis of functional neuroimaging studies , 2008, Neuroscience & Biobehavioral Reviews.

[2]  Sophie K. Scott,et al.  Impaired auditory recognition of fear and anger following bilateral amygdala lesions , 1997, Nature.

[3]  Joseph Piven,et al.  Analysis of face gaze in autism using “Bubbles” , 2007, Neuropsychologia.

[4]  A K Anderson,et al.  Contribution of the anteromedial temporal lobes to the evaluation of facial emotion. , 2000, Neuropsychology.

[5]  Ralph Adolphs,et al.  Fear and the human amygdala , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  R. Kahn,et al.  Lateralization of amygdala activation: a systematic review of functional neuroimaging studies , 2004, Brain Research Reviews.

[7]  A. Anderson,et al.  Neural Correlates of the Automatic Processing of Threat Facial Signals , 2022 .

[8]  Jeffrey S. Maxwell,et al.  Human Amygdala Responsivity to Masked Fearful Eye Whites , 2004, Science.

[9]  Michael Angstadt,et al.  Beyond threat: Amygdala reactivity across multiple expressions of facial affect , 2006, NeuroImage.

[10]  Gereon R. Fink,et al.  Mirror Neuron and Theory of Mind Mechanisms Involved in Face-to-Face Interactions: A Functional Magnetic Resonance Imaging Approach to Empathy , 2007, Journal of Cognitive Neuroscience.

[11]  M. Bindemann,et al.  How do eye gaze and facial expression interact? , 2008 .

[12]  Chris Rorden,et al.  Spatial Normalization of Brain Images with Focal Lesions Using Cost Function Masking , 2001, NeuroImage.

[13]  P. Broks,et al.  Face processing impairments after encephalitis: amygdala damage and recognition of fear , 2000 .

[14]  R. Kleck,et al.  Effects of direct and averted gaze on the perception of facially communicated emotion. , 2005, Emotion.

[15]  S. Rauch,et al.  Masked Presentations of Emotional Facial Expressions Modulate Amygdala Activity without Explicit Knowledge , 1998, The Journal of Neuroscience.

[16]  James M. Kilner,et al.  Brain systems for assessing facial attractiveness , 2007, Neuropsychologia.

[17]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[18]  Hanna Damasio,et al.  Amygdala contribution to selective dimensions of emotion. , 2007, Social cognitive and affective neuroscience.

[19]  Patrik Vuilleumier,et al.  Effects of emotional prosody on auditory extinction for voices in patients with spatial neglect , 2008, Neuropsychologia.

[20]  L. Pessoa On the relationship between emotion and cognition , 2008, Nature Reviews Neuroscience.

[21]  G. McCarthy,et al.  When Strangers Pass , 2004, Psychological science.

[22]  Frank Schneider,et al.  Real-time fMRI of temporolimbic regions detects amygdala activation during single-trial self-induced sadness , 2003, NeuroImage.

[23]  D. Perrett,et al.  Dissociable neural responses to facial expressions of sadness and anger. , 1999, Brain : a journal of neurology.

[24]  John D E Gabrieli,et al.  Amygdala Response to Happy Faces as a Function of Extraversion , 2002, Science.

[25]  K. Nakamura,et al.  The human amygdala plays an important role in gaze monitoring. A PET study. , 1999, Brain : a journal of neurology.

[26]  A. Young,et al.  Recognition of facial emotion in nine individuals with bilateral amygdala damage , 1999, Neuropsychologia.

[27]  Sakiko Yoshikawa,et al.  The amygdala processes the emotional significance of facial expressions: an fMRI investigation using the interaction between expression and face direction , 2004, NeuroImage.

[28]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[29]  J. Winterkorn,et al.  The pathogenesis and treatment of optic disc swelling in neurosarcoidosis: a unique therapeutic response to infliximab. , 2003, Archives of neurology.

[30]  R. Adolphs,et al.  Emotion recognition from faces and prosody following temporal lobectomy. , 2001, Neuropsychology.

[31]  A. Todorov,et al.  The functional basis of face evaluation , 2008, Proceedings of the National Academy of Sciences.

[32]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[33]  Yijun Liu,et al.  Neutral faces activate the amygdala during identity matching , 2006, NeuroImage.

[34]  P. Schyns,et al.  A mechanism for impaired fear recognition after amygdala damage , 2005, Nature.

[35]  David Sander,et al.  A systems approach to appraisal mechanisms in emotion , 2005, Neural Networks.

[36]  Håkan Fischer,et al.  Enhanced amygdala responses to emotional versus neutral schematic facial expressions , 2002, Neuroreport.

[37]  K. Scherer,et al.  Appraisal processes in emotion: Theory, methods, research. , 2001 .

[38]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[39]  A. David,et al.  The impact of early and late damage to the human amygdala on 'theory of mind' reasoning. , 2004, Brain : a journal of neurology.

[40]  D Van Lancker Personal relevance and the human right hemisphere. , 1991, Brain and cognition.

[41]  R. Adolphs Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1997 .

[42]  K. Scherer,et al.  Interaction effects of perceived gaze direction and dynamic facial expression: Evidence for appraisal theories of emotion , 2007 .

[43]  Alexander Todorov,et al.  Evaluating face trustworthiness: a model based approach. , 2008, Social cognitive and affective neuroscience.

[44]  B. Mensour,et al.  Neural circuitry underlying voluntary suppression of sadness , 2003, Biological Psychiatry.

[45]  E. Naito,et al.  Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. , 2004, Brain research. Cognitive brain research.

[46]  A. Cowey,et al.  Sensitivity to eye gaze in prosopagnosic patients and monkeys with superior temporal sulcus ablation , 1990, Neuropsychologia.

[47]  Andrew D. Engell,et al.  Facial expression and gaze-direction in human superior temporal sulcus , 2007, Neuropsychologia.

[48]  L R Squire,et al.  Impaired perception of facial emotions following bilateral damage to the anterior temporal lobe. , 2001, Neuropsychology.

[49]  Alexander Todorov,et al.  Nonlinear Amygdala Response to Face Trustworthiness: Contributions of High and Low Spatial Frequency Information , 2009, Journal of Cognitive Neuroscience.

[50]  Stephan Hamann,et al.  Nosing in on the emotional brain , 2003, Nature Neuroscience.

[51]  Adam K. Anderson,et al.  Expression Without Recognition: Contributions of the Human Amygdala to Emotional Communication , 2000, Psychological science.

[52]  Luca Passamonti,et al.  Anxiety predicts a differential neural response to attended and unattended facial signals of anger and fear , 2009, NeuroImage.

[53]  Cristina Ramponi,et al.  The amygdala response to images with impact. , 2009, Social cognitive and affective neuroscience.

[54]  K. LaBar,et al.  Garner interference reveals dependencies between emotional expression and gaze in face perception. , 2007, Emotion.

[55]  Patrizia Baraldi,et al.  Impaired fear processing in right mesial temporal sclerosis: a fMRI study , 2004, Brain Research Bulletin.

[56]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[57]  J. Grafman,et al.  The Human Amygdala: An Evolved System for Relevance Detection , 2003, Reviews in the neurosciences.

[58]  A. Young,et al.  Neuropsychology of fear and loathing , 2001 .

[59]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[60]  J. Hirsch,et al.  Facial Emotion Recognition after Curative Nondominant Temporal Lobectomy in Patients with Mesial Temporal Sclerosis , 2006, Epilepsia.

[61]  Stephan Eliez,et al.  Amygdalar activation associated with positive and negative facial expressions , 2002, Neuroreport.

[62]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[63]  J. Decety,et al.  Brain Regions Involved in the Perception of Gaze: A PET Study , 1998, NeuroImage.

[64]  A. Young,et al.  Recognition of emotion with temporal lobe epilepsy and asymmetrical amygdala damage , 2006, Epilepsy & Behavior.

[65]  Peter Bartel,et al.  Amygdala, affect and cognition: evidence from 10 patients with Urbach-Wiethe disease. , 2003, Brain : a journal of neurology.

[66]  Jon Driver,et al.  Seen Gaze-Direction Modulates Fusiform Activity and Its Coupling with Other Brain Areas during Face Processing , 2001, NeuroImage.

[67]  Deborah J. Hellawell,et al.  Facial expression processing after amygdalotomy , 1996, Neuropsychologia.

[68]  R. Dolan,et al.  Separate Coding of Different Gaze Directions in the Superior Temporal Sulcus and Inferior Parietal Lobule , 2007, Current Biology.

[69]  G. Cantalupo,et al.  Impaired facial emotion recognition in early-onset right mesial temporal lobe epilepsy , 2003, Neurology.

[70]  James M Kilner,et al.  Integrated Neural Representations of Odor Intensity and Affective Valence in Human Amygdala , 2005, The Journal of Neuroscience.

[71]  S Z Rapcsak,et al.  Fear recognition deficits after focal brain damage: a cautionary note. , 2000, Neurology.

[72]  G. Glover,et al.  Dissociated neural representations of intensity and valence in human olfaction , 2003, Nature Neuroscience.

[73]  A. Young,et al.  Face processing impairments after amygdalotomy. , 1997, Brain : a journal of neurology.

[74]  R. Adolphs,et al.  Normal recognition of emotional similarity between facial expressions following bilateral amygdala damage , 1999, Neuropsychologia.

[75]  H. Przuntek,et al.  Knowing no fear , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[76]  Patrik Vuilleumier,et al.  Self-relevance processing in the human amygdala: gaze direction, facial expression, and emotion intensity. , 2009, Emotion.

[77]  N. Ambady,et al.  Effects of Gaze on Amygdala Sensitivity to Anger and Fear Faces , 2003, Science.

[78]  Lauri Nummenmaa,et al.  Face Cells: Separate Processing of Expression and Gaze in the Amygdala , 2007, Current Biology.

[79]  Hanna Damasio,et al.  Recognizing facial emotion , 1996, Nature.

[80]  Patrik Vuilleumier,et al.  Recognition of Emotional Face Expressions and Amygdala Pathology , 2007 .

[81]  C. Kennard,et al.  The anatomy of visual neglect , 2003 .