Common and distinct neural responses during direct and incidental processing of multiple facial emotions

Whether common or distinct neural systems underpin perception of different emotions and the degree to which these systems are automatically engaged during emotional perception are unresolved. We performed an event-related fMRI experiment in which subjects viewed morphed emotional faces displaying low or high intensities of disgust, fear, happiness, or sadness under two task conditions. The amygdala and fusiform cortex responded to high-intensity expressions of all emotions, independent of task. Right superior temporal sulcus showed an additive effect of the emotion-directed task and high-intensity emotion. Ventromedial prefrontal and somatosensory cortices, regions implicated in providing representations of somatic states, showed enhanced activity during explicit emotional judgments. We failed to find predicted differences between emotions. The results suggest that amygdala contributes to task-independent perceptual processing of a range of emotions. We interpret ventromedial prefrontal and somatosensory cortex activations as evidence that these regions contribute to explicit emotion processing through linking emotion perception with representations of somatic states previously engendered by emotions.

[1]  S. Rauch,et al.  Masked Presentations of Emotional Facial Expressions Modulate Amygdala Activity without Explicit Knowledge , 1998, The Journal of Neuroscience.

[2]  Jordan Grafman,et al.  A thoroughly modern gage , 1999 .

[3]  R. Adolphs Social cognition and the human brain , 1999, Trends in Cognitive Sciences.

[4]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[5]  W Gaebel,et al.  Neurophysiological correlates of the recognition of facial expressions of emotion as revealed by magnetoencephalography. , 1999, Brain research. Cognitive brain research.

[6]  Paul J. Eslinger,et al.  Long-term psychological consequences of childhood frontal lobe lesion in patient DT , 1992, Brain and Cognition.

[7]  E. Maguire The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings. , 2001, Scandinavian journal of psychology.

[8]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[9]  J. O'Doherty,et al.  Appetitive and Aversive Olfactory Learning in Humans Studied Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[10]  S Z Rapcsak,et al.  Fear recognition deficits after focal brain damage: a cautionary note. , 2000, Neurology.

[11]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[12]  A. Damasio The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 1999 .

[13]  H. Critchley,et al.  Neural Activity Relating to Generation and Representation of Galvanic Skin Conductance Responses: A Functional Magnetic Resonance Imaging Study , 2000, The Journal of Neuroscience.

[14]  J. O'Doherty,et al.  Automatic and intentional brain responses during evaluation of trustworthiness of faces , 2002, Nature Neuroscience.

[15]  L R Squire,et al.  Impaired perception of facial emotions following bilateral damage to the anterior temporal lobe. , 2001, Neuropsychology.

[16]  R. Dolan,et al.  Crossmodal binding of fear in voice and face , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[17]  C. Darwin The Expression of the Emotions in Man and Animals , .

[18]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[19]  P. Ekman Pictures of Facial Affect , 1976 .

[20]  R. Adolphs Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[21]  A. Young,et al.  Recognition of facial emotion in nine individuals with bilateral amygdala damage , 1999, Neuropsychologia.

[22]  G. Pagnoni,et al.  Explicit and Incidental Facial Expression Processing: An fMRI Study , 2001, NeuroImage.

[23]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[24]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[25]  H. Critchley,et al.  Explicit and implicit neural mechanisms for processing of social information from facial expressions: A functional magnetic resonance imaging study , 2000, Human brain mapping.

[26]  W. James II.—WHAT IS AN EMOTION ? , 1884 .

[27]  Michael Jacobs,et al.  Conscious and Unconscious , 2003 .

[28]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[29]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[30]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[31]  Karl J. Friston,et al.  Amygdala–Hippocampal Involvement in Human Aversive Trace Conditioning Revealed through Event-Related Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[32]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[33]  Thomas J. Ross,et al.  Amygdala response to both positively and negatively valenced stimuli , 2001, Neuroreport.

[34]  J. Mazziotta,et al.  Modulating emotional responses: effects of a neocortical network on the limbic system , 2000, Neuroreport.

[35]  B Milner,et al.  Perception of faces by patients with localized cortical excisions. , 1983, Canadian journal of psychology.

[36]  Karl J. Friston,et al.  The slice-timing problem in event-related fMRI , 1999 .

[37]  M. Posner The Brain and Emotion , 1999, Nature Medicine.

[38]  D. Perrett,et al.  Neural Representation for the Perception of the Intentionality of Actions , 2000, Brain and Cognition.

[39]  A. Ohman,et al.  Automaticity and the Amygdala: Nonconscious Responses to Emotional Faces , 2002 .

[40]  Karl J. Friston,et al.  Brain Systems Mediating Aversive Conditioning: an Event-Related fMRI Study , 1998, Neuron.

[41]  H. Przuntek,et al.  Knowing no fear , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[42]  N. Sadato,et al.  Attention to emotion modulates fMRI activity in human right superior temporal sulcus. , 2001, Brain research. Cognitive brain research.

[43]  Veronique Bohbot,et al.  Impaired Preference Conditioning after Anterior Temporal Lobe Resection in Humans , 2000, The Journal of Neuroscience.

[44]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[45]  A. Damasio,et al.  Severe disturbance of higher cognition after bilateral frontal lobe ablation , 1985, Neurology.

[46]  Charles D. Smith,et al.  Neural substrates of facial emotion processing using fMRI. , 2001, Brain research. Cognitive brain research.

[47]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[48]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[49]  P. Broks,et al.  Face processing impairments after encephalitis: amygdala damage and recognition of fear , 2000 .

[50]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[51]  A. Young,et al.  Face processing impairments after amygdalotomy. , 1997, Brain : a journal of neurology.

[52]  E. J. Thompson,et al.  The Amygdala. Neurobiological Aspects of Emotion, Memory and Mental Dysfunction , 1992 .

[53]  Karl J. Friston,et al.  Event‐related f MRI , 1997, Human brain mapping.

[54]  D. Perrett,et al.  A specific neural substrate for perceiving facial expressions of disgust , 1997, Nature.

[55]  E. Rolls,et al.  Face and voice expression identification in patients with emotional and behavioural changes following ventral frontal lobe damage , 1996, Neuropsychologia.

[56]  A. Young,et al.  Neural responses to facial and vocal expressions of fear and disgust , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[57]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[58]  G. Fink,et al.  Cerebral Representation of One’s Own Past: Neural Networks Involved in Autobiographical Memory , 1996, The Journal of Neuroscience.

[59]  Edward T. Bullmore,et al.  A differential neural response to threatening and non-threatening negative facial expressions in paranoid and non-paranoid schizophrenics , 1999, Psychiatry Research: Neuroimaging.

[60]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[61]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[62]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[63]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[64]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[65]  A W Young,et al.  Knowing no fear , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[66]  K. Zilles,et al.  The neural correlates of person familiarity. A functional magnetic resonance imaging study with clinical implications. , 2001, Brain : a journal of neurology.

[67]  E A Maguire,et al.  Neuroimaging studies of autobiographical event memory. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[68]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[69]  Karl J. Friston,et al.  Coping with the variance structure of neuroimaging data , 2002 .

[70]  Andrew W. Young,et al.  Neuropsychology of fear and loathing , 2001, Nature Reviews Neuroscience.

[71]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[72]  C. Rorden,et al.  Stereotaxic display of brain lesions. , 2000, Behavioural neurology.

[73]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[74]  Deborah J. Hellawell,et al.  Facial expression processing after amygdalotomy , 1996, Neuropsychologia.

[75]  E. Halgren,et al.  Location of human face‐selective cortex with respect to retinotopic areas , 1999, Human brain mapping.

[76]  C. Fine,et al.  The cognitive and emotional effects of amygdala damage , 2000 .

[77]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[78]  M. Cabanac What is emotion? , 2002, Behavioural Processes.

[79]  R. Adolphs,et al.  A Role for Somatosensory Cortices in the Visual Recognition of Emotion as Revealed by Three-Dimensional Lesion Mapping , 2000, The Journal of Neuroscience.

[80]  Steven C.R. Williams,et al.  Time courses of left and right amygdalar responses to fearful facial expressions , 2001, NeuroImage.

[81]  G. Fink,et al.  Neural activation during selective attention to subjective emotional responses , 1997, Neuroreport.

[82]  A. Young,et al.  Impaired recognition and experience of disgust following brain injury , 2000, Nature Neuroscience.

[83]  D. Perrett,et al.  Dissociable neural responses to facial expressions of sadness and anger. , 1999, Brain : a journal of neurology.

[84]  R. Maddock The retrosplenial cortex and emotion: new insights from functional neuroimaging of the human brain , 1999, Trends in Neurosciences.

[85]  Ralf Deichmann,et al.  Functional Heterogeneity in Human Olfactory Cortex: An Event-Related Functional Magnetic Resonance Imaging Study , 2002, The Journal of Neuroscience.

[86]  Hanna Damasio,et al.  Recognizing facial emotion , 1996, Nature.

[87]  S. Rapcsak,et al.  Anomia for Facial Expressions: Neuropsychological Mechanisms and Anatomical Correlates , 1993, Brain and Language.

[88]  Karl J. Friston,et al.  How Many Subjects Constitute a Study? , 1999, NeuroImage.

[89]  M. Hasselmo,et al.  The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey , 1989, Behavioural Brain Research.

[90]  Paul J. Eslinger,et al.  Neurological and Neuropsychological Bases of Empathy , 1998, European Neurology.

[91]  E. Rolls,et al.  Representation of pleasant and aversive taste in the human brain. , 2001, Journal of neurophysiology.

[92]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[93]  Karl J. Friston,et al.  Cognitive Conjunction: A New Approach to Brain Activation Experiments , 1997, NeuroImage.

[94]  Hanna Damasio,et al.  Impairment of social and moral behavior related to early damage in human prefrontal cortex , 1999, Nature Neuroscience.

[95]  Karl J. Friston,et al.  A neuromodulatory role for the human amygdala in processing emotional facial expressions. , 1998, Brain : a journal of neurology.

[96]  J. Richard Hanley,et al.  Face processing impairments after amygdalotomy , 1995 .

[97]  A C Roberts,et al.  The Role of the Primate Amygdala in Conditioned Reinforcement , 2001, The Journal of Neuroscience.

[98]  S. Rauch,et al.  Differential prefrontal cortex and amygdala habituation to repeatedly presented emotional stimuli , 2001, Neuroreport.

[99]  Charles L. Wilson,et al.  Single Neuron Activity in Human Hippocampus and Amygdala during Recognition of Faces and Objects , 1997, Neuron.

[100]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[101]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[102]  R. Adolphs,et al.  Cortical Systems for the Recognition of Emotion in Facial Expressions , 1996, The Journal of Neuroscience.

[103]  J. C. Anderson,et al.  Dendritic asymmetry cannot account for directional responses of neurons in visual cortex , 1999, Nature Neuroscience.

[104]  R. Adolphs,et al.  Fear and the human amygdala , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[105]  R. Dolan,et al.  Neural Activation during Covert Processing of Positive Emotional Facial Expressions , 1996, NeuroImage.

[106]  D. Perrett,et al.  A differential neural response in the human amygdala to fearful and happy facial expressions , 1996, Nature.

[107]  A. Calder Facial Emotion Recognition after Bilateral Amygdala Damage: Differentially Severe Impairment of Fear , 1996 .