Dynamics of emotional effects on spatial attention in the human visual cortex.

An efficient detection of threat is crucial for survival and requires an appropriate allocation of attentional resources toward the location of potential danger. Recent neuroimaging studies have begun to uncover the brain machinery underlying the reflexive prioritization of spatial attention to locations of threat-related stimuli. Here, we review functional brain imaging experiments using event-related potentials (ERPs) and functional magnetic resonance imaging (fMRI) in a dot-probe paradigm with emotional face cues, in which we investigated the spatio-temporal dynamics of attentional orienting to a visual target when the latter is preceded by either a fearful or happy face, at the same (valid) location or at a different (invalid) location in visual periphery. ERP results indicate that fearful faces can bias spatial attention toward threat-related location, and enhance the amplitude of the early exogenous visual P1 activity generated within the extrastriate cortex in response to a target following a valid rather than invalid fearful face. Furthermore, this gain control mechanism in extrastriate cortex (at 130-150 ms) is preceded by an earlier modulation of activity in posterior parietal regions (at 40-80 ms) that may provide a critical source of top-down signals on visual cortex. Happy faces produced no modulation of ERPs in extrastriate and parietal cortex. fMRI data also show increased responses in the occipital visual cortex for valid relative to invalid targets following fearful faces, but in addition reveal significant decreases in intraparietal cortex and increases in orbitofrontal cortex when targets are preceded by an invalid fearful face, suggesting that negative emotional stimuli may not only draw but also hold spatial attention more strongly than neutral or positive stimuli. These data confirm that threat may act as a powerful exogenous cue and trigger reflexive shifts in spatial attention toward its location, through a rapid temporal sequence of neural events in parietal and temporo-occipital areas, with dissociable neural substrates for engagement benefits in attention affecting activity in extrastriate occipital areas and increased disengagement costs affecting intraparietal cortex. These brain-imaging results reveal how emotional signals related to threat can play an important role in modulating spatial attention to afford flexible perception and action.

[1]  P. Bandettini The temporal resolution of Functional MRI , 1999 .

[2]  W. Walter,et al.  Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain , 1964, Nature.

[3]  Gereon R Fink,et al.  Cerebral correlates of alerting, orienting and reorienting of visuospatial attention: an event-related fMRI study , 2004, NeuroImage.

[4]  E. Halgren,et al.  Cognitive response profile of the human fusiform face area as determined by MEG. , 2000, Cerebral cortex.

[5]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[6]  Hanna Damasio,et al.  Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex , 2001, Nature Neuroscience.

[7]  Patrik Vuilleumier,et al.  Reciprocal links between emotion and attention , 2003 .

[8]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[9]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[10]  D. Jeffreys,et al.  Source locations of pattern-specific components of human visual evoked potentials. I. Component of striate cortical origin , 2004, Experimental Brain Research.

[11]  R. Dolan,et al.  Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study , 2002, Neuropsychologia.

[12]  Kenneth Hugdahl,et al.  Attentional shifts to emotionally charged cues: Behavioural and ERP data. , 1995 .

[13]  E. Fox,et al.  Do threatening stimuli draw or hold visual attention in subclinical anxiety? , 2001, Journal of experimental psychology. General.

[14]  E. Fox,et al.  Facial Expressions of Emotion: Are Angry Faces Detected More Efficiently? , 2000, Cognition & emotion.

[15]  Patrik Vuilleumier,et al.  Emotional facial expressions capture attention , 2001, Neurology.

[16]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[17]  J. Duncan,et al.  Prefrontal cortical function and anxiety: controlling attention to threat-related stimuli , 2004, Nature Neuroscience.

[18]  G. Crombez,et al.  Selective attention to threat in the dot probe paradigm: differentiating vigilance and difficulty to disengage. , 2004, Behaviour research and therapy.

[19]  Peter J. Lang,et al.  A Bio‐Informational Theory of Emotional Imagery , 1979 .

[20]  Christoph M. Michel,et al.  Two electrophysiological stages of spatial orienting towards fearful faces: early temporo-parietal activation preceding gain control in extrastriate visual cortex , 2005, NeuroImage.

[21]  G. Crombez,et al.  Does imminent threat capture and hold attention? , 2004, Emotion.

[22]  P. Vuilleumier,et al.  Facial expression and selective attention , 2002 .

[23]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[24]  J. Eastwood,et al.  Differential attentional guidance by unattended faces expressing positive and negative emotion , 2001, Perception & psychophysics.

[25]  M. Fenske,et al.  Modulation of focused attention by faces expressing emotion: evidence from flanker tasks. , 2003, Emotion.

[26]  Gilles Pourtois,et al.  Neural systems for orienting attention to the location of threat signals: An event-related fMRI study , 2006, NeuroImage.

[27]  Margot J. Taylor,et al.  Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. , 2000, Psychophysiology.

[28]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 1. Depth recorded potentials in the human occipital and parietal lobes , 1994, Journal of Physiology-Paris.

[29]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[30]  P. Ekman Pictures of Facial Affect , 1976 .

[31]  A. Anderson,et al.  Lesions of the human amygdala impair enhanced perception of emotionally salient events , 2001, Nature.

[32]  Christoph M. Michel,et al.  Electrical neuroimaging based on biophysical constraints , 2004, NeuroImage.

[33]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[34]  Karl J. Friston,et al.  Human Brain Function , 1997 .

[35]  C. MacLeod,et al.  Attentional bias in emotional disorders. , 1986, Journal of abnormal psychology.

[36]  George R. Mangun,et al.  Reflexive Attention Modulates Processing of Visual Stimuli in Human Extrastriate Cortex , 1998, Psychological science.

[37]  Karin Mogg,et al.  Attentional Bias to Threat: Roles of Trait Anxiety, Stressful Events, and Awareness , 1994, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[38]  Karin Mogg,et al.  Covert and overt orienting of attention to emotional faces in anxiety , 2000 .

[39]  R. Knight,et al.  Transient interference of right hemispheric function due to automatic emotional processing , 2000, Neuropsychologia.

[40]  C. H. Hansen,et al.  Finding the face in the crowd: an anger superiority effect. , 1988, Journal of personality and social psychology.

[41]  Dietrich Lehmann,et al.  Affective Judgments of Faces Modulate Early Activity (∼160 ms) within the Fusiform Gyri , 2002, NeuroImage.

[42]  S. Hillyard,et al.  Delayed Striate Cortical Activation during Spatial Attention , 2002, Neuron.

[43]  Andreas Keil,et al.  Additive effects of emotional content and spatial selective attention on electrocortical facilitation. , 2005, Cerebral cortex.

[44]  John Duncan,et al.  State Anxiety Modulation of the Amygdala Response to Unattended Threat-Related Stimuli , 2004, The Journal of Neuroscience.

[45]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[46]  M. Botvinick,et al.  The Contribution of the Anterior Cingulate Cortex to Executive Processes in Cognition , 1999, Reviews in the neurosciences.

[47]  S. Rauch,et al.  Brain habituation during repeated exposure to fearful and neutral faces: A functional MRI study , 2003, Brain Research Bulletin.

[48]  E. Fox,et al.  Allocation of visual attention and anxiety. , 1993, Cognition & emotion.

[49]  O. Bertrand,et al.  Attention modulates gamma-band oscillations differently in the human lateral occipital cortex and fusiform gyrus. , 2005, Cerebral cortex.

[50]  Victor A. F. Lamme,et al.  Source (or Part of the following Source): Type Article Title Internal State of Monkey Primary Visual Cortex (v1) Predicts Figure Ground Perception Author(s) Internal State of Monkey Primary Visual Cortex (v1) Predicts Figure–ground Perception Materials and Methods , 2022 .

[51]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[52]  Bruno Verschuere,et al.  Signals for threat modulate attentional capture and holding: Fear-conditioning and extinction during the exogenous cueing task , 2005 .

[53]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[54]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[55]  P Vuilleumier,et al.  Neural response to emotional faces with and without awareness: event-related fMRI in a parietal patient with visual extinction and spatial neglect , 2002, Neuropsychologia.

[56]  J C Woestenburg,et al.  Location selection in the visual domain. , 2000, Psychophysiology.

[57]  François Mauguière,et al.  Early Amygdala Reaction to Fear Spreading in Occipital, Temporal, and Frontal Cortex A Depth Electrode ERP Study in Human , 2004, Neuron.

[58]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[59]  D. Lehmann,et al.  Event-related potentials of the brain and cognitive processes: Approaches and applications , 1986, Neuropsychologia.

[60]  Eric R. Kandel,et al.  Individual Differences in Trait Anxiety Predict the Response of the Basolateral Amygdala to Unconsciously Processed Fearful Faces , 2004, Neuron.

[61]  D. Lehmann,et al.  Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. , 1999, Neuroreport.

[62]  S. Hillyard,et al.  Identification of early visual evoked potential generators by retinotopic and topographic analyses , 1994 .

[63]  Steven J. Luck,et al.  Multiple mechanisms of visual-spatial attention: recent evidence from human electrophysiology , 1995, Behavioural Brain Research.

[64]  M. Eysenck Anxiety: The Cognitive Perspective , 1992 .

[65]  M. Carrasco,et al.  Spatial covert attention increases contrast sensitivity across the CSF: support for signal enhancement , 2000, Vision Research.

[66]  K. Mogg,et al.  Attentional bias in anxiety and depression: the role of awareness. , 1995, The British journal of clinical psychology.

[67]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[68]  Gilles Pourtois,et al.  Emotion and attention interactions in social cognition: Brain regions involved in processing anger prosody , 2005, NeuroImage.

[69]  M. Corbetta,et al.  An Event-Related Functional Magnetic Resonance Imaging Study of Voluntary and Stimulus-Driven Orienting of Attention , 2005, The Journal of Neuroscience.

[70]  M. Corbetta,et al.  Two attentional processes in the parietal lobe. , 2002, Cerebral cortex.

[71]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[72]  A. Anderson Affective influences on the attentional dynamics supporting awareness. , 2005, Journal of experimental psychology. General.

[73]  K. Mogg,et al.  ATTENTIONAL BIASES FOR EMOTIONAL FACES , 1997 .

[74]  R. Zajonc Feeling and thinking : Preferences need no inferences , 1980 .

[75]  J. Mattingley,et al.  Look at me, I'm smiling: Visual search for threatening and nonthreatening facial expressions , 2005 .

[76]  S. Hillyard,et al.  Involvement of striate and extrastriate visual cortical areas in spatial attention , 1999, Nature Neuroscience.

[77]  P. Holland,et al.  Amygdala circuitry in attentional and representational processes , 1999, Trends in Cognitive Sciences.

[78]  K. Mogg,et al.  Selective attention to threat: A test of two cognitive models of anxiety , 2000 .

[79]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[80]  D. Amaral,et al.  Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey , 2003, Neuroscience.

[81]  E. Vogel,et al.  The visual N1 component as an index of a discrimination process. , 2000, Psychophysiology.

[82]  M. Bradley,et al.  Emotional arousal and activation of the visual cortex: an fMRI analysis. , 1998, Psychophysiology.

[83]  Michael J. Brammer,et al.  A preferential increase in the extrastriate response to signals of danger , 2003, NeuroImage.

[84]  O. John,et al.  Automatic vigilance: the attention-grabbing power of negative social information. , 1991, Journal of personality and social psychology.

[85]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[86]  K. Mogg,et al.  A cognitive-motivational analysis of anxiety. , 1998, Behaviour research and therapy.

[87]  J. Bartlett,et al.  Inversion and processing of component and spatial–relational information in faces. , 1996 .

[88]  J. C. Woestenburg,et al.  Modulation of early ERP components with peripheral precues: a trend analysis , 1997, Biological Psychology.

[89]  Nancy Kanwisher,et al.  Neural events and perceptual awareness , 2001, Cognition.

[90]  Christoph M. Michel,et al.  Spatiotemporal Dynamics of Human Cognition. , 1999, News in physiological sciences : an international journal of physiology produced jointly by the International Union of Physiological Sciences and the American Physiological Society.

[91]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[92]  R. Dolan,et al.  Amygdala Automaticity in Emotional Processing , 2003, Annals of the New York Academy of Sciences.

[93]  E. Fox Processing emotional facial expressions: The role of anxiety and awareness , 2002, Cognitive, affective & behavioral neuroscience.

[94]  Hans-Jochen Heinze,et al.  Asymmetrical Activation in the Human Brain during Processing of Fearful Faces , 2005, Current Biology.

[95]  Georg Kerkhoff,et al.  Spatial hemineglect in humans , 2001, Progress in Neurobiology.

[96]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[97]  Jan Theeuwes,et al.  Endogenous and exogenous attention shifts are mediated by the same large-scale neural network , 2004, NeuroImage.

[98]  G. Pourtois,et al.  Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging , 2007, Neuropsychologia.

[99]  D. Zald The human amygdala and the emotional evaluation of sensory stimuli , 2003, Brain Research Reviews.

[100]  Nick Medford,et al.  Time courses of left and right amygdalar responses to fearful facial expressions , 2001 .

[101]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[102]  Daniel Lundqvist,et al.  Looking for foes and friends: perceptual and emotional factors when finding a face in the crowd. , 2005, Emotion.

[103]  K. Mogg,et al.  Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness , 1999 .

[104]  S. Hillyard,et al.  Spatial Selective Attention Affects Early Extrastriate But Not Striate Components of the Visual Evoked Potential , 1996, Journal of Cognitive Neuroscience.

[105]  Patrik Vuilleumier,et al.  Beware and be aware: Capture of spatial attention by fear-related stimuli in neglect , 2001, Neuroreport.

[106]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[107]  M. Carrasco,et al.  Transient Attention Enhances Perceptual Performance and fMRI Response in Human Visual Cortex , 2005, Neuron.

[108]  J. Downar,et al.  A multimodal cortical network for the detection of changes in the sensory environment , 2000, Nature Neuroscience.

[109]  Joel R. Meyer,et al.  A large-scale distributed network for covert spatial attention: further anatomical delineation based on stringent behavioural and cognitive controls. , 1999, Brain : a journal of neurology.

[110]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[111]  David Navon,et al.  Allocation of Attention According to Informativeness in Visual Recognition , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[112]  J. Driver,et al.  Perceptual awareness and its loss in unilateral neglect and extinction , 2001, Cognition.

[113]  P Krolak-Salmon,et al.  Processing of facial emotional expression: spatio‐temporal data as assessed by scalp event‐related potentials , 2001, The European journal of neuroscience.

[114]  S J Luck,et al.  Visual event-related potentials index focused attention within bilateral stimulus arrays. II. Functional dissociation of P1 and N1 components. , 1990, Electroencephalography and clinical neurophysiology.

[115]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[116]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[117]  A. Dale,et al.  Functional Parcellation of Attentional Control Regions of the Brain , 2004, Journal of Cognitive Neuroscience.

[118]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[119]  D. Lehmann,et al.  Reference-free identification of components of checkerboard-evoked multichannel potential fields. , 1980, Electroencephalography and clinical neurophysiology.

[120]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[121]  Andrew D. Lawrence,et al.  Individual Differences in the Modulation of Fear-Related Brain Activation by Attentional Control , 2004, Journal of Cognitive Neuroscience.

[122]  Joseph E LeDoux The Emotional Brain: The Mysterious Underpinnings of Emotional Life , 1996 .

[123]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[124]  H Fischer,et al.  Affective and attentive neural networks in humans: a PET study of Pavlovian conditioning , 1995, Neuroreport.

[125]  S J Luck,et al.  Visual event-related potentials index focused attention within bilateral stimulus arrays. I. Evidence for early selection. , 1990, Electroencephalography and clinical neurophysiology.

[126]  R. Marois,et al.  Capacity limits of information processing in the brain , 2005, Trends in Cognitive Sciences.

[127]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Emotion Facilitates Perception and Potentiates the Perceptual Benefits of Attention , 2022 .

[128]  Peter J. Lang,et al.  Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance , 2005, NeuroImage.

[129]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[130]  Antigona Martínez,et al.  Source analysis of event-related cortical activity during visuo-spatial attention. , 2003, Cerebral cortex.

[131]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[132]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[133]  A. Damasio,et al.  Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity , 1988, Neurology.

[134]  K. Mogg,et al.  Some methodological issues in assessing attentional biases for threatening faces in anxiety: a replication study using a modified version of the probe detection task. , 1999, Behaviour research and therapy.

[135]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[136]  T. Dalgleish,et al.  The emotional Stroop task and psychopathology. , 1996, Psychological bulletin.

[137]  Yaffa Yeshurun,et al.  Covert attention increases spatial resolution with or without masks: support for signal enhancement. , 2002, Journal of vision.

[138]  Karl J. Friston,et al.  A neuromodulatory role for the human amygdala in processing emotional facial expressions. , 1998, Brain : a journal of neurology.

[139]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[140]  R. Lane,et al.  Neural Correlates of Levels of Emotional Awareness: Evidence of an Interaction between Emotion and Attention in the Anterior Cingulate Cortex , 1998, Journal of Cognitive Neuroscience.