Time course of affective bias in visual attention: Convergent evidence from steady-state visual evoked potentials and behavioral data

Selective attention to a primary task can be biased by the occurrence of emotional distractors that involuntary attract attention due to their intrinsic stimulus significance. What is largely unknown is the time course and magnitude of competitive interactions between a to-be-attended foreground task and emotional distractors. We used pleasant, unpleasant and neutral pictures from the International Affective Picture System (IAPS) that were either presented in intact or phase-scrambled form. Pictures were superimposed by a flickering display of moving random dots, which constituted the primary task and enabled us to record steady-state visual evoked potentials (SSVEPs) as a continuous measure of attentional resource allocation directed to the task. Subjects were required to attend to the dots and to detect short intervals of coherent motion while ignoring the background pictures. We found that pleasant and unpleasant relative to neutral pictures more strongly influenced task-related processing as reflected in a significant decrease in SSVEP amplitudes and target detection rates, both covering a time window of several hundred milliseconds. Strikingly, the effect of semantic relative to phase-scrambled pictures on task-related activity was much larger, emerged earlier and lasted longer in time compared to the specific effect of emotion. The observed differences in size and duration of time courses of semantic and emotional picture processing strengthen the assumption of separate functional mechanisms for both processes rather than a general boosting of neural activity in favor of emotional stimulus processing.

[1]  David Weinkove,et al.  Long-term starvation and ageing induce AGE-1/PI 3-kinase-dependent translocation of DAF-16/FOXO to the cytoplasm , 2006, BMC Biology.

[2]  Markus Junghöfer,et al.  Fleeting images: rapid affect discrimination in the visual cortex , 2006, Neuroreport.

[3]  L. Pessoa To what extent are emotional visual stimuli processed without attention and awareness? , 2005, Current Opinion in Neurobiology.

[4]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[5]  J. Theeuwes,et al.  Abrupt onsets capture attention independent of top-down control settings , 2008, Perception & psychophysics.

[6]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[7]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[8]  Steven A. Hillyard,et al.  Attention Facilitates Multiple Stimulus Features in Parallel in Human Visual Cortex , 2008, Current Biology.

[9]  Amanda Holmes,et al.  An electrophysiological investigation into the automaticity of emotional face processing in high versus low trait anxious individuals , 2009, Cognitive, affective & behavioral neuroscience.

[10]  Thomas M. Moerland,et al.  Fate of unattended fearful faces in the amygdala is determined by both attentional resources and cognitive modulation , 2005, NeuroImage.

[11]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[12]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[13]  Aina Puce,et al.  Category-sensitive excitatory and inhibitory processes in human extrastriate cortex. , 2002, Journal of neurophysiology.

[14]  Dan Foti,et al.  Neural response to emotional pictures is unaffected by concurrent task difficulty: an event-related potential study. , 2007, Behavioral neuroscience.

[15]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[16]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[17]  Peter J. Lang,et al.  Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance , 2005, NeuroImage.

[18]  Peter Lang,et al.  Brain processes in emotional perception: Motivated attention , 2004 .

[19]  Harald T. Schupp,et al.  Emotional Facilitation of Sensory Processing in the Visual Cortex , 2003, Psychological science.

[20]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[21]  A. Jedynak,et al.  Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli , 2003, Neuropsychologia.

[22]  A. Keil,et al.  Identification facilitation for emotionally arousing verbs during the attentional blink. , 2004, Emotion.

[23]  Peter J. Lang,et al.  Attention and Orienting : Sensory and Motivational Processes , 1997 .

[24]  A. Anderson,et al.  Neural Correlates of the Automatic Processing of Threat Facial Signals , 2022 .

[25]  Matthias M. Müller,et al.  Color-selective attention need not be mediated by spatial attention. , 2009, Journal of vision.

[26]  Andreas Keil,et al.  Early cortical facilitation for emotionally arousing targets during the attentional blink , 2006, BMC Biology.

[27]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[28]  I. Biederman Perceiving Real-World Scenes , 1972, Science.

[29]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[30]  J. Driver,et al.  Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[32]  A. Anderson,et al.  Lesions of the human amygdala impair enhanced perception of emotionally salient events , 2001, Nature.

[33]  Li Fei-Fei,et al.  Neural mechanisms of rapid natural scene categorization in human visual cortex , 2009, Nature.

[34]  P. Perona,et al.  Rapid natural scene categorization in the near absence of attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Matthias M. Müller,et al.  Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention , 2000, Clinical Neurophysiology.

[36]  Fernando Cadaveira,et al.  Attentional load affects automatic emotional processing: evidence from event-related potentials , 2006, Neuroreport.

[37]  Andreas Keil,et al.  Time course of competition for visual processing resources between emotional pictures and foreground task. , 2008, Cerebral cortex.

[38]  Martin Eimer,et al.  Attention modulates the processing of emotional expression triggered by foveal faces , 2006, Neuroscience Letters.

[39]  John G. Taylor,et al.  Influence of attentional demands on the processing of emotional facial expressions in the amygdala , 2007, NeuroImage.

[40]  L. Pessoa,et al.  Dissociable effects of bottom-up and top-down factors on the processing of unattended fearful faces , 2007, Neuropsychologia.

[41]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[42]  S A Hillyard,et al.  Feature-selective attention enhances color signals in early visual areas of the human brain , 2006, Proceedings of the National Academy of Sciences.

[43]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[44]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[45]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[46]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[47]  R VanRullen,et al.  Is it a Bird? Is it a Plane? Ultra-Rapid Visual Categorisation of Natural and Artifactual Objects , 2001, Perception.

[48]  Andrew W. Young,et al.  Differential effects of object-based attention on evoked potentials to fearful and disgusted faces , 2008, Neuropsychologia.

[49]  S. Yantis,et al.  Stimulus-driven attentional capture: evidence from equiluminant visual objects. , 1994, Journal of experimental psychology. Human perception and performance.

[50]  Rob Jenkins,et al.  Neural processing of fearful faces: effects of anxiety are gated by perceptual capacity limitations. , 2007, Cerebral cortex.

[51]  Markus Junghöfer,et al.  Explicit attention interferes with selective emotion processing in human extrastriate cortex , 2007, BMC Neuroscience.

[52]  M. Bradley,et al.  Motivated attention: Affect, activation, and action. , 1997 .

[53]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[54]  Jason B. Mattingley,et al.  Differential amygdala responses to happy and fearful facial expressions depend on selective attention , 2005, NeuroImage.

[55]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[56]  Peter J. Lang,et al.  When Good Things Go Bad , 2005, Psychological science.

[57]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[58]  Sarah Walker,et al.  Ultra-rapid categorization requires visual attention: Scenes with multiple foreground objects. , 2008, Journal of vision.

[59]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[60]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[61]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[62]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.