Attentional bias to affective faces and complex IAPS images in early visual cortex follows emotional cue extraction

Emotionally arousing stimuli are known to rapidly draw the brain's processing resources, even when they are task-irrelevant. The steady-state visual evoked potential (SSVEP) response, a neural response to a flickering stimulus which effectively allows measurement of the processing resources devoted to that stimulus, has been used to examine this process of attentional shifting. Previous studies have used a task in which participants detected periods of coherent motion in flickering random dot kinematograms (RDKs) which generate an SSVEP, and found that task-irrelevant emotional stimuli withdraw more attentional resources from the task-relevant RDKs than task-irrelevant neutral stimuli. However, it is not clear whether the emotion-related differences in the SSVEP response are conditional on higher-level extraction of emotional cues as indexed by well-known event-related potential (ERPs) components (N170, early posterior negativity, EPN), or if affective bias in competition for visual attention resources is a consequence of a time-invariant shifting process. In the present study, we used two different types of emotional distractors - IAPS pictures and facial expressions - for which emotional cue extraction occurs at different speeds, being typically earlier for faces (at ~170ms, as indexed by the N170) than for IAPS images (~220-280ms, EPN). We found that emotional modulation of attentional resources as measured by the SSVEP occurred earlier for faces (around 180ms) than for IAPS pictures (around 550ms), after the extraction of emotional cues as indexed by visual ERP components. This is consistent with emotion related re-allocation of attentional resources occurring after emotional cue extraction rather than being linked to a time-fixed shifting process.

[1]  K. Scherer,et al.  The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance , 2011, Behavior research methods.

[2]  P. Lang,et al.  Re‐entrant projections modulate visual cortex in affective perception: Evidence from Granger causality analysis , 2009, Human brain mapping.

[3]  Markus Junghöfer,et al.  The selective processing of emotional visual stimuli while detecting auditory targets: An ERP analysis , 2008, Brain Research.

[4]  J Jonides,et al.  Attentional capture by abrupt onsets: new perceptual objects or visual masking? , 1996, Journal of experimental psychology. Human perception and performance.

[5]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[6]  Andreas Keil,et al.  Time course of competition for visual processing resources between emotional pictures and foreground task. , 2008, Cerebral cortex.

[7]  Martin Eimer,et al.  Attention modulates the processing of emotional expression triggered by foveal faces , 2006, Neuroscience Letters.

[8]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[9]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[10]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[11]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[12]  P. Lang,et al.  Emotion, motivation, and the brain: reflex foundations in animal and human research. , 2006, Progress in brain research.

[13]  Greg Hajcak,et al.  Electrocortical reactivity to emotional images and faces in middle childhood to early adolescence , 2012, Developmental Cognitive Neuroscience.

[14]  Wolfram Boucsein,et al.  Modification of N170 by different emotional expression of schematic faces , 2007, Biological Psychology.

[15]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[16]  D. Spinelli,et al.  Spatiotemporal analysis of the cortical sources of the steady‐state visual evoked potential , 2007, Human brain mapping.

[17]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.

[18]  M. Eimer,et al.  The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. , 2005, Brain research. Cognitive brain research.

[19]  A. Anderson,et al.  Neural Correlates of the Automatic Processing of Threat Facial Signals , 2022 .

[20]  Matthias M Müller,et al.  Attentional Bias to Briefly Presented Emotional Distractors Follows a Slow Time Course in Visual Cortex , 2011, The Journal of Neuroscience.

[21]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[22]  Leslie G. Ungerleider,et al.  The neural basis of biased competition in human visual cortex , 2001, Neuropsychologia.

[23]  M. Junghöfer,et al.  Emotion and attention: event-related brain potential studies. , 2006, Progress in brain research.

[24]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[25]  Tobias Brosch,et al.  Beyond Fear , 2008, Psychological science.

[26]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[27]  Matthias M. Müller,et al.  Slow biasing of processing resources in early visual cortex is preceded by emotional cue extraction in emotion–attention competition , 2014, Human brain mapping.

[28]  Haline E. Schendan,et al.  Object-sensitive activity reflects earlier perceptual and later cognitive processing of visual objects between 95 and 500ms , 2010, Brain Research.

[29]  J. Theeuwes,et al.  Abrupt onsets capture attention independent of top-down control settings II: Additivity is no evidence for filtering , 2010, Attention, perception & psychophysics.

[30]  Chao-Cheng Chen,et al.  Neurophysiological mechanisms in the emotional modulation of attention: The interplay between threat sensitivity and attentional control , 2007, Biological Psychology.

[31]  Christoph M. Michel,et al.  Two electrophysiological stages of spatial orienting towards fearful faces: early temporo-parietal activation preceding gain control in extrastriate visual cortex , 2005, NeuroImage.

[32]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[33]  S. Hillyard,et al.  Selective attention to stimulus location modulates the steady-state visual evoked potential. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[34]  B. Rockstroh,et al.  Statistical control of artifacts in dense array EEG/MEG studies. , 2000, Psychophysiology.

[35]  Jennifer C. Britton,et al.  Facial expressions and complex IAPS pictures: Common and differential networks , 2006, NeuroImage.

[36]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[37]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[38]  B. Rossion,et al.  ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception , 2011, Vision Research.

[39]  M. Junghöfer,et al.  Attention and emotion: an ERP analysis of facilitated emotional stimulus processing , 2003, Neuroreport.

[40]  Matthias M. Müller,et al.  Effects of spatial selective attention on the steady-state visual evoked potential in the 20-28 Hz range. , 1998, Brain research. Cognitive brain research.

[41]  Anna Weinberg,et al.  Beyond good and evil: the time-course of neural activity elicited by specific picture content. , 2010, Emotion.

[42]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[43]  G. Rousselet,et al.  Parametric study of EEG sensitivity to phase noise during face processing , 2008, BMC Neuroscience.

[44]  W. Sommer,et al.  Emotion Effects on the N170: A Question of Reference? , 2012, Brain Topography.

[45]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[46]  Sébastien M. Crouzet,et al.  Fast saccades toward faces: face detection in just 100 ms. , 2010, Journal of vision.

[47]  Naotsugu Tsuchiya,et al.  Intact rapid detection of fearful faces in the absence of the amygdala , 2009, Nature Neuroscience.

[48]  D. Grandjean,et al.  Enhanced extrastriate visual response to bandpass spatial frequency filtered fearful faces: Time course and topographic evoked‐potentials mapping , 2005, Human brain mapping.

[49]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[50]  S A Hillyard,et al.  Feature-selective attention enhances color signals in early visual areas of the human brain , 2006, Proceedings of the National Academy of Sciences.

[51]  R. Desimone.  Visual attention mediated by biased competition in extrastriate visual cortex. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[52]  Søren K. Andersen,et al.  Time course of affective bias in visual attention: Convergent evidence from steady-state visual evoked potentials and behavioral data , 2010, NeuroImage.

[53]  Christine L Larson,et al.  Stability of emotion-modulated startle during short and long picture presentation. , 2005, Psychophysiology.

[54]  S. Andersen,et al.  Behavioral performance follows the time course of neural facilitation and suppression during cued shifts of feature-selective attention , 2010, Proceedings of the National Academy of Sciences.

[55]  Antonio Schettino,et al.  rain mechanisms for emotional influences on perception and attention : hat is magic and what is not , 2012 .

[56]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[57]  James W. Tanaka,et al.  The SHINE toolbox for controlling low-level image properties , 2010 .

[58]  D. Regan.  Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[59]  S. Wiens,et al.  Directed attention reduces processing of emotional distracters irrespective of valence and arousal level , 2013, Biological Psychology.

[60]  Noga Cohen,et al.  Dynamic modulation of emotional processing , 2013, Biological Psychology.

[61]  Greg O. Horne,et al.  Controlling low-level image properties: The SHINE toolbox , 2010, Behavior research methods.

[62]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[63]  Dennis Gabor,et al.  Theory of communication , 1946 .

[64]  J. Theeuwes,et al.  Abrupt onsets capture attention independent of top-down control settings , 2008, Perception & psychophysics.

[65]  Natalie C. Ebner,et al.  FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation , 2010, Behavior research methods.

[66]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[67]  R. Bakeman.  Recommended effect size statistics for repeated measures designs , 2005, Behavior research methods.

[68]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[69]  J. Algina,et al.  Generalized eta and omega squared statistics: measures of effect size for some common research designs. , 2003, Psychological methods.

[70]  M. Bradley,et al.  Activation of the visual cortex in motivated attention. , 2003, Behavioral neuroscience.

[71]  Carsten Nicolas Boehler,et al.  Mandatory Processing of Irrelevant Fearful Face Features in Visual Search , 2010, Journal of Cognitive Neuroscience.

[72]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[73]  Werner Sommer,et al.  Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials , 2012, Biological Psychology.

[74]  Thom Baguley,et al.  Calculating and graphing within-subject confidence intervals for ANOVA , 2012, Behavior research methods.

[75]  Urs Maurer,et al.  The face-specific N170 component is modulated by emotional facial expression , 2007, Behavioral and Brain Functions.

[76]  Thom Baguley,et al.  Serious stats: a guide to advanced statistics for the behavioral sciences , 2012 .

[77]  Andreas Keil,et al.  Additive effects of emotional content and spatial selective attention on electrocortical facilitation. , 2005, Cerebral cortex.

[78]  M. Milders,et al.  Attentional bias to brief threat-related faces revealed by saccadic eye movements. , 2010, Emotion.

[79]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[80]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[81]  L. Deouell,et al.  STRUCTURAL ENCODING AND IDENTIFICATION IN FACE PROCESSING: ERP EVIDENCE FOR SEPARATE MECHANISMS , 2000, Cognitive neuropsychology.

[82]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.