Processing of masked and unmasked emotional faces under different attentional conditions: an electrophysiological investigation

In order to investigate the interactions between non-spatial selective attention, awareness and emotion processing, we carried out an ERP study using a backward masking paradigm, in which angry, fearful, happy, and neutral facial expressions were presented, while participants attempted to detect the presence of one or the other category of facial expressions in the different experimental blocks. ERP results showed that negative emotions enhanced an early N170 response over temporal-occipital leads in both masked and unmasked conditions, independently of selective attention. A later effect arising at the P2 was linked to awareness. Finally, selective attention was found to affect the N2 and N3 components over occipito-parietal leads. Our findings reveal that (i) the initial processing of facial expressions arises prior to attention and awareness; (ii) attention and awareness give rise to temporally distinct periods of activation independently of the type of emotion with only a partial degree of overlap; and (iii) selective attention appears to be influenced by the emotional nature of the stimuli, which in turn impinges on unconscious processing at a very early stage. This study confirms previous reports that negative facial expressions can be processed rapidly, in absence of visual awareness and independently of selective attention. On the other hand, attention and awareness may operate in a synergistic way, depending on task demand.

[1]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[2]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[3]  M. Milders,et al.  Attentional bias to brief threat-related faces revealed by saccadic eye movements. , 2010, Emotion.

[4]  Asaid Khateb,et al.  Early ERP Modulation for Task-Irrelevant Subliminal Faces , 2011, Front. Psychology.

[5]  W. Singer,et al.  Neuroscience and Biobehavioral Reviews Distilling the Neural Correlates of Consciousness , 2022 .

[6]  D. Lehmann,et al.  Reference-free identification of components of checkerboard-evoked multichannel potential fields. , 1980, Electroencephalography and clinical neurophysiology.

[7]  Marie-Pierre Deiber,et al.  Emotional expressions modulate low α and β oscillations in a cortically blind patient. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  Alberto Zani,et al.  Is that a belt or a snake? object attentional selection affects the early stages of visual sensory processing , 2012, Behavioral and Brain Functions.

[9]  Thomas M. Moerland,et al.  Fate of unattended fearful faces in the amygdala is determined by both attentional resources and cognitive modulation , 2005, NeuroImage.

[10]  M. Koivisto,et al.  An ERP study of change detection, change blindness, and visual awareness. , 2003, Psychophysiology.

[11]  Keith R. Lohse On Attentional Control , 2015 .

[12]  Alice Mado Proverbio,et al.  Selective Attention to Spatial Frequency Gratings Affects Visual Processing as Early as 60 MSEC. Poststimulus , 2009, Perceptual and motor skills.

[13]  Ronald A. Rensink,et al.  Competition for consciousness among visual events: the psychophysics of reentrant visual processes. , 2000, Journal of experimental psychology. General.

[14]  R. Zeelenberg,et al.  Emotion Improves and Impairs Early Vision , 2009, Psychological science.

[15]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[16]  Asaid Khateb,et al.  Electrophysiological evidence for early non-conscious processing of fearful facial expressions. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Leslie G. Ungerleider,et al.  Attentional control of the processing of neural and emotional stimuli. , 2002, Brain research. Cognitive brain research.

[18]  Amanda Holmes,et al.  An electrophysiological investigation into the automaticity of emotional face processing in high versus low trait anxious individuals , 2009, Cognitive, affective & behavioral neuroscience.

[19]  John G. Taylor,et al.  A competition for consciousness? , 1996, Neurocomputing.

[20]  R. Hari,et al.  Visual awareness of objects correlates with activity of right occipital cortex , 1996, Neuroreport.

[21]  C. Ashwin,et al.  Does emotion processing require attention? The effects of fear conditioning and perceptual load. , 2010, Emotion.

[22]  Dominique Lamy,et al.  Neural Correlates of Subjective Awareness and Unconscious Processing: An ERP Study , 2009, Journal of Cognitive Neuroscience.

[23]  Gilles Pourtois,et al.  State-dependent attention modulation of human primary visual cortex: A high density ERP study , 2012, NeuroImage.

[24]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Margot J. Taylor,et al.  Attention inhibition of early cortical activation to fearful faces , 2010, Brain Research.

[26]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[27]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[28]  Mika Koivisto,et al.  The role of selective attention in visual awareness of stimulus features: Electrophysiological studies , 2008, Cognitive, affective & behavioral neuroscience.

[29]  Michela Balconi,et al.  Consciousness and emotion: ERP modulation and attentive vs. pre-attentive elaboration of emotional facial expressions by backward masking , 2009 .

[30]  H. Okon-Singer,et al.  Distinguishing between automaticity and attention in the processing of emotionally significant stimuli. , 2007, Emotion.

[31]  Matthew Finkbeiner,et al.  Spatial and Temporal Attention Modulate the Early Stages of Face Processing: Behavioural Evidence from a Reaching Paradigm , 2013, PloS one.

[32]  Antonio Schettino,et al.  rain mechanisms for emotional influences on perception and attention : hat is magic and what is not , 2012 .

[33]  Michela Balconi,et al.  Consciousness and emotional facial expression recognition: subliminal/supraliminal stimulation effect on N200 and P300 ERPs , 2007 .

[34]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[35]  Catherine Tallon-Baudry,et al.  On the Neural Mechanisms Subserving Consciousness and Attention , 2012, Front. Psychology.

[36]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[37]  A. Keil,et al.  Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception. , 2006, Cerebral cortex.

[38]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[39]  M. Eimer,et al.  ERPs reveal subliminal processing of fearful faces. , 2008, Psychophysiology.

[40]  Markus Kiefer,et al.  Top-down modulation of unconscious 'automatic' processes: A gating framework , 2008, Advances in cognitive psychology.

[41]  E. Gordon,et al.  A Temporal Dissociation of Subliminal versus Supraliminal Fear Perception: An Event-related Potential Study , 2004, Journal of Cognitive Neuroscience.

[42]  E. Friedman,et al.  Temporal processing. , 1991, Journal of learning disabilities.

[43]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[44]  S. Hillyard,et al.  Identification of early visual evoked potential generators by retinotopic and topographic analyses , 1994 .

[45]  Wioleta Walentowska,et al.  Attention modulates emotional expression processing. , 2011, Psychophysiology.

[46]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[47]  J. Changeux,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.5 May 2006 Conscious, preconscious, and subliminal processing: a testable taxonomy , 2022 .

[48]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[49]  Effective processing of masked eye gaze requires volitional control , 2012, Experimental Brain Research.

[50]  Paul Pauli,et al.  Early cortical processing of natural and artificial emotional faces differs between lower and higher socially anxious persons , 2009, Journal of Neural Transmission.

[51]  Michael Davis,et al.  The amygdala , 2000, Current Biology.

[52]  Mika Koivisto,et al.  Event-related brain potential correlates of visual awareness , 2010, Neuroscience & Biobehavioral Reviews.

[53]  Bert Reynvoet,et al.  Mechanisms of masked priming: a meta-analysis. , 2009, Psychological bulletin.

[54]  T. Bachmann,et al.  Does the P300 reflect conscious perception or its consequences? , 2015, Neuroscience.

[55]  Leslie G. Ungerleider,et al.  Visual awareness and the detection of fearful faces. , 2005, Emotion.

[56]  Rodrigo Quian Quiroga,et al.  Perceptual and contextual awareness: methodological considerations in the search for the neural correlates of consciousness , 2014, Front. Psychol..

[57]  Zhicheng Lin,et al.  Priming of awareness or how not to measure visual awareness. , 2014, Journal of vision.

[58]  S. Dehaene,et al.  Brain Dynamics Underlying the Nonlinear Threshold for Access to Consciousness , 2007, PLoS biology.

[59]  F. Maratos Temporal processing of emotional stimuli: the capture and release of attention by angry faces. , 2011, Emotion.

[60]  Odmar Neumann,et al.  Automatic Processing: A Review of Recent Findings and a Plea for an Old Theory , 1984 .

[61]  Romina Palermo,et al.  The Role of Spatial Attention in Nonconscious Processing , 2009, Psychological science.

[62]  Henry Railo,et al.  Behavioral and electrophysiological evidence for fast emergence of visual consciousness , 2015, Neuroscience of consciousness.

[63]  P. Putman,et al.  Resting state EEG delta-beta coherence in relation to anxiety, behavioral inhibition, and selective attentional processing of threatening stimuli. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[64]  Gilles Pourtois,et al.  Positive emotion broadens attention focus through decreased position-specific spatial encoding in early visual cortex: Evidence from ERPs , 2013, Cognitive, affective & behavioral neuroscience.

[65]  Urs Maurer,et al.  The face-specific N170 component is modulated by emotional facial expression , 2007, Behavioral and Brain Functions.

[66]  Michael A. Pitts,et al.  Neural Signatures of Conscious Face Perception in an Inattentional Blindness Paradigm , 2015, The Journal of Neuroscience.

[67]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[68]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[69]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[70]  Po-Jang Hsieh,et al.  The ‘correlates’ in neural correlates of consciousness , 2012, Neuroscience & Biobehavioral Reviews.

[71]  Asaid Khateb,et al.  Electrophysiological correlates of affective blindsight , 2009, NeuroImage.

[72]  D. Lundqvist,et al.  Unconscious emotion : Evolutionary perspectives, psychophysiological data, and neuropsychological mechanisms , 2000 .

[73]  Mika Koivisto,et al.  Electrophysiological correlates of visual consciousness and selective attention , 2007, Neuroreport.

[74]  Stanislas Dehaene,et al.  Toward a computational theory of conscious processing , 2014, Current Opinion in Neurobiology.

[75]  Cortical regions involved in extraction of forms from complex figures: an fMRI study , 2001, NeuroImage.

[76]  P. McCormick Orienting attention without awareness. , 1997, Journal of experimental psychology. Human perception and performance.

[77]  Evian Gordon,et al.  A Direct Brainstem–amygdala–cortical Dalarmt System for Subliminal Signals of Fear , 2004 .

[78]  L. Pessoa,et al.  Load-dependent modulation of affective picture processing , 2005, Cognitive, affective & behavioral neuroscience.

[79]  Marzia Del Zotto,et al.  Electrical neuroimaging evidence that spatial frequency-based selective attention affects V1 activity as early as 40-60 ms in humans , 2010, BMC Neuroscience.

[80]  Mika Koivisto,et al.  The relationship between awareness and attention: Evidence from ERP responses , 2009, Neuropsychologia.

[81]  Claudio Babiloni,et al.  Visuo-spatial consciousness and parieto-occipital areas: a high-resolution EEG study. , 2006, Cerebral cortex.