Implicit and Explicit Attention to Pictures and Words: An fMRI-Study of Concurrent Emotional Stimulus Processing

The present study utilized functional magnetic resonance imaging (fMRI) to examine the neural processing of concurrently presented emotional stimuli under varying explicit and implicit attention demands. Specifically, in separate trials, participants indicated the category of either pictures or words. The words were placed over the center of the pictures and the picture-word compound-stimuli were presented for 1500 ms in a rapid event-related design. The results reveal pronounced main effects of task and emotion: the picture categorization task prompted strong activations in visual, parietal, temporal, frontal, and subcortical regions; the word categorization task evoked increased activation only in left extrastriate cortex. Furthermore, beyond replicating key findings regarding emotional picture and word processing, the results point to a dissociation of semantic-affective and sensory-perceptual processes for words: while emotional words engaged semantic-affective networks of the left hemisphere regardless of task, the increased activity in left extrastriate cortex associated with explicitly attending to words was diminished when the word was overlaid over an erotic image. Finally, we observed a significant interaction between Picture Category and Task within dorsal visual-associative regions, inferior parietal, and dorsolateral, and medial prefrontal cortices: during the word categorization task, activation was increased in these regions when the words were overlaid over erotic as compared to romantic pictures. During the picture categorization task, activity in these areas was relatively decreased when categorizing erotic as compared to romantic pictures. Thus, the emotional intensity of the pictures strongly affected brain regions devoted to the control of task-related word or picture processing. These findings are discussed with respect to the interplay of obligatory stimulus processing with task-related attentional control mechanisms.

[1]  Markus Junghöfer,et al.  Neural systems of visual attention responding to emotional gestures , 2009, NeuroImage.

[2]  Amelia Johannes,et al.  PERIPHERAL VISION. , 1929, British medical journal.

[3]  Alexandru D. Iordan,et al.  Neural signatures of the response to emotional distraction: a review of evidence from brain imaging investigations , 2013, Front. Hum. Neurosci..

[4]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[5]  Gilles Pourtois,et al.  Investigating audiovisual integration of emotional signals in the human brain. , 2006, Progress in brain research.

[6]  Ludovic Ferrand,et al.  Automaticity of Word Reading , 2014 .

[7]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[8]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[9]  Wolfgang Grodd,et al.  Amygdala activation during reading of emotional adjectives--an advantage for pleasant content. , 2009, Social cognitive and affective neuroscience.

[10]  G. Fink,et al.  Dorsal and Ventral Attention Systems: Distinct Neural Circuits but Collaborative Roles , 2013 .

[11]  Bruce W. Smith,et al.  Modulation of emotion by cognition and cognition by emotion , 2007, NeuroImage.

[12]  G. Crombez,et al.  Does imminent threat capture and hold attention? , 2004, Emotion.

[13]  Evelyn C. Ferstl,et al.  Emotional valence and arousal affect reading in an interactive way: Neuroimaging evidence for an approach-withdrawal framework , 2014, Neuropsychologia.

[14]  M. Bradley,et al.  Emotional arousal and activation of the visual cortex: an fMRI analysis. , 1998, Psychophysiology.

[15]  D. Schacter,et al.  Processing emotional pictures and words: Effects of valence and arousal , 2006, Cognitive, affective & behavioral neuroscience.

[16]  G. Alpers,et al.  Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains , 2014, Front. Psychol..

[17]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[18]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[19]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[20]  Kevin N. Ochsner,et al.  The Neural Bases of Distraction and Reappraisal , 2010, Journal of Cognitive Neuroscience.

[21]  Leslie G. Ungerleider,et al.  Neuroimaging Studies of Attention: From Modulation of Sensory Processing to Top-Down Control , 2003, The Journal of Neuroscience.

[22]  Janneke F. M. Jehee,et al.  Attention Improves Encoding of Task-Relevant Features in the Human Visual Cortex , 2011, The Journal of Neuroscience.

[23]  M. Mesulam,et al.  Remapping attentional priorities: differential contribution of superior parietal lobule and intraparietal sulcus. , 2007, Cerebral cortex.

[24]  S. Heim,et al.  Identifying brain systems for gaze orienting during reading: fMRI investigation of the Landolt paradigm , 2013, Front. Hum. Neurosci..

[25]  K. Mathiak,et al.  Multisensory emotions: perception, combination and underlying neural processes , 2012, Reviews in the neurosciences.

[26]  K. Kiehl,et al.  A supramodal limbic‐paralimbic‐neocortical network supports goal‐directed stimulus processing , 2005, Human brain mapping.

[27]  W. Miltner,et al.  Brain activation to briefly presented emotional words: Effects of stimulus awareness , 2015, Human brain mapping.

[28]  M. Wessa,et al.  Goal-directed behavior under emotional distraction is preserved by enhanced task-specific activation. , 2013, Social cognitive and affective neuroscience.

[29]  Benjamin J. Tamber-Rosenau,et al.  Cortical Mechanisms of Cognitive Control for Shifting Attention in Vision and Working Memory , 2011, Journal of Cognitive Neuroscience.

[30]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[31]  Francesca M. M. Citron Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies , 2012, Brain and Language.

[32]  T. Kircher,et al.  Supramodal Representation of Emotions , 2011, The Journal of Neuroscience.

[33]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[34]  Dieter Vaitl,et al.  Neuroimaging of emotion: empirical effects of proportional global signal scaling in fMRI data analysis , 2005, NeuroImage.

[35]  B. Wandell The neurobiological basis of seeing words , 2011, Annals of the New York Academy of Sciences.

[36]  G. Mangun,et al.  ERP and fMRI measures of visual spatial selective attention , 1998, Human brain mapping.

[37]  Kimberly S. Chiew,et al.  Neural correlates of recognition memory for emotional faces and scenes. , 2011, Social cognitive and affective neuroscience.

[38]  S. Kotz,et al.  Emotion triggers executive attention: Anterior cingulate cortex and amygdala responses to emotional words in a conflict task , 2011, Human brain mapping.

[39]  Katherine L. Roberts,et al.  Examining a Supramodal Network for Conflict Processing: A Systematic Review and Novel Functional Magnetic Resonance Imaging Data for Related Visual and Auditory Stroop Tasks , 2008, Journal of Cognitive Neuroscience.

[40]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[41]  Juan Lupiáñez,et al.  Two cognitive and neural systems for endogenous and exogenous spatial attention , 2013, Behavioural Brain Research.

[42]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[43]  Juraj Kukolja,et al.  Selective processing of social stimuli in the superficial amygdala , 2009, Human brain mapping.

[44]  J. Hyönä,et al.  Emotional scene content drives the saccade generation system reflexively. , 2009, Journal of experimental psychology. Human perception and performance.

[45]  Ralf Schmälzle,et al.  Explicit semantic stimulus categorization interferes with implicit emotion processing. , 2014, Social cognitive and affective neuroscience.

[46]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[47]  Qingyang Li,et al.  Emotional perception: Meta-analyses of face and natural scene processing , 2011, NeuroImage.

[48]  P. Matthews,et al.  Semantic Processing in the Left Inferior Prefrontal Cortex: A Combined Functional Magnetic Resonance Imaging and Transcranial Magnetic Stimulation Study , 2003, Journal of Cognitive Neuroscience.

[49]  Riitta Salmelin,et al.  Neural representation of language: activation versus long-range connectivity , 2006, Trends in Cognitive Sciences.

[50]  C. Ashwin,et al.  Does emotion processing require attention? The effects of fear conditioning and perceptual load. , 2010, Emotion.

[51]  S. Hamann,et al.  Positive and negative emotional verbal stimuli elicit activity in the left amygdala , 2002, Neuroreport.

[52]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[53]  C. Rorden,et al.  Stereotaxic display of brain lesions. , 2000, Behavioural neurology.

[54]  Derek G. V. Mitchell,et al.  The impact of processing load on emotion , 2007, NeuroImage.

[55]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[56]  Sander L. Koole,et al.  Tuning down the emotional brain: An fMRI study of the effects of cognitive load on the processing of affective images , 2009, NeuroImage.

[57]  Patrik Vuilleumier,et al.  Lateralized interactive social content and valence processing within the human amygdala , 2013, Front. Hum. Neurosci..

[58]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[59]  S. Dehaene,et al.  Topographical Layout of Hand, Eye, Calculation, and Language-Related Areas in the Human Parietal Lobe , 2002, Neuron.

[60]  J. Houwer,et al.  Stop what you are not doing! Emotional pictures interfere with the task not to respond , 2010, Psychonomic bulletin & review.

[61]  Sonja A. Kotz,et al.  Emotion, Language, and the Brain , 2011, Lang. Linguistics Compass.

[62]  M. Gazzaniga,et al.  Combined spatial and temporal imaging of brain activity during visual selective attention in humans , 1994, Nature.

[63]  P. Lang,et al.  Parafoveal semantic processing of emotional visual scenes. , 2005, Journal of experimental psychology. Human perception and performance.

[64]  L. Pessoa,et al.  Dissociable effects of bottom-up and top-down factors on the processing of unattended fearful faces , 2007, Neuropsychologia.

[65]  Peter J. Lang,et al.  Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance , 2005, NeuroImage.

[66]  I. Fischler,et al.  Processing Words with Emotional Connotation: An fMRI Study of Time Course and Laterality in Rostral Frontal and Retrosplenial Cortices , 2004, Journal of Cognitive Neuroscience.

[67]  Maurizio Codispoti,et al.  Peripheral vision and preferential emotion processing , 2009, Neuroreport.

[68]  VÕ MELISSAL.-H. di-The Berlin Affective Word List Reloaded (BAWL–R) , 2022 .

[69]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[70]  Thomas Straube,et al.  Brain activation during direct and indirect processing of positive and negative words , 2011, Behavioural Brain Research.

[71]  Katherine Vytal,et al.  Neuroimaging Support for Discrete Neural Correlates of Basic Emotions: A Voxel-based Meta-analysis , 2010, Journal of Cognitive Neuroscience.

[72]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[73]  A. Jacobs,et al.  The Berlin Affective Word List Reloaded (BAWL-R) , 2009, Behavior research methods.

[74]  Karl J. Friston,et al.  Anterior insular cortex and emotional awareness , 2013, The Journal of comparative neurology.

[75]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.