Macroscopic brain dynamics during verbal and pictorial processing of affective stimuli.

Emotions can be viewed as action dispositions, preparing an individual to act efficiently and successfully in situations of behavioral relevance. To initiate optimized behavior, it is essential to accurately process the perceptual elements indicative of emotional relevance. The present chapter discusses effects of affective content on neural and behavioral parameters of perception, across different information channels. Electrocortical data are presented from studies examining affective perception with pictures and words in different task contexts. As a main result, these data suggest that sensory facilitation has an important role in affective processing. Affective pictures appear to facilitate perception as a function of emotional arousal at multiple levels of visual analysis. If the discrimination between affectively arousing vs. nonarousing content relies on fine-grained differences, amplification of the cortical representation may occur as early as 60-90 ms after stimulus onset. Affectively arousing information as conveyed via visual verbal channels was not subject to such very early enhancement. However, electrocortical indices of lexical access and/or activation of semantic networks showed that affectively arousing content may enhance the formation of semantic representations during word encoding. It can be concluded that affective arousal is associated with activation of widespread networks, which act to optimize sensory processing. On the basis of prioritized sensory analysis for affectively relevant stimuli, subsequent steps such as working memory, motor preparation, and action may be adjusted to meet the adaptive requirements of the situation perceived.

[1]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[2]  I. Blanchette,et al.  Independent manipulation of emotion in an emotional stroop task using classical conditioning. , 2004, Emotion.

[3]  Harold Pashler,et al.  Attention and the Processing of Emotional Words and Names , 2004, Psychological science.

[4]  M. Junghöfer,et al.  Attention and emotion: an ERP analysis of facilitated emotional stimulus processing , 2003, Neuroreport.

[5]  S. Kitayama,et al.  Interaction between affect and cognition in word perception. , 1990, Journal of personality and social psychology.

[6]  L. Collet,et al.  Hemispheric lateralization of emotions: Absence of electrophysiological arguments , 1987, Physiology & Behavior.

[7]  S. Hillyard,et al.  Selective attention to stimulus location modulates the steady-state visual evoked potential. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[8]  P. Ekman,et al.  The nature of emotion: Fundamental questions. , 1994 .

[9]  M. Bradley,et al.  Emotion, Motivation, and Anxiety: Brain Mechanisms and Psychophysiology the Motivational Organization of Emotion Patterns of Human Emotion Emotion and Perception the Psychophysiology of Picture Processing Neural Imaging: Motivation in the Visual Cortex Motivational Circuits in the Brain , 2022 .

[10]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[11]  Peter J. Lang,et al.  Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance , 2005, NeuroImage.

[12]  R. Knight,et al.  Transient interference of right hemispheric function due to automatic emotional processing , 2000, Neuropsychologia.

[13]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[14]  A. Angrilli,et al.  Emotional Information Processing and Visual Evoked Brain Potentials , 1996, Perceptual and motor skills.

[15]  O. Bertrand,et al.  Time-frequency digital filtering based on an invertible wavelet transform: an application to evoked potentials , 1994, IEEE Transactions on Biomedical Engineering.

[16]  Andreas Keil,et al.  Additive effects of emotional content and spatial selective attention on electrocortical facilitation. , 2005, Cerebral cortex.

[17]  A Gevins,et al.  Electroencephalographic imaging of higher brain function. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  A. Keil,et al.  Effects of classical conditioning on identification and cortical processing of speech syllables , 2006, Experimental Brain Research.

[19]  H. Pashler,et al.  Moray Revisited: High-Priority Affective Stimuli and Visual Search , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[20]  Jeanette Altarriba,et al.  The distinctiveness of emotion concepts: a comparison between emotion, abstract, and concrete words. , 2004, The American journal of psychology.

[21]  Peter J. Lang,et al.  The motivational organization of emotion: Affect-reflex connections. , 1994 .

[22]  M. Bradley,et al.  Activation of the visual cortex in motivated attention. , 2003, Behavioral neuroscience.

[23]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[24]  M. Castillo,et al.  Foveal vs. parafoveal attention-grabbing power of threat-related information. , 2005, Experimental psychology.

[25]  K. Shapiro,et al.  Personal names and the attentional blink: a visual "cocktail party" effect. , 1997, Journal of experimental psychology. Human perception and performance.

[26]  A. Castañeda Reaction time and response amplitude as a function of anxiety and stimulus intensity. , 1956, Journal of abnormal psychology.

[27]  Richard J Davidson,et al.  Spatio-temporal dynamics of brain mechanisms in aversive classical conditioning: high-density event-related potential and brain electrical tomography analyses , 2003, Neuropsychologia.

[28]  Pradeep J Nathan,et al.  Augmentation of serotonin enhances pleasant and suppresses unpleasant cortical electrophysiological responses to visual emotional stimuli in humans , 2004, NeuroImage.

[29]  A. Keil The Role of Human Prefrontal Cortex in Motivated Perception and Behavior: A Macroscopic Perspective , 2004 .

[30]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[31]  Matthias M. Müller,et al.  Early modulation of visual perception by emotional arousal: Evidence from steady-state visual evoked brain potentials , 2003, Cognitive, affective & behavioral neuroscience.

[32]  B. Bergum,et al.  Response Latency as a Function of Stimulus Affect and Presentation Order , 1966, Perceptual and motor skills.

[33]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[34]  R. Silberstein,et al.  Steady-state visually evoked potential topography during the Wisconsin card sorting test. , 1995, Electroencephalography and clinical neurophysiology.

[35]  Matthias M. Müller,et al.  Magnetoencephalographic recording of steadystate visual evoked cortical activity , 2005, Brain Topography.

[36]  Roland Neumann,et al.  Approach and avoidance: the influence of proprioceptive and exteroceptive cues on encoding of affective information. , 2000 .

[37]  M. Bradley,et al.  Motivated attention: Affect, activation, and action. , 1997 .

[38]  J. Hietanen,et al.  Affect and face perception: odors modulate the recognition advantage of happy faces. , 2003, Emotion.

[39]  Marvin M. Chun,et al.  Attentional rubbernecking: Cognitive control and personality in emotion-induced blindness , 2005, Psychonomic bulletin & review.

[40]  S. Luck,et al.  The role of attention in feature detection and conjunction discrimination: an electrophysiological analysis. , 1995, The International journal of neuroscience.

[41]  A. Keil,et al.  Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception. , 2006, Cerebral cortex.

[42]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[43]  A. Engel,et al.  Event-related potential correlates of the attentional blink phenomenon. , 2003, Brain research. Cognitive brain research.

[44]  F Pulvermüller,et al.  Hebb's concept of cell assemblies and the psychophysiology of word processing. , 1996, Psychophysiology.

[45]  Andreas Keil,et al.  Functional correlates of macroscopic high-frequency brain activity in the human visual system , 2001, Neuroscience & Biobehavioral Reviews.

[46]  L. Kamin Relations between discrimination, apparatus stress, and the Taylor scale. , 1955, Journal of abnormal psychology.

[47]  K. Mogg,et al.  Selective processing of threat cues in anxiety states: a replication. , 1989, Behaviour research and therapy.

[48]  A. Anderson Affective influences on the attentional dynamics supporting awareness. , 2005, Journal of experimental psychology. General.

[49]  Matthias M. Müller,et al.  Processing of affective pictures modulates right-hemispheric gamma band EEG activity , 1999, Clinical Neurophysiology.

[50]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[51]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[52]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[53]  Jeff T. Larsen,et al.  May I have your attention, please: Electrocortical responses to positive and negative stimuli , 2003, Neuropsychologia.

[54]  D. Tucker Lateral brain function in normal and disordered emotion: Interpreting electroencephalographic evidence , 1984, Biological Psychology.

[55]  J. Hietanen,et al.  Positive facial expressions are recognized faster than negative facial expressions, but why? , 2004, Psychological research.

[56]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[57]  A. Anderson,et al.  Lesions of the human amygdala impair enhanced perception of emotionally salient events , 2001, Nature.

[58]  Matthias M. Müller,et al.  Effects of emotional arousal in the cerebral hemispheres: a study of oscillatory brain activity and event-related potentials , 2001, Clinical Neurophysiology.

[59]  Peter J. Lang,et al.  A Bio‐Informational Theory of Emotional Imagery , 1979 .

[60]  Satoru Otani,et al.  Prefrontal Cortex: From Synaptic Plasticity to Cognition , 2004, Springer US.

[61]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[62]  R. B. Silberstein,et al.  Steady-State Visually Evoked Potential Topography during Processing of Emotional Valence in Healthy Subjects , 2002, NeuroImage.

[63]  A. Angrilli,et al.  Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[64]  Andreas Keil,et al.  Fear but not awareness predicts enhanced sensory processing in fear conditioning. , 2006, Psychophysiology.

[65]  Hemispheric differences in the perception of positive and negative faces. , 1985, The International journal of neuroscience.

[66]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[67]  Matthias M. Müller,et al.  Human Gamma Band Activity and Perception of a Gestalt , 1999, The Journal of Neuroscience.

[68]  E Pessa,et al.  Hemispheric activity of 40 Hz EEG during recall of emotional events: differences between low and high hypnotizables. , 1987, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[69]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[70]  Peter J. Lang,et al.  Attention and Orienting : Sensory and Motivational Processes , 1997 .

[71]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[72]  M C Potter,et al.  Two attentional deficits in serial target search: the visual attentional blink and an amodal task-switch deficit. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[73]  F. Pulvermüller,et al.  Neuromagnetic evidence for early access to cognitive representations , 2001, Neuroreport.

[74]  F P McKenna,et al.  Colour naming of phobia-related words. , 1986, British journal of psychology.

[75]  K. Mogg,et al.  Selective processing of negative information: effects of clinical anxiety, concurrent depression, and awareness. , 1995, Journal of abnormal psychology.

[76]  L. Aftanas,et al.  Analysis of Evoked EEG Synchronization and Desynchronization in Conditions of Emotional Activation in Humans: Temporal and Topographic Characteristics , 2004, Neuroscience and Behavioral Physiology.

[77]  A. Keil,et al.  Identification facilitation for emotionally arousing verbs during the attentional blink. , 2004, Emotion.

[78]  D. Derryberry,et al.  Attentional interference effects of emotional pictures: threat, negativity, or arousal? , 2005, Emotion.

[79]  F. Ramus Outstanding questions about phonological processing in dyslexia. , 2001, Dyslexia.

[80]  S. Hillyard,et al.  Involvement of striate and extrastriate visual cortical areas in spatial attention , 1999, Nature Neuroscience.

[81]  A. Young,et al.  Priming of Emotion Recognition , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[82]  A. Flykt,et al.  Emotion drives attention: detecting the snake in the grass. , 2001 .

[83]  Harald T. Schupp,et al.  Emotional Facilitation of Sensory Processing in the Visual Cortex , 2003, Psychological science.

[84]  Joseph A. Sergeant,et al.  Emotions : Essays on Emotion Theory , 1994 .

[85]  E. Vogel,et al.  Word meanings can be accessed but not reported during the attentional blink , 1996, Nature.

[86]  A. Keil,et al.  Modulation of Induced Gamma Band Responses in a Perceptual Learning Task in the Human EEG , 2002, Journal of Cognitive Neuroscience.

[87]  C. H. Hansen,et al.  Finding the face in the crowd: an anger superiority effect. , 1988, Journal of personality and social psychology.

[88]  Andreas Keil,et al.  Motivated attention in emotional picture processing is reflected by activity modulation in cortical attention networks , 2004, NeuroImage.

[89]  R. Hare,et al.  Abnormal processing of affective words by psychopaths. , 1991, Psychophysiology.

[90]  M. D. Anes,et al.  Investigating hemispheric specialization in a novel face–word stroop task , 2004, Brain and Language.

[91]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[92]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[93]  Marvin M. Megibow,et al.  Hemispheric Equality in Reaction Times to Emotional and Non-Emotional Nouns , 1979, Perceptual and motor skills.

[94]  Matthias M. Müller,et al.  Effects of spatial selective attention on the steady-state visual evoked potential in the 20-28 Hz range. , 1998, Brain research. Cognitive brain research.

[95]  M. Bradley,et al.  Looking at facial expressions: Dysphoria and facial EMG , 2002, Biological Psychology.

[96]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[97]  Andreas Keil,et al.  Cortical activation during Pavlovian fear conditioning depends on heart rate response patterns: an MEG study. , 2005, Brain research. Cognitive brain research.

[98]  H. Nordby,et al.  Event-related potential (ERP) asymmetries to emotional stimuli in a visual half-field paradigm. , 1997, Psychophysiology.

[99]  E. Vogel,et al.  Electrophysiological Evidence for a Postperceptual Locus of Suppression during the Attentional Blink Time-based Attention and the Attentional Blink , 1998 .

[100]  Andreas Keil,et al.  Mapping the brain's orchestration during speech comprehension: task-specific facilitation of regional synchrony in neural networks , 2004, BMC Neuroscience.