Emotional and semantic networks in visual word processing: insights from ERP studies.

The event-related brain potential (ERP) literature concerning the impact of emotional content on visual word processing is reviewed and related to general knowledge on semantics in word processing: emotional connotation can enhance cortical responses at all stages of visual word processing following the assembly of visual word form (up to 200 ms), such as semantic access (around 200 ms), allocation of attentional resources (around 300 ms), contextual analysis (around 400 ms), and sustained processing and memory encoding (around 500 ms). Even earlier effects have occasionally been reported with subliminal or perceptual threshold presentation, particularly in clinical populations. Here, the underlying mechanisms are likely to diverge from the ones operational in standard natural reading. The variability in timing of the effects can be accounted for by dynamically changing lexical representations that can be activated as required by the subjects' motivational state, the task at hand, and additional contextual factors. Throughout, subcortical structures such as the amygdala are likely to contribute these enhancements. Further research will establish whether or when emotional arousal, valence, or additional emotional properties drive the observed effects and how experimental factors interact with these. Meticulous control of other word properties known to affect ERPs in visual word processing, such as word class, length, frequency, and concreteness and the use of more standardized EEG procedures is vital. Mapping the interplay between cortical and subcortical mechanisms that give rise to amplified cortical responses to emotional words will be of highest priority for future research.

[1]  E R John,et al.  Information Delivery and the Sensory Evoked Potential , 1967, Science.

[2]  M Martín-Loeches,et al.  An early electrophysiological sign of semantic processing in basal extrastriate areas. , 2001, Psychophysiology.

[3]  Friedemann Pulvermüller,et al.  Early influences of word length and frequency: a group study using MEG , 2003, Neuroreport.

[4]  B. Rockstroh,et al.  Neuromagnetic brain responses to words from semantic sub- and supercategories , 2005, BMC Neuroscience.

[5]  Michael Davis,et al.  The role of the amygdala in fear and anxiety. , 1992, Annual review of neuroscience.

[6]  M I Posner,et al.  Neuroanatomy, circuitry and plasticity of word reading. , 1999, Neuroreport.

[7]  M. Sigman,et al.  The neural code for written words: a proposal , 2005, Trends in Cognitive Sciences.

[8]  S Dehaene,et al.  Electrophysiological evidence for category-specific word processing in the normal human brain. , 1995, Neuroreport.

[9]  H. Flor,et al.  Processing of pain- and body-related verbal material in chronic pain patients: central and peripheral correlates , 1997, Pain.

[10]  A. Friederici,et al.  Temporal structure of syntactic parsing: early and late event-related brain potential effects. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[11]  J. Cacioppo,et al.  Electrophysiological Evidence of Implicit and Explicit Categorization Processes , 2000 .

[12]  Colin M. Brown,et al.  ERP effects of listening to speech compared to reading: the P600/SPS to syntactic violations in spoken sentences and rapid serial visual presentation , 2000, Neuropsychologia.

[13]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[14]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[15]  J. Gore,et al.  Activation of the left amygdala to a cognitive representation of fear , 2001, Nature Neuroscience.

[16]  D. Molfese,et al.  Electrophysiological correlates of semantic features , 1985, Journal of psycholinguistic research.

[17]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[18]  K. Bäuml,et al.  Effects of the beholder's age on the perception of facial attractiveness. , 2000, Acta psychologica.

[19]  C Braun,et al.  Cerebral processing of words and the development of chronic pain. , 1997, Psychophysiology.

[20]  Marta Kutas,et al.  Neural plasticity in the dynamics of human visual word recognition , 1998, Neuroscience Letters.

[21]  Paul Pauli,et al.  Electrocortical evidence for an early abnormal processing of panic-related words in panic disorder patients. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  F. Pulvermüller,et al.  Neuromagnetic evidence for early access to cognitive representations , 2001, Neuroreport.

[23]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[24]  Henrique Sequeira,et al.  Autonomic responding to aversive words without conscious valence discrimination. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[26]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[27]  Leslie G. Ungerleider,et al.  Neural correlates of category-specific knowledge , 1996, Nature.

[28]  Kara D. Federmeier,et al.  Effects of transient, mild mood states on semantic memory organization and use: an event-related potential investigation in humans , 2001, Neuroscience Letters.

[29]  J. Haxby,et al.  Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects , 1999, Nature Neuroscience.

[30]  Christoph M. Michel,et al.  Electrical neuroimaging reveals early generator modulation to emotional words , 2004, NeuroImage.

[31]  Mahzarin R. Banaji,et al.  Perspectivism in Social Psychology: The Yin and Yang of Scientific Progress , 2004 .

[32]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. I. Depth-recorded potentials in the human occipital, temporal and parietal lobes [corrected]. , 1994, Journal of physiology, Paris.

[33]  Charles A. Perfetti,et al.  Comprehending written language: a blueprint of the reader , 2000 .

[34]  E. Gordon,et al.  A Temporal Dissociation of Subliminal versus Supraliminal Fear Perception: An Event-related Potential Study , 2004, Journal of Cognitive Neuroscience.

[35]  E. Bernat,et al.  Event-related brain potentials differentiate positive and negative mood adjectives during both supraliminal and subliminal visual processing. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Kara D. Federmeier,et al.  Brain responses to nouns, verbs and class-ambiguous words in context. , 2000, Brain : a journal of neurology.

[37]  C. Perfetti,et al.  Reading optimally builds on spoken language: implications for deaf readers. , 2000, Journal of deaf studies and deaf education.

[38]  J. T. Marsh,et al.  Judgments of emotion in words and faces: ERP correlates. , 1987, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[39]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[40]  E. Donchin,et al.  Parsing the late positive complex: mental chronometry and the ERP components that inhabit the neighborhood of the P300. , 2004, Psychophysiology.

[41]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[42]  F. Pulvermüller,et al.  Neurophysiological distinction of verb categories , 2000, Neuroreport.

[43]  W. Skrandies,et al.  Dimensions of affective semantic meaning — behavioral and evoked potential correlates in Chinese subjects , 2003, Neuroscience Letters.

[44]  J. Cacioppo Asymmetries in affect-laden information processing. , 2004 .

[45]  A. Anderson,et al.  Lesions of the human amygdala impair enhanced perception of emotionally salient events , 2001, Nature.

[46]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 1. Depth recorded potentials in the human occipital and parietal lobes , 1994, Journal of Physiology-Paris.

[47]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[48]  S. Sereno,et al.  Context Effects in Word Recognition , 2003, Psychological science.

[49]  J. Pernier,et al.  ERP Manifestations of Processing Printed Words at Different Psycholinguistic Levels: Time Course and Scalp Distribution , 1999, Journal of Cognitive Neuroscience.

[50]  M. Kutas,et al.  Neurophysiological evidence for visual perceptual categorization of words and faces within 150 ms. , 1998, Psychophysiology.

[51]  A. A. Wijers,et al.  Neural Differentiation of Lexico-Syntactic Categories or Semantic Features? Event-Related Potential Evidence for Both , 2002, Journal of Cognitive Neuroscience.

[52]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[53]  T Shallice,et al.  Word-form dyslexia. , 1980, Brain : a journal of neurology.

[54]  Richard L. Abrams,et al.  Three Cognitive Markers of Unconscious Semantic Activation , 1996, Science.

[55]  Henri Begleiter,et al.  Evoked Brain Potentials and Behavior , 1979, The Downstate Series of Research in Psychiatry and Psychology.

[56]  G. Bower Mood and memory. , 1981, The American psychologist.

[57]  S. Hamann,et al.  Positive and negative emotional verbal stimuli elicit activity in the left amygdala , 2002, Neuroreport.

[58]  T Shallice,et al.  Semantic access dyslexia. , 1979, Brain : a journal of neurology.

[59]  Eugene Galanter,et al.  Handbook of mathematical psychology: I. , 1963 .

[60]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[61]  R. Salmelin,et al.  Dynamics of letter string perception in the human occipitotemporal cortex. , 1999, Brain : a journal of neurology.

[62]  R. Hare,et al.  Abnormal processing of affective words by psychopaths. , 1991, Psychophysiology.

[63]  R. Chapman Connotative Meaning and Averaged Evoked Potentials , 1979 .

[64]  Hans-Jochen Heinze,et al.  Brain potentials and syntactic violations revisited: no evidence for specificity of the syntactic positive shift , 1998, Neuropsychologia.

[65]  R D Hare,et al.  Semantic and affective processing in psychopaths: an event-related potential (ERP) study. , 1999, Psychophysiology.

[66]  José A. Hinojosa,et al.  Event-Related Potentials and Semantics: An Overview and an Integrative Proposal , 2001, Brain and Language.

[67]  J. Kounios,et al.  Dual-coding, context-availability, and concreteness effects in sentence comprehension: an electrophysiological investigation. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[68]  Miguel A. Pozo,et al.  Electrophysiological evidence of automatic early semantic processing , 2004, Brain and Language.

[69]  Thomas J. Ross,et al.  Amygdala response to both positively and negatively valenced stimuli , 2001, Neuroreport.

[70]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[71]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  J. M. Kittross The measurement of meaning , 1959 .

[73]  Colin M. Brown,et al.  The neurocognition of language , 2000 .

[74]  R. Dolan,et al.  A subcortical pathway to the right amygdala mediating "unseen" fear. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[75]  Joseph A. Sergeant,et al.  Emotions : Essays on Emotion Theory , 1994 .

[76]  S. Dehaene,et al.  A direct intracranial record of emotions evoked by subliminal words. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[77]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[78]  Joseph E LeDoux Cognitive-Emotional Interactions in the Brain , 1989 .

[79]  Robert M. Chapman,et al.  Brain responses related to semantic meaning , 1978, Brain and Language.

[80]  H. Begleiter,et al.  Visual Evoked Potentials and Affective Ratings of Semantic Stimuli , 1979 .

[81]  S. Dehaene,et al.  The visual word form area: a prelexical representation of visual words in the fusiform gyrus , 2002, Neuroreport.

[82]  Friedemann Pulvermüller,et al.  Neuromagnetic evidence for early semantic access in word recognition , 2001, The European journal of neuroscience.

[83]  A. Weinstein Visual ERPs evidence for enhanced processing of threatening information in anxious university students , 1995, Biological Psychiatry.

[84]  M. Kiefer,et al.  Time course of conscious and unconscious semantic brain activation , 2000, Neuroreport.

[85]  Joseph E LeDoux Emotion: clues from the brain. , 1995, Annual review of psychology.

[86]  E. Stern,et al.  Linguistic threat activates the human amygdala. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[87]  W Skrandies,et al.  Evoked potential correlates of semantic meaning--A brain mapping study. , 1998, Brain research. Cognitive brain research.

[88]  A. N. Gusev,et al.  Categorization of unilaterally presented emotional words: an ERP analysis. , 2000, Acta neurobiologiae experimentalis.

[89]  Murray S. Miron,et al.  Cross-Cultural Universals of Affective Meaning , 1975 .

[90]  A. Rudell Rapid stream stimulation and the recognition potential. , 1992, Electroencephalography and clinical neurophysiology.

[91]  John W McCrary,et al.  Behavioral and neural analyses of connotative meaning: Word classes and rating scales , 1980, Brain and Language.

[92]  D. Swinney,et al.  Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[93]  F. Pulvermüller,et al.  Walking or Talking?: Behavioral and Neurophysiological Correlates of Action Verb Processing , 2001, Brain and Language.

[94]  Daniel Brandeis,et al.  Neurophysiological signs of rapidly emerging visual expertise for symbol strings , 2005, Neuroreport.

[95]  D. Amaral,et al.  Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey , 2003, Neuroscience.

[96]  H. Aarts,et al.  On Wildebeests and Humans , 2003, Psychological science.

[97]  Christian Schmid,et al.  A Matlab function to estimate choice model parameters from paired-comparison data , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[98]  H Begleiter,et al.  Cortical evoked potentials to semantic stimuli. , 1969, Psychophysiology.

[99]  Brigitte Rockstroh,et al.  Processing of emotional adjectives: Evidence from startle EMG and ERPs. , 2006, Psychophysiology.

[100]  J. Russell A circumplex model of affect. , 1980 .

[101]  M. Posner,et al.  Establishing a time‐line of word recognition: evidence from eye movements and event‐related potentials , 1998, Neuroreport.

[102]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[103]  Peter J. Lang,et al.  The motivational organization of emotion: Affect-reflex connections. , 1994 .

[104]  É. Kostandov,et al.  Averaged cortical evoked potentials to recognized and non-recognized verbal stimuli. , 1977, Acta neurobiologiae experimentalis.

[105]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 2. Depth-recorded potentials in the human frontal and Rolandic cortices , 1994, Journal of Physiology-Paris.

[106]  Peter J. Lang,et al.  A Bio‐Informational Theory of Emotional Imagery , 1979 .

[107]  Evian Gordon,et al.  A Direct Brainstem–amygdala–cortical Dalarmt System for Subliminal Signals of Fear , 2004 .

[108]  K. Lifshitz The averaged evoked cortical response to complex visual stimuli. , 1966, Psychophysiology.