Electrophysiological correlates of the interplay between low-level visual features and emotional content during word reading

Processing affectively charged visual stimuli typically results in increased amplitude of specific event-related potential (ERP) components. Low-level features similarly modulate electrophysiological responses, with amplitude changes proportional to variations in stimulus size and contrast. However, it remains unclear whether emotion-related amplifications during visual word processing are necessarily intertwined with changes in specific low-level features or, instead, may act independently. In this pre-registered electrophysiological study, we varied font size and contrast of neutral and negative words while participants were monitoring their semantic content. We examined ERP responses associated with early sensory and attentional processes as well as later stages of stimulus processing. Results showed amplitude modulations by low-level visual features early on following stimulus onset – i.e., P1 and N1 components –, while the LPP was independently modulated by these visual features. Independent effects of size and emotion were observed only at the level of the EPN. Here, larger EPN amplitudes for negative were observed only for small high contrast and large low contrast words. These results suggest that early increase in sensory processing at the EPN level for negative words is not automatic, but bound to specific combinations of low-level features, occurring presumably via attentional control processes.

[1]  Luiz Pessoa,et al.  Visual Attention and Emotional Perception , 2005 .

[2]  David M. Groppe,et al.  Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. , 2011, Psychophysiology.

[3]  W. Sommer,et al.  Emotions in word and face processing: Early and late cortical responses , 2009, Brain and Cognition.

[4]  J. de Houwer,et al.  On the (un)conditionality of automatic attitude activation: the valence proportion effect. , 2011, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[5]  Karl J. Friston,et al.  Electromagnetic source reconstruction for group studies , 2008, NeuroImage.

[6]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[7]  W. Sommer,et al.  Font Size Matters—Emotion and Attention in Cortical Responses to Written Words , 2012, PloS one.

[8]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[9]  E. Wagenmakers,et al.  Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology , 2016 .

[10]  Sara C. Sereno,et al.  Early emotion word processing: Evidence from event-related potentials , 2009, Biological Psychology.

[11]  Tzyy-Ping Jung,et al.  Real-time neuroimaging and cognitive monitoring using wearable dry EEG , 2015, IEEE Transactions on Biomedical Engineering.

[12]  Antonio Schettino,et al.  rain mechanisms for emotional influences on perception and attention : hat is magic and what is not , 2012 .

[13]  Markus Junghöfer,et al.  Evidence for rapid prefrontal emotional evaluation from visual evoked responses to conditioned gratings , 2014, Biological Psychology.

[14]  M. Codispoti,et al.  Effects of Picture Size Reduction and Blurring on Emotional Engagement , 2010, PloS one.

[15]  Pienie Zwitserlood,et al.  Rapid prefrontal cortex activation towards aversively paired faces and enhanced contingency detection are observed in highly trait-anxious women under challenging conditions , 2015, Front. Behav. Neurosci..

[16]  Annekathrin Schacht,et al.  Event-related brain responses to emotional words, pictures, and faces – a cross-domain comparison , 2014, Front. Psychol..

[17]  Ramin Assadollahi,et al.  Emotional and semantic networks in visual word processing: insights from ERP studies. , 2006, Progress in brain research.

[18]  M. Brysbaert,et al.  Norms of valence, arousal, dominance, and age of acquisition for 4,300 Dutch words , 2013, Behavior research methods.

[19]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[20]  Simon Garnier,et al.  Default Color Maps from 'matplotlib' , 2015 .

[21]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[22]  Steven J. Luck,et al.  ERPLAB: an open-source toolbox for the analysis of event-related potentials , 2014, Front. Hum. Neurosci..

[23]  Dan Foti,et al.  Motivated and controlled attention to emotion: Time-course of the late positive potential , 2009, Clinical Neurophysiology.

[24]  Stefan Debener,et al.  Size matters: effects of stimulus size, duration and eccentricity on the visual gamma-band response , 2004, Clinical Neurophysiology.

[25]  Felix D. Schönbrodt,et al.  Sequential Hypothesis Testing With Bayes Factors: Efficiently Testing Mean Differences , 2017, Psychological methods.

[26]  R. Blair,et al.  An alternative method for significance testing of waveform difference potentials. , 1993, Psychophysiology.

[27]  Karl J. Friston,et al.  EEG and MEG Data Analysis in SPM8 , 2011, Comput. Intell. Neurosci..

[28]  J. J. Lange,et al.  An ERP study of visual spatial attention and letter target detection for isoluminant and nonisoluminant stimuli. , 1997, Psychophysiology.

[29]  M. Junghöfer,et al.  How ‘love’ and ‘hate’ differ from ‘sleep’: Using combined electro/magnetoencephalographic data to reveal the sources of early cortical responses to emotional words , 2014, Human brain mapping.

[30]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[31]  Brian A. Nosek,et al.  The preregistration revolution , 2018, Proceedings of the National Academy of Sciences.

[32]  H. Hughes,et al.  Effects of flash luminance and positional expectancies on visual response latency , 1984, Perception & psychophysics.

[33]  Marta Kutas,et al.  Mass univariate analysis of event-related brain potentials/fields II: Simulation studies. , 2011, Psychophysiology.

[34]  F. Pulvermüller,et al.  Effects of word length and frequency on the human event-related potential , 2004, Clinical Neurophysiology.

[35]  Antonio Schettino,et al.  Shedding light on emotional perception: Interaction of brightness and semantic content in extrastriate visual cortex , 2016, NeuroImage.

[36]  Maurizio Codispoti,et al.  Arousal and attention: picture size and emotional reactions. , 2007, Psychophysiology.

[37]  Nicholas Gaspelin,et al.  How to get statistically significant effects in any ERP experiment (and why you shouldn't). , 2017, Psychophysiology.

[38]  Jeffrey N. Rouder,et al.  Default Bayes factors for ANOVA designs , 2012 .

[39]  F. Wilhelm,et al.  Exposure to social-evaluative video clips: Neural, facial-muscular, and experiential responses and the role of social anxiety , 2015, Biological Psychology.

[40]  Ana L. N. Fred,et al.  Unveiling the Biometric Potential of Finger-Based ECG Signals , 2011, Comput. Intell. Neurosci..

[41]  J. Kissler,et al.  Buzzwords , 2007, Psychological science.

[42]  Jasna Martinovic,et al.  Electrocortical amplification for emotionally arousing natural scenes: The contribution of luminance and chromatic visual channels , 2015, Biological Psychology.

[43]  Yihui Xie,et al.  A General-Purpose Package for Dynamic Report Generation in R , 2016 .

[44]  Jan De Houwer,et al.  Unconscious semantic activation depends on feature-specific attention allocation , 2012, Cognition.

[45]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[46]  A. Schacht,et al.  The impact of personal relevance on emotion processing: evidence from event-related potentials and pupillary responses , 2017, Social cognitive and affective neuroscience.

[47]  J. Kissler,et al.  Buzzwords , 2007, Psychology Science.

[48]  Manfred Herrmann,et al.  Time course of implicit processing and explicit processing of emotional faces and emotional words , 2011, Biological Psychology.

[49]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[50]  M. Bradley,et al.  Brain potentials in perception: picture complexity and emotional arousal. , 2007, Psychophysiology.

[51]  Markus Junghöfer,et al.  Selective Visual Attention to Emotion , 2007, The Journal of Neuroscience.

[52]  M. A. Pozo,et al.  Looking at emotional words is not the same as reading emotional words: Behavioral and neural correlates. , 2010, Psychophysiology.

[53]  S. Sereno,et al.  Context Effects in Word Recognition , 2003, Psychological science.

[54]  Sonja A. Kotz,et al.  Concreteness in emotional words: ERP evidence from a hemifield study , 2007, Brain Research.

[55]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[56]  J. Carroll,et al.  Word Frequency and Age of Acquisition as Determiners of Picture-Naming Latency , 1973 .

[57]  S. Luck An Introduction to the Event-Related Potential Technique , 2005 .

[58]  Durk Talsma,et al.  Generating spatial and nonspatial attentional control: An ERP study. , 2005, Psychophysiology.

[59]  G. Pourtois,et al.  Feature-specific attention allocation overrules the orienting response to emotional stimuli. , 2014, Social cognitive and affective neuroscience.

[60]  M. Junghöfer,et al.  Early Prefrontal Brain Responses to the Hedonic Quality of Emotional Words – A Simultaneous EEG and MEG Study , 2013, PloS one.

[61]  J. Kissler,et al.  Event related potentials to emotional adjectives during reading. , 2008, Psychophysiology.

[62]  W. Sommer,et al.  Time course and task dependence of emotion effects in word processing , 2009, Cognitive, affective & behavioral neuroscience.

[63]  Francesca M. M. Citron Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies , 2012, Brain and Language.

[64]  Cornelia Herbert,et al.  Emotion, Etmnooi, or Emitoon? – Faster lexical access to emotional than to neutral words during reading , 2013, Biological Psychology.

[65]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[66]  M. Codispoti,et al.  When does size not matter? Effects of stimulus size on affective modulation. , 2006, Psychophysiology.

[67]  L. Carretié Exogenous (automatic) attention to emotional stimuli: a review , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[68]  Sonja A. Kotz,et al.  Attentional orienting towards emotion: P2 and N400 ERP effects , 2011, Neuropsychologia.

[69]  J. Kissler,et al.  Perceived Communicative Context and Emotional Content Amplify Visual Word Processing in the Fusiform Gyrus , 2015, The Journal of Neuroscience.

[70]  S. Luck,et al.  Electrophysiological correlates of feature analysis during visual search. , 1994, Psychophysiology.

[71]  Sebastian Schindler,et al.  Selective visual attention to emotional words: Early parallel frontal and visual activations followed by interactive effects in visual cortex , 2016, Human brain mapping.

[72]  G. A. Miller,et al.  Committee report: publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography. , 2014, Psychophysiology.

[73]  H. Jeffreys,et al.  Theory of probability , 1896 .

[74]  P. Michie,et al.  The attentional blink and P300. , 1999, Neuroreport.

[75]  Nathaniel D. Phillips,et al.  YaRrr! The Pirate’s Guide to R , 2017 .

[76]  Tzyy-Ping Jung,et al.  Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[77]  R. Cabeza,et al.  Event-related potentials of emotional memory: Encoding pleasant, unpleasant, and neutral pictures , 2002, Cognitive, affective & behavioral neuroscience.

[78]  D. Balota,et al.  The locus of word-frequency effects in the pronunciation task: Lexical access and/or production? ☆ , 1985 .

[79]  P. Montoya,et al.  Low spatial frequency filtering modulates early brain processing of affective complex pictures , 2007, Neuropsychologia.

[80]  John K. Tsotsos,et al.  Neurobiology of Attention , 2005 .

[81]  Paul Pauli,et al.  Don't look at me in anger! Enhanced processing of angry faces in anticipation of public speaking. , 2010, Psychophysiology.

[82]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[83]  L. Pessoa On the relationship between emotion and cognition , 2008, Nature Reviews Neuroscience.

[84]  M. Bradley,et al.  Emotion and the motivational brain , 2010, Biological Psychology.

[85]  George R. Mangun,et al.  Reflexive Attention Modulates Processing of Visual Stimuli in Human Extrastriate Cortex , 1998, Psychological science.

[86]  Maurizio Codispoti,et al.  Fuzzy picture processing: effects of size reduction and blurring on emotional processing. , 2008, Emotion.

[87]  J. Kissler,et al.  Emotion and attention in visual word processing—An ERP study , 2009, Biological Psychology.

[88]  G. Mangun,et al.  Luminance and spatial attention effects on early visual processing. , 1995, Brain research. Cognitive brain research.

[89]  Jeffrey N Rouder,et al.  Bayesian Analysis of Factorial Designs , 2017, Psychological methods.

[90]  S. Nieuwenhuis,et al.  Reappraisal modulates the electrocortical response to unpleasant pictures , 2006, Cognitive, affective & behavioral neuroscience.

[91]  A. Engel,et al.  Event-related potential correlates of the attentional blink phenomenon. , 2003, Brain research. Cognitive brain research.

[92]  A. Jacobs,et al.  Affective processing within 1/10th of a second: High arousal is necessary for early facilitative processing of negative but not positive words , 2009, Cognitive, affective & behavioral neuroscience.

[93]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[94]  L. M. M.-T. Theory of Probability , 1929, Nature.

[95]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[96]  Jeffrey N. Rouder,et al.  Model comparison in ANOVA , 2016, Psychonomic bulletin & review.

[97]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[98]  E. Vogel,et al.  The visual N1 component as an index of a discrimination process. , 2000, Psychophysiology.