The interaction between pictures and words: evidence from positivity offset and negativity bias

In order to study the interaction between pictures and words, we investigated the variations of their actual arousal levels through the observation of the positivity offset and negativity bias under different conditions. We used emotional pictures and emotional Chinese words to construct stimuli under four conditions: (1) only a word was presented (Word Only condition), (2) only a picture was presented (Picture Only condition), (3) a word was presented before a picture (Word Before Picture condition) and (4) a picture was presented before a word (Picture Before Word condition). The picture and word in each target pair under the conditions (3) and (4) were congruous in content and emotion. Significant negativity bias is noticed under the Picture Only and the Word Only conditions. Effects analogous to a positivity offset are observed under the other two conditions. It is suggested that the actual arousal levels of multiple stimuli, such as those presented under the conditions (3) and (4) are different from those of individual pictures and individual words, while the actual arousal levels of individual pictures do not differ significantly from those of individual words. The results indicate that content consistency can lead to a reduction in emotional attention, and also that the influence of pictures on words will differ from the opposite condition.

[1]  J. Cacioppo,et al.  Electrophysiological Evidence of Implicit and Explicit Categorization Processes , 2000 .

[2]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[3]  L Carretié,et al.  Emotion, attention, and the 'negativity bias', studied through event-related potentials. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  C. Pernet,et al.  Neural timing of visual implicit categorization. , 2003, Brain research. Cognitive brain research.

[5]  A. Angrilli,et al.  Emotional Information Processing and Visual Evoked Brain Potentials , 1996, Perceptual and motor skills.

[6]  S. Delplanque,et al.  Event-related P3a and P3b in response to unpredictable emotional stimuli , 2005, Biological Psychology.

[7]  John Polich,et al.  Affective visual event-related potentials: Arousal, repetition, and time-on-task , 2007, Biological Psychology.

[8]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[9]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[10]  M. Weisbrod,et al.  SOA-dependent N400 and P300 semantic priming effects using pseudoword primes and a delayed lexical decision. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  A. A. Wijers,et al.  Processing of visual semantic information to concrete words: temporal dynamics and neural mechanisms indicated by event-related brain potentials , 2005, Cognitive neuropsychology.

[12]  Automatic affective processing , 2001 .

[13]  R. Cabeza,et al.  Event-related potentials of emotional memory: Encoding pleasant, unpleasant, and neutral pictures , 2002, Cognitive, affective & behavioral neuroscience.

[14]  D Deacon,et al.  The lifetime of automatic semantic priming effects may exceed two seconds. , 1999, Brain research. Cognitive brain research.

[15]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[16]  Brigitte Rockstroh,et al.  Processing of emotional adjectives: Evidence from startle EMG and ERPs. , 2006, Psychophysiology.

[17]  S. Hillyard,et al.  Cross-modal selective attention effects on retinal, myogenic, brainstem, and cerebral evoked potentials. , 1990, Psychophysiology.

[18]  R. Näätänen.  The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function , 1990, Behavioral and Brain Sciences.

[19]  S. Delplanque,et al.  Modulation of cognitive processing by emotional valence studied through event-related potentials in humans , 2004, Neuroscience Letters.

[20]  Peter Lang,et al.  Brain processes in emotional perception: Motivated attention , 2004 .

[21]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[22]  남궁기,et al.  Reduced P3 amplitudes by negative facial emotional photographs in schizophrenia , 2003 .

[23]  Luis Carretié,et al.  Valence-related vigilance biases in anxiety studied through event-related potentials. , 2004, Journal of affective disorders.

[24]  Jeff T. Larsen,et al.  May I have your attention, please: Electrocortical responses to positive and negative stimuli , 2003, Neuropsychologia.

[25]  Yue-Jia Luo,et al.  Temporal course of emotional negativity bias: An ERP study , 2006, Neuroscience Letters.

[26]  Jan De Houwer,et al.  A time course analysis of the affective priming effect , 2001 .

[27]  John Polich,et al.  Affective ERP processing in a visual oddball task: Arousal, valence, and gender , 2008, Clinical Neurophysiology.

[28]  Peter J. Lang,et al.  Eliciting Affect Using the International Affective Picture System: Trajectories through Evaluative Space , 1998 .

[29]  Jeff T. Larsen,et al.  Negative information weighs more heavily on the brain: the negativity bias in evaluative categorizations. , 1998, Journal of personality and social psychology.

[30]  A. Angrilli,et al.  Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[31]  Baolin Liu,et al.  The Effect of Task Relevance on Electrophysiological Response to Emotional Stimuli , 2008, ISNN.

[32]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[33]  M. Guazzelli,et al.  Spatiotemporal dynamics of single-letter reading: a combined ERP-FMRI study. , 2008, Archives italiennes de biologie.

[34]  Sonja A. Kotz,et al.  Concreteness in emotional words: ERP evidence from a hemifield study , 2007, Brain Research.

[35]  E. Golob,et al.  Age-related qualitative differences in auditory cortical responses during short-term memory , 2000, Clinical Neurophysiology.

[36]  A. Starr,et al.  Disordered auditory short-term memory in man and event-related potentials. , 1987, Brain : a journal of neurology.

[37]  Baolin Liu,et al.  A Detailed Study on the Modulation of Emotion Processing by Spatial Location , 2008, ISNN.

[38]  Paul Pauli,et al.  Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response? , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[39]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[40]  Luis Carretié,et al.  Automatic attention to emotional stimuli: Neural correlates , 2004, Human brain mapping.

[41]  D. Hermans,et al.  Affective priming with subliminally presented pictures. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[42]  J. Polich,et al.  Affective valence, stimulus attributes, and P300: color vs. black/white and normal vs. scrambled images. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[43]  John Polich,et al.  Affective valence and P300 when stimulus arousal level is controlled , 2007 .

[44]  Guy Dove,et al.  Linking Brainwaves to the Brain: An ERP Primer , 2005, Developmental neuropsychology.

[45]  Pedro Avero,et al.  Affective Priming with Pictures of Emotional Scenes: The Role of Perceptual Similarity and Category Relatedness , 2006, The Spanish Journal of Psychology.

[46]  J Radilová,et al.  The late positive component of visual evoked response sensitive to emotional factors. , 1982, Activitas nervosa superior.

[47]  E. Holmes,et al.  The causal effect of mental imagery on emotion assessed using picture-word cues. , 2008, Emotion.

[48]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[49]  P. Holcomb,et al.  Imaginal, Semantic, and Surface-Level Processing of Concrete and Abstract Words: An Electrophysiological Investigation , 2000, Journal of Cognitive Neuroscience.

[50]  Harald T. Schupp,et al.  Affective Prime and Target Picture Processing: An ERP Analysis of Early and Late Interference Effects , 2008, Brain Topography.