Neural Correlates of Task-Irrelevant First and Second Language Emotion Words – Evidence from the Emotional Face–Word Stroop Task

Emotionally valenced words have thus far not been empirically examined in a bilingual population with the emotional face–word Stroop paradigm. Chinese-English bilinguals were asked to identify the facial expressions of emotion with their first (L1) or second (L2) language task-irrelevant emotion words superimposed on the face pictures. We attempted to examine how the emotional content of words modulated behavioral performance and cerebral functioning in the bilinguals’ two languages. The results indicated that there were significant congruency effects for both L1 and L2 emotion words, and that identifiable differences in the magnitude of the Stroop effect between the two languages were also observed, suggesting L1 is more capable of activating the emotional response to word stimuli. For event-related potentials data, an N350–550 effect was observed only in the L1 task with greater negativity for incongruent than congruent trials. The size of the N350–550 effect differed across languages, whereas no identifiable language distinction was observed in the effect of conflict slow potential (conflict SP). Finally, more pronounced negative amplitude at 230–330 ms was observed in L1 than in L2, but only for incongruent trials. This negativity, likened to an orthographic decoding N250, may reflect the extent of attention to emotion word processing at word-form level, while the N350–550 reflects a complicated set of processes in the conflict processing. Overall, the face–word congruency effect has reflected identifiable language distinction at 230–330 and 350-550 ms, which provides supporting evidence for the theoretical proposals assuming attenuated emotionality of L2 processing.

[1]  M. L. Howe,et al.  Mood-congruent true and false memory: Effects of depression , 2011, Memory.

[2]  W. Sommer,et al.  Interplay of emotional valence and concreteness in word processing: An event-related potential study with verbs , 2013, Brain and Language.

[3]  H. Mayberg,et al.  An ERP study of the temporal course of the Stroop color-word interference effect , 2000, Neuropsychologia.

[4]  Jiajin Yuan,et al.  Neural oscillatory evidence of the difference between emotional and conceptual processing in language comprehension , 2013, Neuroscience Letters.

[5]  J. Altarriba,et al.  The Role of Language in Therapy With the Spanish–English Bilingual Client , 2002 .

[6]  Jeffrey N Rouder,et al.  Exploring the differences in distributional properties between Stroop and Simon effects using delta plots , 2010, Attention, perception & psychophysics.

[7]  C. Harris Bilingual Speakers in the Lab: Psychophysiological Measures of Emotional Reactivity , 2004 .

[8]  Edith Mägiste Development of intra- and interlingual interference in bilinguals , 1985 .

[9]  P. Hertel,et al.  Emotionality in free recall: Language specificity in bilingual memory. , 1994 .

[10]  C. Harris When is a First Language More Emotional? Psychophysiological Evidence from Bilingual Speakers , 2006 .

[11]  W. Perlstein,et al.  Temporal dissociation of components of cognitive control dysfunction in severe TBI: ERPs and the cued-Stroop task , 2006, Neuropsychologia.

[12]  W. Sommer,et al.  Font Size Matters—Emotion and Attention in Cortical Responses to Written Words , 2012, PloS one.

[13]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[14]  A. Pavlenko,et al.  Affective processing in bilingual speakers: disembodied cognition? , 2012, International journal of psychology : Journal international de psychologie.

[15]  Chris R. Brewin,et al.  Cognitive psychology and emotional disorders , 1989 .

[16]  Kara D. Federmeier,et al.  Handbook of Psychophysiology: Event-Related Brain Potentials: Methods, Theory, and Applications , 2007 .

[17]  Ralph Mercurio,et al.  Making Sense of It All , 2021, Beginning Microsoft 365 Collaboration Apps.

[18]  D. O'Neill,et al.  First Language , 2009 .

[19]  J. Altarriba Expressions of emotion as mediated by context , 2008 .

[20]  I. David,et al.  The Stroop matching task presents conflict at both the response and nonresponse levels: an event-related potential and electromyography study. , 2012, Psychophysiology.

[21]  Hans Rudi Fischer Language games and (hi)stories: Wittgenstein, Bateson and Schapp on the role of language in therapy , 2007, Kybernetes.

[22]  C. Caldwell-Harris,et al.  Emotion and lying in a non-native language. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  Aneta Pavlenko,et al.  Emotion and emotion-laden words in the bilingual lexicon , 2008 .

[24]  Jean‐Marc Dewaele,et al.  Emotions in Multiple Languages , 2010, Modern Language Review.

[25]  R C Burgess,et al.  Event related potentials I , 1992, Clinical Neurophysiology.

[26]  Heather Winskel The emotional Stroop task and emotionality rating of negative and neutral words in late Thai-English bilinguals. , 2013, International journal of psychology : Journal international de psychologie.

[27]  J. Kroll,et al.  Category Interference in Translation and Picture Naming: Evidence for Asymmetric Connections Between Bilingual Memory Representations , 1994 .

[28]  Yue-jia Luo,et al.  Emotional conflict occurs at an early stage: Evidence from the emotional face–word Stroop task , 2010, Neuroscience Letters.

[29]  Colin M. Macleod Half a century of research on the Stroop effect: an integrative review. , 1991, Psychological bulletin.

[30]  Barbara Kaup,et al.  Embodiment and second-language: Automatic activation of motor responses during processing spatially associated L2 words and emotion L2 words in a vertical Stroop paradigm , 2014, Brain and Language.

[31]  J. Kissler,et al.  Event related potentials to emotional adjectives during reading. , 2008, Psychophysiology.

[32]  N. Wicha,et al.  Cognitive and Electrophysiological Correlates of the Bilingual Stroop Effect , 2012, Front. Psychology.

[33]  M. D. Anes,et al.  Investigating hemispheric specialization in a novel face–word stroop task , 2004, Brain and Language.

[34]  J. Havelka,et al.  Emotional activation in the first and second language , 2007 .

[35]  Ute Habel,et al.  Brain circuitries involved in emotional interference task in major depression disorder. , 2013, Journal of affective disorders.

[36]  A. Jacobs,et al.  The Time Course of Emotion Effects in First and Second Language Processing: A Cross Cultural ERP Study with German–Spanish Bilinguals , 2011, Front. Psychology.

[37]  J. Gleason,et al.  Taboo words and reprimands elicit greater autonomic reactivity in a first language than in a second language , 2003, Applied Psycholinguistics.

[38]  Avishai Henik,et al.  Controlling Stroop interference: Evidence from a bilingual task. , 1990 .

[39]  J. Qiu,et al.  Neural time course of emotional conflict control: An ERP study , 2013, Neuroscience Letters.

[40]  L. Bai,et al.  The Development of Native Chinese Affective Picture System-A pretest in 46 College Students , 2005 .

[41]  Peter E. Clayson,et al.  Making sense of all the conflict: a theoretical review and critique of conflict-related ERPs. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[42]  Jean‐Marc Dewaele,et al.  The Emotional Force of Swearwords and Taboo Words in the Speech of Multilinguals , 2004 .

[43]  Tina M. Sutton,et al.  The automatic access of emotion: Emotional Stroop effects in Spanish–English bilingual speakers , 2007 .

[44]  R. West,et al.  Neural correlates of cognitive control and conflict detection in the Stroop and digit-location tasks , 2003, Neuropsychologia.

[45]  Fruzsina Soltész,et al.  Stimulus and response conflict in the color–word Stroop task: A combined electro-myography and event-related potential study , 2010, Brain Research.

[46]  J. Gleason,et al.  Taboo Words and Reprimands Elicit Greater Autonomic Reactivity in a First Than in a Second Language , 2003 .

[47]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[49]  Margarita Kaushanskaya,et al.  The Language Experience and Proficiency Questionnaire (LEAP-Q): assessing language profiles in bilinguals and multilinguals. , 2007, Journal of speech, language, and hearing research : JSLHR.

[50]  Xiaofeng Liu Event-related potentials associated with Chinese and English color-word Stroop tasks in Chinese bilinguals , 2007 .

[51]  C. Harris Bilinguals ’ Recall and Recognition of Emotion Words , 2003 .

[52]  Posterior N1 asymmetry to English and Welsh words in Early and Late English–Welsh bilinguals , 2010, Biological Psychology.

[53]  D. Algom,et al.  A rational look at the emotional stroop phenomenon: a generic slowdown, not a stroop effect. , 2004, Journal of experimental psychology. General.

[54]  J. Kissler,et al.  Buzzwords , 2007, Psychological science.

[55]  C. Pléh,et al.  Emotional activation measured using the emotional Stroop task in early Hungarian-Serbian bilinguals from Serbia , 2014 .

[56]  William M. Perlstein,et al.  Neural time course of conflict adaptation effects on the Stroop task , 2009, Neuropsychologia.

[57]  Werner Sommer,et al.  Are effects of emotion in single words non-lexical? Evidence from event-related brain potentials , 2011, Neuropsychologia.

[58]  Catherine L. Caldwell-Harris Emotionality Differences Between a Native and Foreign Language , 2015 .

[59]  N. Segalowitz,et al.  Automatic and controlled processes in the first- and second-language reading of fluent bilinguals , 1983, Memory & cognition.

[60]  Sara C. Sereno,et al.  Early emotion word processing: Evidence from event-related potentials , 2009, Biological Psychology.

[61]  V. Marian,et al.  Multilingual Stroop performance: Effects of trilingualism and proficiency on inhibitory control , 2013, International journal of multilingualism.

[62]  C Alain,et al.  Age-related decline in inhibitory control contributes to the increased Stroop effect observed in older adults. , 2000, Psychophysiology.

[63]  D. W. Green,et al.  BILINGUALISM AND THOUGHT , 1998 .

[64]  B. Opitz,et al.  Emotionality in a second language: It's a matter of time , 2012, Neuropsychologia.

[65]  J. Havelka,et al.  Behavioural and physiological responses to the emotional and taboo Stroop tasks in native and non-native speakers of English , 2011 .

[66]  Antao Chen,et al.  Neural correlates of stimulus and response interference in a 2-1 mapping stroop task. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[67]  H. Semlitsch,et al.  A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. , 1986, Psychophysiology.

[68]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[69]  J. Qiu,et al.  Electrophysiological correlates related to the conflict adaptation effect in an emotional conflict task , 2015, Neuroscience Letters.

[70]  J. Altarriba Does cariño equal “liking”? , 2003 .

[71]  Ling Li,et al.  Visual short-term memory load modulates the early attention and perception of task-irrelevant emotional faces , 2015, Front. Hum. Neurosci..

[72]  Yiming Yang,et al.  ERP correlates of compositionality in Chinese idiom comprehension , 2013, Journal of Neurolinguistics.

[73]  María Ruz,et al.  Attention Modulates Initial Stages of Visual Word Processing , 2008, Journal of Cognitive Neuroscience.

[74]  Ping Li,et al.  Neural Correlates of Nouns and Verbs in Early Bilinguals , 2008, Annals of the New York Academy of Sciences.

[75]  J. Kissler,et al.  Emotion and attention in visual word processing—An ERP study , 2009, Biological Psychology.

[76]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[77]  A. Fox,et al.  Processing emotional category congruency between emotional facial expressions and emotional words , 2011, Cognition & emotion.

[78]  Ramin Assadollahi,et al.  Emotional and semantic networks in visual word processing: insights from ERP studies. , 2006, Progress in brain research.

[79]  Jeanette Altarriba,et al.  Emotion Word Processing: Effects of Word Type and Valence in Spanish–English Bilinguals , 2016, Journal of psycholinguistic research.

[80]  W. Sommer,et al.  Emotions in word and face processing: Early and late cortical responses , 2009, Brain and Cognition.

[81]  Manuel Perea,et al.  Vocabulary teaching strategies and conceptual representations of words in L2 in children: evidence with novice learners. , 2009, Journal of experimental child psychology.

[82]  C. Harris,et al.  BRIEF REPORT Bilinguals' recall and recognition of emotion words , 2004 .

[83]  M. Komoda,et al.  Second language reading: Implications of the word superiority effect in skilled bilinguals. , 1980 .

[84]  Arthur M. Jacobs,et al.  Can Harry Potter still put a spell on us in a second language? An fMRI study on reading emotion-laden literature in late bilinguals , 2015, Cortex.

[85]  Marcel Bastiaansen,et al.  Oscillatory brain dynamics associated with the automatic processing of emotion in words , 2014, Brain and Language.