Processing lexical semantic and syntactic information in first and second language: fMRI evidence from German and Russian

We introduce two experiments that explored syntactic and semantic processing of spoken sentences by native and non‐native speakers. In the first experiment, the neural substrates corresponding to detection of syntactic and semantic violations were determined in native speakers of two typologically different languages using functional magnetic resonance imaging (fMRI). The results show that the underlying neural response of participants to stimuli across different native languages is quite similar. In the second experiment, we investigated how non‐native speakers of a language process the same stimuli presented in the first experiment. First, the results show a more similar pattern of increased activation between native and non‐native speakers in response to semantic violations than to syntactic violations. Second, the non‐native speakers were observed to employ specific portions of the frontotemporal language network differently from those employed by native speakers. These regions included the inferior frontal gyrus (IFG), superior temporal gyrus (STG), and subcortical structures of the basal ganglia. Hum Brain Mapp 25:266–286, 2005. © 2005 Wiley‐Liss, Inc.

[1]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[2]  J. Connolly,et al.  Event-Related Potential Components Reflect Phonological and Semantic Processing of the Terminal Word of Spoken Sentences , 1994, Journal of Cognitive Neuroscience.

[3]  D. Swinney,et al.  Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Mark D'Esposito,et al.  Subcortical aphasia , 1995, Neurology.

[5]  K. Uğurbil,et al.  High contrast and fast three‐dimensional magnetic resonance imaging at high fields , 1995, Magnetic resonance in medicine.

[6]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[7]  A. Friederici,et al.  Temporal structure of syntactic parsing: early and late event-related brain potential effects. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Alan C. Evans,et al.  PET studies of phonetic processing of speech: review, replication, and reanalysis. , 1996, Cerebral cortex.

[9]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[10]  R. Ingham,et al.  A PET study of the neural systems of stuttering , 1996, Nature.

[11]  F. Fazio,et al.  Brain processing of native and foreign languages , 1996, NeuroImage.

[12]  R W Cox,et al.  Use of functional MR to map language in multilingual volunteers. , 1996, AJNR. American journal of neuroradiology.

[13]  S. Dehaene,et al.  Anatomical variability in the cortical representation of first and second language , 1997, Neuroreport.

[14]  Karl J. Friston,et al.  Event‐related f MRI , 1997, Human brain mapping.

[15]  J. Hirsch,et al.  Distinct cortical areas associated with native and second languages , 1997, Nature.

[16]  Karl J. Friston,et al.  Event-related fMRI , 1997 .

[17]  S Buus,et al.  Age of second-language acquisition and perception of speech in noise. , 1997, Journal of speech, language, and hearing research : JSLHR.

[18]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[20]  R. Ilmoniemi,et al.  Language-specific phoneme representations revealed by electric and magnetic brain responses , 1997, Nature.

[21]  David Caplan,et al.  Effects of Syntactic Structure and Propositional Number on Patterns of Regional Cerebral Blood Flow , 1998, Journal of Cognitive Neuroscience.

[22]  David Caplan,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1998, NeuroImage.

[23]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[24]  V Bettinardi,et al.  The bilingual brain. Proficiency and age of acquisition of the second language. , 1998, Brain : a journal of neurology.

[25]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[26]  D. Caplan,et al.  Processing of Visually Presented Sentences in Mandarin and English Studied with fMRI , 1999, Neuron.

[27]  G. Waters,et al.  PET Studies of Syntactic Processing with Auditory Sentence Presentation , 1999, NeuroImage.

[28]  J. Desmond,et al.  Functional Specialization for Semantic and Phonological Processing in the Left Inferior Prefrontal Cortex , 1999, NeuroImage.

[29]  A. Friederici,et al.  Electrophysiological Evidence for Two Steps in Syntactic Analysis: Early Automatic and Late Controlled Processes , 1999, Journal of Cognitive Neuroscience.

[30]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.

[31]  M. Chee,et al.  Mandarin and English Single Word Processing Studied with Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[32]  I. R. MacKay,et al.  Native Italian speakers' perception and production of English vowels. , 1999, The Journal of the Acoustical Society of America.

[33]  D. Perani,et al.  A cultural effect on brain function , 2000, Nature Neuroscience.

[34]  D. V. von Cramon,et al.  Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. , 2000, Brain research. Cognitive brain research.

[35]  E. Bullmore,et al.  Common and Distinct Neural Substrates for Pragmatic, Semantic, and Syntactic Processing of Spoken Sentences: An fMRI Study , 2000, Journal of Cognitive Neuroscience.

[36]  James Emil Flege,et al.  Factors affecting the recognition of words in a second language , 2000, Bilingualism: Language and Cognition.

[37]  D. Shankweiler,et al.  An Event-related Neuroimaging Study Distinguishing Form and Content in Sentence Processing , 2000, Journal of Cognitive Neuroscience.

[38]  E. Gibson,et al.  The P600 as an index of syntactic integration difficulty , 2000 .

[39]  S. Blumstein,et al.  The Role of Segmentation in Phonological Processing: An fMRI Investigation , 2000, Journal of Cognitive Neuroscience.

[40]  R. Poldrack Imaging Brain Plasticity: Conceptual and Methodological Issues— A Theoretical Review , 2000, NeuroImage.

[41]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[42]  C. Price The anatomy of language: contributions from functional neuroimaging , 2000, Journal of anatomy.

[43]  M. Chee,et al.  Overlap and Dissociation of Semantic Processing of Chinese Characters, English Words, and Pictures: Evidence from fMRI , 2000, NeuroImage.

[44]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[45]  Colin M. Brown,et al.  ERP effects of listening to speech compared to reading: the P600/SPS to syntactic violations in spoken sentences and rapid serial visual presentation , 2000, Neuropsychologia.

[46]  Y. Miyashita,et al.  A syntactic specialization for Broca's area. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[47]  A. Friederici,et al.  Noise affects auditory and linguistic processing differently: an MEG study , 2000, Neuroreport.

[48]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[49]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[50]  S. Petersen,et al.  Characterizing the Hemodynamic Response: Effects of Presentation Rate, Sampling Procedure, and the Possibility of Ordering Brain Activity Based on Relative Timing , 2000, NeuroImage.

[51]  D G Norris,et al.  Reduced power multislice MDEFT imaging , 2000, Journal of magnetic resonance imaging : JMRI.

[52]  C. Price,et al.  The Constraints Functional Neuroimaging Places on Classical Models of Auditory Word Processing , 2001, Journal of Cognitive Neuroscience.

[53]  D. Perani,et al.  Syntax and the Brain: Disentangling Grammar by Selective Anomalies , 2001, NeuroImage.

[54]  Yukihiko Fujii,et al.  Brain strategies for reading in the second language are determined by the first language , 2001, Neuroscience Research.

[55]  G Hickok,et al.  Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study , 2001, Neuroreport.

[56]  Shlomo Bentin,et al.  Syntactic and Semantic Factors in Processing Gender Agreement in Hebrew: Evidence from ERPs and Eye Movements ☆ , 2001 .

[57]  Stefano F. Cappa,et al.  The bilingual brain as revealed by functional neuroimaging , 2001, The Bilingualism Reader.

[58]  G Lohmann,et al.  LIPSIA--a new software system for the evaluation of functional magnetic resonance images of the human brain. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[59]  D. Caplan Functional Neuroimaging Studies of Syntactic Processing , 2001, Journal of psycholinguistic research.

[60]  Cathy J. Price,et al.  Functional Neuroimaging of Language , 2001 .

[61]  R. Poldrack,et al.  Recovering Meaning Left Prefrontal Cortex Guides Controlled Semantic Retrieval , 2001, Neuron.

[62]  Colin M. Brown,et al.  Syntactic Processing in Left Prefrontal Cortex Is Independent of Lexical Meaning , 2001, NeuroImage.

[63]  A Hahne,et al.  What's Different in Second-Language Processing? Evidence from Event-Related Brain Potentials , 2001, Journal of psycholinguistic research.

[64]  H Nakajima,et al.  A topographical study of ERP correlates of semantic and syntactic violations in the Japanese language using the multichannel EEG system. , 2001, Psychophysiology.

[65]  J B Poline,et al.  Brain imaging of language plasticity in adopted adults: can a second language replace the first? , 2001, NeuroImage.

[66]  A D Friederici,et al.  Syntactic Working Memory and the Establishment of Filler-Gap Dependencies: Insights from ERPs and fMRI , 2001, Journal of psycholinguistic research.

[67]  M. Raichle Handbook of Functional Neuroimaging of Cognition , 2001 .

[68]  H. Heinze,et al.  Brain potential and functional MRI evidence for how to handle two languages with one brain , 2002, Nature.

[69]  P. Lieberman On the nature and evolution of the neural bases of human language. , 2002, American journal of physical anthropology.

[70]  F. Vargha-Khadem,et al.  Behavioural analysis of an inherited speech and language disorder: comparison with acquired aphasia. , 2002, Brain : a journal of neurology.

[71]  J. Gee,et al.  Neural basis for sentence comprehension: Grammatical and short‐term memory components , 2002, Human brain mapping.

[72]  A. Friederici,et al.  Differential task effects on semantic and syntactic processes as revealed by ERPs. , 2002, Brain research. Cognitive brain research.

[73]  Karl J. Friston,et al.  MRI analysis of an inherited speech and language disorder: structural brain abnormalities. , 2002, Brain : a journal of neurology.

[74]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[75]  Francesco Vespignani,et al.  Cortical brain responses to semantic incongruity and syntactic violation in Italian language: an event-related potential study , 2002, Neuroscience Letters.

[76]  Sonja A. Kotz,et al.  Modulation of the Lexical–Semantic Network by Auditory Semantic Priming: An Event-Related Functional MRI Study , 2002, NeuroImage.

[77]  M. Lowe,et al.  A Cross-Linguistic fMRI Study of Spectral and Temporal Cues Underlying Phonological Processing , 2002, Journal of Cognitive Neuroscience.

[78]  L. Tan,et al.  Functional anatomy of syntactic and semantic processing in language comprehension , 2002, Human brain mapping.

[79]  Peter F. Liddle,et al.  Reading Anomalous Sentences: An Event-Related fMRI Study of Semantic Processing , 2002, NeuroImage.

[80]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[81]  Kuniyoshi L Sakai,et al.  An event-related fMRI study of explicit syntactic processing of normal/anomalous sentences in contrast to implicit syntactic processing. , 2003, Cerebral cortex.

[82]  Gabriele Lohmann,et al.  Bayesian second-level analysis of functional magnetic resonance images , 2003, NeuroImage.

[83]  D. V. von Cramon,et al.  Syntactic language processing: ERP lesion data on the role of the basal ganglia , 2003, Journal of the International Neuropsychological Society.

[84]  Eraldo Paulesu,et al.  The role of age of acquisition and language usage in early, high‐proficient bilinguals: An fMRI study during verbal fluency , 2003, Human brain mapping.

[85]  A. Friederici,et al.  The brain basis of syntactic processes: functional imaging and lesion studies , 2003, NeuroImage.

[86]  J B Poline,et al.  Brain imaging of language plasticity in adopted adults: can a second language replace the first? , 2001, NeuroImage.

[87]  Isabell Wartenburger,et al.  Early Setting of Grammatical Processing in the Bilingual Brain , 2003, Neuron.

[88]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[89]  A. Friederici,et al.  Why the P600 is not just a P300: the role of the basal ganglia , 2003, Clinical Neurophysiology.

[90]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[91]  S. Scott,et al.  The neuroanatomical and functional organization of speech perception , 2003, Trends in Neurosciences.

[92]  J. Xiong,et al.  Neural systems of second language reading are shaped by native language , 2003 .

[93]  B Opitz,et al.  Distributed cortical networks for syntax processing: Broca’s area as the common denominator , 2003, Brain and Language.

[94]  A. A. Wijers,et al.  Activations of “motor” and other non-language structures during sentence comprehension , 2004, Brain and Language.

[95]  Jutta L. Mueller Electrophysiological correlates of second language processing , 2005 .

[96]  C. Fiebach,et al.  Revisiting the role of Broca's area in sentence processing: Syntactic integration versus syntactic working memory , 2005, Human brain mapping.