Sentences in the Brain: Event-Related Potentials as Real-Time Reflections of Sentence Comprehension and Language Learning

From the perspective of a person trying to understand a sentence, language is a continuous flow of information distributed over time. Somehow, the listener translates this stream of information into discrete and rapidly sequenced units of sound, meaning, and structure, and does so in real time, that is, nearly instantaneously. The results of these complex analyses are then integrated into a single coherent interpretation, even in the presence of considerable ambiguity. The challenge facing us is to account for how people accomplish this. Asking the listener or reader for an answer to this question provides little useful information; the relevant processes are not generally available to conscious reflection. We must therefore rely on other methods of investigation. One might surmise that the ideal method would mirror the properties of comprehension itself (Osterhout, McLaughlin, & Bersick, 1997). The ideal method should provide continuous measurement throughout the process of understanding a sentence, have a temporal resolution exceeding that of the relevant processes, and be differentially sensitive to events occurring at different levels of analysis (phonological, syntactic, semantic, etc.). Furthermore, language comprehension is clearly a function of the human brain. Theoretical accounts of some of the most fundamental questions about human language (e.g., the ability of children to acquire language, and the effects of age on language-learning ability) rely explicitly on biological explanations. Compelling tests of these hypotheses necessarily require biological measurement. For these and other reasons, the ideal method should also provide a means for relating the obtained data to brain function.

[1]  P. Schlattmann,et al.  Reduced Event-Related Current Density in the Anterior Cingulate Cortex in Schizophrenia , 2001, NeuroImage.

[2]  Lee Osterhout,et al.  Words in the brain: lexical determinants of word-induced brain activity , 2002, Journal of Neurolinguistics.

[3]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[4]  A. Friederici,et al.  Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study , 2000, Human brain mapping.

[5]  T. Bever,et al.  Some sentences on our consciousness of sentences , 2001 .

[6]  J. Hirsch,et al.  Distinct cortical areas associated with native and second languages , 1997, Nature.

[7]  Willem J. M. Levelt,et al.  Producing spoken language: A blueprint of the speaker , 1999 .

[8]  Douglas Saddy,et al.  Distinct Neurophysiological Patterns Reflecting Aspects of Syntactic Complexity and Syntactic Repair , 2002, Journal of psycholinguistic research.

[9]  Kazuyuki Nakagome,et al.  Early Components of Event-Related Potentials Related to Semantic and Syntactic Processes in the Japanese Language , 2004, Brain Topography.

[10]  Lee Osterhout,et al.  Event-related brain potentials and human language , 1997, Trends in Cognitive Sciences.

[11]  Cathy J. Price,et al.  Functional Neuroimaging of Language , 2001 .

[12]  S. Butler,et al.  The localization of equivalent dipoles of EEG sources by the application of electrical field theory. , 1975, Electroencephalography and clinical neurophysiology.

[13]  E. Bullmore,et al.  Common and Distinct Neural Substrates for Pragmatic, Semantic, and Syntactic Processing of Spoken Sentences: An fMRI Study , 2000, Journal of Cognitive Neuroscience.

[14]  H. Neville,et al.  Maturational Constraints on Functional Specializations for Language Processing: ERP and Behavioral Evidence in Bilingual Speakers , 1996, Journal of Cognitive Neuroscience.

[15]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[16]  L. Osterhout,et al.  On Space, Time, and Language: For the Next Century, Timing Is (Almost) Everything , 2000, Brain and Language.

[17]  Paul M. Matthews,et al.  Functional magnetic resonance imaging: An introduction to methods , 2001 .

[18]  D. Caplan,et al.  Electrophysiological distinctions in processing conceptual relationships within simple sentences. , 2003, Brain research. Cognitive brain research.

[19]  H Nakajima,et al.  A topographical study of ERP correlates of semantic and syntactic violations in the Japanese language using the multichannel EEG system. , 2001, Psychophysiology.

[20]  Colin M. Brown,et al.  The syntactic positive shift (sps) as an erp measure of syntactic processing , 1993 .

[21]  L. Osterhout,et al.  Event-Related Brain Potentials Elicited by Failure to Agree , 1995 .

[22]  Francesco Vespignani,et al.  Cortical brain responses to semantic incongruity and syntactic violation in Italian language: an event-related potential study , 2002, Neuroscience Letters.

[23]  A. Friederici,et al.  Processing a second language: Late learners''comprehension mechanisms as revealed by event-related b , 2001 .

[24]  S. Dehaene,et al.  Anatomical variability in the cortical representation of first and second language , 1997, Neuroreport.

[25]  J. Nicol,et al.  On the Distinctiveness, Independence, and Time Course of the Brain Responses to Syntactic and Semantic Anomalies. , 1999 .

[26]  A. Friederici The Time Course of Syntactic Activation During Language Processing: A Model Based on Neuropsychological and Neurophysiological Data , 1995, Brain and Language.

[27]  V Bettinardi,et al.  The bilingual brain. Proficiency and age of acquisition of the second language. , 1998, Brain : a journal of neurology.

[28]  F. Fazio,et al.  Brain processing of native and foreign languages , 1996, NeuroImage.

[29]  F. Dick,et al.  Beyond Phrenology: Brain and Language in the Next Millennium , 2000, Brain and Language.

[30]  R. Turner,et al.  Sentence Reading: A Functional MRI Study at 4 Tesla , 1997, Journal of Cognitive Neuroscience.

[31]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[32]  M. Rugg,et al.  Electrophysiology of Mind: Event-Related Brain Potentials and Cognition , 1995 .

[33]  H. Kolk,et al.  Structure and limited capacity in verbal working memory: A study with event-related potentials , 2003, Brain and Language.

[34]  Richard Shillcock,et al.  The On-line Study of Sentence Comprehension , 2004 .

[35]  Lee Osterhout,et al.  Brain potentials reflect violations of gender stereotypes , 1997, Memory & cognition.

[36]  H. Neville,et al.  An Event-Related fMRI Study of Syntactic and Semantic Violations , 2001, Journal of psycholinguistic research.

[37]  Anthony Kroch,et al.  The Isolability of Syntactic Processing , 1989 .

[38]  C. Price The functional anatomy of word comprehension and production , 1998, Trends in Cognitive Sciences.

[39]  R D Pascual-Marqui,et al.  Differential effects of normal aging on sources of standard N1, target N1 and target P300 auditory event-related brain potentials revealed by low resolution electromagnetic tomography (LORETA). , 1998, Electroencephalography and clinical neurophysiology.

[40]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[41]  Lyn Frazier,et al.  Against lexical generation of syntax , 1989 .

[42]  A. Dale,et al.  From retinotopy to recognition: fMRI in human visual cortex , 1998, Trends in Cognitive Sciences.

[43]  Michael K. Tanenhaus,et al.  Linguistic Structure in Language Processing , 1988 .

[44]  Håkan Ringbom,et al.  The role of the first language in foreign language learning , 1990 .

[45]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[46]  A. Caramazza,et al.  Dissociation of algorithmic and heuristic processes in language comprehension: Evidence from aphasia , 1976, Brain and Language.

[47]  M. Chee,et al.  Mandarin and English Single Word Processing Studied with Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[48]  A. Friederici,et al.  Electrophysiological Evidence for Two Steps in Syntactic Analysis: Early Automatic and Late Controlled Processes , 1999, Journal of Cognitive Neuroscience.

[49]  J. Gore,et al.  An Event-Related fMRI Study of Implicit Phrase-Level Syntactic and Semantic Processing , 1999, NeuroImage.

[50]  Dietrich Lehmann,et al.  Evaluation of Methods for Three-Dimensional Localization of Electrical Sources in the Human Brain , 1978, IEEE Transactions on Biomedical Engineering.

[51]  H. Neville,et al.  Fractionating language: different neural subsystems with different sensitive periods. , 1992, Cerebral cortex.

[52]  D. Swinney,et al.  Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[53]  Nina F. Dronkers,et al.  The Pursuit of Brain–Language Relationships , 2000, Brain and Language.

[54]  S. Blumstein,et al.  Back to the Future: Reclaiming Aphasia from Cognitive Neurolinguistics , 2000, Brain and Language.

[55]  D. Caplan,et al.  Processing of Visually Presented Sentences in Mandarin and English Studied with fMRI , 1999, Neuron.

[56]  F. Rösler,et al.  Individual cortical current density reconstructions of the semantic N400 effect: Using a generalized minimum norm model with different constraints (L1 and L2 norm) , 2000, Human brain mapping.

[57]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[58]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[59]  M Teräs,et al.  PET studies on the memory processing of word pairs in bilingual Finnish–English subjects , 2002, Behavioural Brain Research.

[60]  D. Shankweiler,et al.  An Event-related Neuroimaging Study Distinguishing Form and Content in Sentence Processing , 2000, Journal of Cognitive Neuroscience.

[61]  R. Cabeza,et al.  Handbook of functional neuroimaging of cognition , 2001 .

[62]  N Makris,et al.  Location of lesions in stroke patients with deficits in syntactic processing in sentence comprehension. , 1996, Brain : a journal of neurology.

[63]  S. Gass,et al.  Language transfer in language learning , 1985 .

[64]  Lee Osterhout,et al.  Constraints on Movement Phenomena in Sentence Processing: Evidence from Event-related Brain Potentials , 1996 .

[65]  J. S. Johnson,et al.  Critical Period Effects in Second Language Acquisition: The Effect of Written versus Auditory Materials on the Assessment of Grammatical Competence† , 1992 .

[66]  D Y von Cramon,et al.  Language related brain potentials in patients with cortical and subcortical left hemisphere lesions. , 1999, Brain : a journal of neurology.

[67]  Mark D'Esposito,et al.  Cognitive Association Formation in Human Memory Revealed by Spatiotemporal Brain Imaging , 2001, Neuron.

[68]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[69]  A. Friederici,et al.  Temporal structure of syntactic parsing: early and late event-related brain potential effects. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[70]  Roberto D. Pascual-Marqui,et al.  Functional imaging with low resolution brain electromagnetic tomography (LORETA) : review, new comparisons, and new validation , 2002 .

[71]  A. Friederici,et al.  First-Pass versus Second-Pass Parsing Processes in a Wernicke's and a Broca's Aphasic: Electrophysiological Evidence for a Double Dissociation , 1998, Brain and Language.

[72]  A. Friederici,et al.  Differential task effects on semantic and syntactic processes as revealed by ERPs. , 2002, Brain research. Cognitive brain research.

[73]  Ulrika Kahl,et al.  [The bilingual brain]. , 2002, Lakartidningen.

[74]  Fernanda Ferreira,et al.  Reanalysis in sentence processing , 1998 .

[75]  Susan M. Garnsey,et al.  The Contributions of Verb Bias and Plausibility to the Comprehension of Temporarily Ambiguous Sentences , 1997 .

[76]  Arturo E. Hernandez,et al.  In Search of the Language Switch: An fMRI Study of Picture Naming in Spanish–English Bilinguals , 2000, Brain and Language.

[77]  J. Elman Representation and structure in connectionist models , 1991 .

[78]  C. Clifton,et al.  The independence of syntactic processing , 1986 .

[79]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[80]  Lee Osterhout,et al.  On the Brain Response to Syntactic Anomalies: Manipulations of Word Position and Word Class Reveal Individual Differences , 1997, Brain and Language.

[81]  Stephen M. Smith,et al.  Functional MRI : an introduction to methods , 2002 .

[82]  Isabell Wartenburger,et al.  Early Setting of Grammatical Processing in the Bilingual Brain , 2003, Neuron.

[83]  R. Pascual-Marqui Review of methods for solving the EEG inverse problem , 1999 .

[84]  James L. McClelland,et al.  Sentence comprehension: A parallel distributed processing approach , 1989, Language and Cognitive Processes.

[85]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[86]  A. Dale,et al.  Distinct Patterns of Neural Modulation during the Processing of Conceptual and Syntactic Anomalies , 2003, Journal of Cognitive Neuroscience.

[87]  L. Osterhout,et al.  Brain potentials elicited by prose-embedded linguistic anomalies , 2002, Memory & cognition.

[88]  J. S. Johnson,et al.  Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language , 1989, Cognitive Psychology.

[89]  A M Dale,et al.  Randomized event‐related experimental designs allow for extremely rapid presentation rates using functional MRI , 1998, Neuroreport.

[90]  P. Doyle,et al.  Reconsidering the Hegemony of Linguistic Explanations in Aphasia: The Challenge for the Beginning of the Millennium , 2000, Brain and Language.

[91]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[92]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[93]  M. Chee,et al.  Relative Language Proficiency Modulates BOLD Signal Change when Bilinguals Perform Semantic Judgments , 2001, NeuroImage.

[94]  Michael Bersick,et al.  Brain potentials elicited by words: word length and frequency predict the latency of an early negativity , 1997, Biological Psychology.

[95]  Ravi S. Menon,et al.  Spatial and temporal resolution in fMRI , 2001 .

[96]  W. J. Nowack Neocortical Dynamics and Human EEG Rhythms , 1995, Neurology.

[97]  David Swinney,et al.  Language and the brain : representation and processing , 2000 .

[98]  Shlomo Bentin,et al.  Event-related potentials, semantic processes, and expectancy factors in word recognition , 1987, Brain and Language.

[99]  J. Lewin Functional MRI: An introduction to methods , 2003 .

[100]  D Klein,et al.  Cerebral organization in bilinguals: a PET study of Chinese-English verb generation. , 1999, Neuroreport.

[101]  Emmanuel Dupoux Language, brain, and cognitive development : essays in honor of Jacques Mehler , 2001 .

[102]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[103]  M. Hämäläinen,et al.  Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data , 1989, IEEE Transactions on Biomedical Engineering.

[104]  Gary H. Glover,et al.  Convergent Cortical Representation of Semantic Processing in Bilinguals , 1999, Brain and Language.

[105]  M. L. Lambon Ralph,et al.  Age of acquisition effects in adult lexical processing reflect loss of plasticity in maturing systems: insights from connectionist networks. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[106]  Marcel Adam Just,et al.  An fMRI Study of Bilingual Sentence Comprehension and Workload , 2002, NeuroImage.

[107]  Kim Ainsworth-Darnell,et al.  Dissociating Brain Responses to Syntactic and Semantic Anomalies: Evidence from Event-Related Potentials , 1998 .

[108]  Vicka R. Corey,et al.  On the Language Specificity of the Brain Response to Syntactic Anomalies: Is the Syntactic Positive Shift a Member of the P300 Family? , 1996, Journal of Cognitive Neuroscience.