Interplay between Syntax and Semantics during Sentence Comprehension: ERP Effects of Combining Syntactic and Semantic Violations

This study investigated the effects of combined semantic and syntactic violations in relation to the effects of single semantic and single syntactic violations on language-related event-related brain potential (ERP) effects (N400 and P600/ SPS). Syntactic violations consisted of a mismatch in grammatical gender or number features of the definite article and the noun in sentence-internal or sentence-final noun phrases (NPs). Semantic violations consisted of semantically implausible adjectivenoun combinations in the same NPs. Combined syntactic and semantic violations were a summation of these two respective violation types. ERPs were recorded while subjects read the sentences with the different types of violations and the correct control sentences. ERP effects were computed relative to ERPs elicited by the sentence-internal or sentence-final nouns. The size of the N400 effect to the semantic violation was increased by an additional syntactic violation (the syntactic boost). In contrast, the size of the P600/ SPS to the syntactic violation was not affected by an additional semantic violation. This suggests that in the absence of syntactic ambiguity, the assignment of syntactic structure is independent of semantic context. However, semantic integration is influenced by syntactic processing. In the sentence-final position, additional global processing consequences were obtained as a result of earlier violations in the sentence. The resulting increase in the N400 amplitude to sentence-final words was independent of the nature of the violation. A speeded anomaly detection task revealed that it takes substantially longer to detect semantic than syntactic anomalies. These results are discussed in relation to the latency and processing characteristics of the N400 and P600/SPS effects. Overall, the results reveal an asymmetry in the interplay between syntax and semantics during on-line sentence comprehension.

[1]  William D. Marslen-Wilson,et al.  The On-Line Effects of Semantic Context on Syntactic Processing , 1977 .

[2]  Angela D. Friederici,et al.  The Processing of Locally Ambiguous Relative Clauses in German , 1995 .

[3]  Colin M. Brown,et al.  The syntactic positive shift (sps) as an erp measure of syntactic processing , 1993 .

[4]  Peter Hagoort,et al.  The neurocognition of syntactic processing , 1999 .

[5]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[6]  Willem J. M. Levelt,et al.  Producing spoken language: A blueprint of the speaker , 1999 .

[7]  Julie E. Boland,et al.  Interaction with autonomy: Multiple Output models and the inadequacy of the Great Divide , 1996, Cognition.

[8]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[9]  M. Kutas,et al.  Anticipating Words and Their Gender: An Event-related Brain Potential Study of Semantic Integration, Gender Expectancy, and Gender Agreement in Spanish Sentence Reading , 2004, Journal of Cognitive Neuroscience.

[10]  Peter Hagoort,et al.  How the brain solves the binding problem for language: a neurocomputational model of syntactic processing , 2003, NeuroImage.

[11]  William D. Marslen-Wilson,et al.  Access and integration: projecting sound onto meaning , 1989 .

[12]  H. Heinze,et al.  ERP Negativities During Syntactic Processing of Written Words , 1994 .

[13]  A. Friederici,et al.  Temporal structure of syntactic parsing: early and late event-related brain potential effects. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[14]  Colin M. Brown,et al.  Semantic Integration in Sentences and Discourse: Evidence from the N400 , 1999, Journal of Cognitive Neuroscience.

[15]  Peter Hagoort,et al.  Word-category violations in patients with Broca’s aphasia: An ERP study , 2005, Brain and Language.

[16]  Mark Steedman,et al.  Interaction with context during human sentence processing , 1988, Cognition.

[17]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[18]  Manuel Carreiras,et al.  Early Event-related Potential Effects of Syllabic Processing during Visual Word Recognition , 2005, Journal of Cognitive Neuroscience.

[19]  Lyn Frazier,et al.  Sentence processing: A tutorial review. , 1987 .

[20]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[21]  R. Jackendoff.  Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[22]  P Hagoort,et al.  Gender Electrified: ERP Evidence on the Syntactic Nature of Gender Processing , 1999, Journal of psycholinguistic research.

[23]  Lee Osterhout,et al.  Event-related brain potentials and human language , 1997, Trends in Cognitive Sciences.

[24]  Colin M. Brown,et al.  Syntax-related ERP-effects in Dutch. , 2003, Brain research. Cognitive brain research.

[25]  Ray Jackendoff,et al.  The representational structures of the language faculty and their interactions , 2000 .

[26]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[27]  P. Hagoort,et al.  A superficial resemblance does not necessarily mean you are part of the family : Counterarguments to Coulson, King and Kutas (1998) in the P600/SPS-P300 debate , 1999 .

[28]  A. Friederici,et al.  Lexical integration: Sequential effects of syntactic and semantic information , 1999, Memory & cognition.

[29]  G. Mulder,et al.  When syntax meets semantics. , 1997, Psychophysiology.

[30]  Anne Lacheret,et al.  On-line Processing of Pop-Out Words in Spoken French Dialogues , 2005, Journal of Cognitive Neuroscience.

[31]  Hans-Jochen Heinze,et al.  Dissociation of Brain Activity Related to Syntactic and Semantic Aspects of Language , 1993, Journal of Cognitive Neuroscience.

[32]  M. Tanenhaus,et al.  Verb-specific constraints in sentence processing: Separating effects of lexical preference from garden-paths. , 1993 .

[33]  E. Donchin,et al.  Psychophysiology : systems, processes, and applications , 1987 .

[34]  Thomas F. Mnte,et al.  Brain Activity Associated with Syntactic Incongruencies in Words and Pseudo-Words , 1997, Journal of Cognitive Neuroscience.

[35]  J. Nicol,et al.  On the Distinctiveness, Independence, and Time Course of the Brain Responses to Syntactic and Semantic Anomalies. , 1999 .

[36]  B. J. Winer,et al.  Statistical Principles in Experimental Design, 2nd Edition. , 1973 .

[37]  Colin M. Brown,et al.  The N400 as a function of the level of processing. , 1995, Psychophysiology.

[38]  Peter Hagoort,et al.  On the electrophysiology of language comprehension: Implications for the human language system , 2000 .

[39]  Isabell Wartenburger,et al.  Neural correlates of syntactic transformations , 2004, Human brain mapping.

[40]  E. Bates,et al.  When zebras become painted donkeys: Grammatical gender and semantic priming interact during picture integration in a spoken Spanish sentence , 2005, Language and cognitive processes.

[41]  Peter Hagoort,et al.  The Processing Nature of the N400: Evidence from Masked Priming , 1993, Journal of Cognitive Neuroscience.

[42]  P. Hagoort,et al.  The Influence of Semantic and Syntactic Context Constraints on Lexical Selection and Integration in Spoken-Word Comprehension as Revealed by ERPs , 2004, Journal of Cognitive Neuroscience.

[43]  D. Mitchell,et al.  The Effects of Context and Content on Immediate Processing in Reading , 1978 .

[44]  P G O'Seaghdha.  Conjoint and dissociable effects of syntactic and semantic context. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[45]  William D. Marslen-Wilson,et al.  Lexical Representation and Process , 1991 .

[46]  Angela D. Friederici,et al.  When word category information encounters morphosyntax: An ERP study , 2005, Neuroscience Letters.

[47]  Michael D. Rugg,et al.  The ERP and cognitive psychology: Conceptual issues. , 1995 .

[48]  D. Swinney,et al.  Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[49]  J. Fodor,et al.  Reply to Block and Boghossian , 1993 .

[50]  Kim Ainsworth-Darnell,et al.  Dissociating Brain Responses to Syntactic and Semantic Anomalies: Evidence from Event-Related Potentials , 1998 .

[51]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[52]  Arthur F. Kramer,et al.  Principles of signal acquisition and analysis , 1986 .

[53]  Markus Jokela,et al.  Event-related potentials suggest early interaction between syntax and semantics during on-line sentence comprehension , 2005, Neuroscience Letters.

[54]  G. Kempen,et al.  Syntactic structure assembly in human parsing: a computational model based on competitive inhibition and a lexicalist grammar , 2000, Cognition.

[55]  M. Rugg,et al.  Electrophysiology of Mind: Event-Related Brain Potentials and Cognition , 1995 .

[56]  Weijia Ni,et al.  Sidestepping garden paths: Assessing the contributions of syntax, semantics and plausibility in resolving ambiguities , 1996 .

[57]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[58]  Christopher T. Kello,et al.  Verb-specific constraints in sentence processing: separating effects of lexical preference from garden-paths. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[59]  Colin M. Brown,et al.  Early referential context effects in sentence processing: Evidence from event-related brain potentials , 1999 .