Sentence processing in the visual and auditory modality: Do comma and prosodic break have parallel functions?

Two Event-Related Potential (ERP) studies contrast the processing of locally ambiguous sentences in the visual and the auditory modality. These sentences are disambiguated by a lexical element. Before this element appears in a sentence, the sentence can also be disambiguated by a boundary marker: a comma in the visual modality, or a prosodic break in the auditory modality. Previous studies have shown that a specific ERP component, the Closure Positive Shift (CPS), can be elicited by these markers. The results of the present studies show that both the comma and the prosodic break disambiguate the ambiguous sentences before the critical lexical element, despite the fact that a clear CPS is only found in the auditory modality. Comma and prosodic break thus have parallel functions irrespective of whether they do or do not elicit a CPS.

[1]  D. Swinney,et al.  Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Colin M. Brown,et al.  When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. , 2003, Brain research. Cognitive brain research.

[3]  Herbert Schriefers,et al.  The Interplay between Prosody and Syntax in Sentence Processing: The Case of Subject- and Object-control Verbs , 2010, Journal of Cognitive Neuroscience.

[4]  A D Friederici,et al.  Prosodic Boundaries, Comma Rules, and Brain Responses: The Closure Positive Shift in ERPs as a Universal Marker for Prosodic Phrasing in Listeners and Readers , 2001, Journal of psycholinguistic research.

[5]  Karsten Steinhauer.  Electrophysiological correlates of prosody and punctuation , 2003, Brain and Language.

[6]  Anja Hahne,et al.  Event-Related Brain Potentials While Encountering Semantic and Syntactic Constraint Violations , 1993, Journal of Cognitive Neuroscience.

[7]  M. Balconi,et al.  Comprehending Semantic and Grammatical Violations in Italian. N400 and P600 Comparison with Visual and Auditory Stimuli , 2005, Journal of psycholinguistic research.

[8]  Colin M. Brown,et al.  The Mechanism Underlying Backward Priming in a Lexical Decision Task: Spreading Activation versus Semantic Matching , 1998 .

[9]  Colin M. Brown,et al.  ERP effects of listening to speech: semantic ERP effects , 2000, Neuropsychologia.

[10]  Ulrike Toepel,et al.  Catching the news: Processing strategies in listening to dialogs as measured by ERPs , 2007, Behavioral and Brain Functions.

[11]  Lyn Frazier,et al.  Syntactic processing: Evidence from dutch , 1987 .

[12]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[13]  A. Friederici.  Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[14]  Lee Osterhout,et al.  Constraints on Movement Phenomena in Sentence Processing: Evidence from Event-related Brain Potentials , 1996 .

[15]  M. Kutas,et al.  ERPs and Domain Specificity: Beating a Straw Horse , 1998 .

[16]  Ulrike Toepel,et al.  Inadequate and infrequent are not alike: ERPs to deviant prosodic patterns in spoken sentence comprehension , 2008, Brain and Language.

[17]  Angela D. Friederici,et al.  Influence of Prosodic Information on the Processing of Split Particles: ERP Evidence from Spoken German , 2005, Journal of Cognitive Neuroscience.

[18]  E. Kaan,et al.  Repair, Revision, and Complexity in Syntactic Analysis: An Electrophysiological Differentiation , 2003, Journal of Cognitive Neuroscience.

[19]  A. Friederici,et al.  Temporal structure of syntactic parsing: early and late event-related brain potential effects. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[20]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[21]  Colin M. Brown,et al.  ERP effects of listening to speech compared to reading: the P600/SPS to syntactic violations in spoken sentences and rapid serial visual presentation , 2000, Neuropsychologia.

[22]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[23]  H. Kolk,et al.  An ERP study of P600 effects elicited by semantic anomalies. , 2005, Brain research. Cognitive brain research.

[24]  Colin M. Brown,et al.  Early referential context effects in sentence processing: Evidence from event-related brain potentials , 1999 .

[25]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[26]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[27]  Matthias Schlesewsky,et al.  Context-sensitive neural responses to conflict resolution: Electrophysiological evidence from subject–object ambiguities in language comprehension , 2006, Brain Research.

[28]  A. Friederici.  The Time Course of Syntactic Activation During Language Processing: A Model Based on Neuropsychological and Neurophysiological Data , 1995, Brain and Language.

[29]  Kai Alter,et al.  Processing prosodic boundaries in natural and hummed speech: an FMRI study. , 2008, Cerebral cortex.

[30]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[31]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[32]  Herbert Schriefers,et al.  Journal of Memory and Language , 2001 .

[33]  L. Osterhout,et al.  The independence of combinatory semantic processing: Evidence from event-related potentials , 2005 .

[34]  Herbert Schriefers,et al.  Discourse, Syntax, and Prosody: The Brain Reveals an Immediate Interaction , 2007, Journal of Cognitive Neuroscience.

[35]  Janet D. Fodor.  Prosodic disambiguation in silent deading , 2002 .

[36]  Douglas Saddy,et al.  Distinct Neurophysiological Patterns Reflecting Aspects of Syntactic Complexity and Syntactic Repair , 2002, Journal of psycholinguistic research.

[37]  Albert Kim,et al.  Sentences in the Brain: Event-Related Potentials as Real-Time Reflections of Sentence Comprehension and Language Learning , 2004 .

[38]  Angela D. Friederici,et al.  Brain potentials indicate immediate use of prosodic cues in natural speech processing , 1999, Nature Neuroscience.

[39]  H. Neville,et al.  Natural speech processing: An analysis using event-related brain potentials , 1991, Psychobiology.

[40]  T C Gunter,et al.  Working memory constraints on syntactic processing: an electrophysiological investigation. , 2001, Psychophysiology.

[41]  Stefanie Shattuck-Hufnagel,et al.  A prosody tutorial for investigators of auditory sentence processing , 1996, Journal of psycholinguistic research.

[42]  Colin M. Brown,et al.  The neurocognition of language , 2000 .

[43]  Marie T. Banich,et al.  Mind, Brain, and Language : Multidisciplinary Perspectives , 2003 .

[44]  O. Witte,et al.  Perception of phrase structure in music , 2005, Human brain mapping.

[45]  J. Thayer,et al.  The continuing problem of false positives in repeated measures ANOVA in psychophysiology: a multivariate solution. , 1987, Psychophysiology.

[46]  C. Clifton,et al.  The On-line Study of Sentence Comprehension: Eyetracking, ERPs and Beyond , 2004 .

[47]  Carlos Gussenhoven,et al.  Transcription of Dutch intonation , 2005 .

[48]  M. Kutas,et al.  Who Did What and When? Using Word- and Clause-Level ERPs to Monitor Working Memory Usage in Reading , 1995, Journal of Cognitive Neuroscience.

[49]  A. Friederici,et al.  Differential task effects on semantic and syntactic processes as revealed by ERPs. , 2002, Brain research. Cognitive brain research.

[50]  Angela D. Friederici,et al.  Prosody-driven Sentence Processing: An Event-related Brain Potential Study , 2005, Journal of Cognitive Neuroscience.

[51]  Colin M. Brown,et al.  Semantic Integration in Sentences and Discourse: Evidence from the N400 , 1999, Journal of Cognitive Neuroscience.

[52]  Colin M. Brown,et al.  Processing the NP- versus S-Coordination Ambiguity: Thematic Information Does not Completely Eliminate Processing Difficulty , 2005 .

[53]  A. Friederici,et al.  Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. , 1993, Brain research. Cognitive brain research.

[54]  A. Friederici,et al.  Lexical integration: Sequential effects of syntactic and semantic information , 1999, Memory & cognition.