Prosodic Boundaries, Comma Rules, and Brain Responses: The Closure Positive Shift in ERPs as a Universal Marker for Prosodic Phrasing in Listeners and Readers

Just as the false comma in this sentence, shows punctuation can influence sentence processing considerably. Pauses and other prosodic cues in spoken language serve the same function of structuring the sentence in smaller phrases. However, surprisingly little effort has been spent on the question as to whether both phenomena rest on the same mechanism and whether they are equally efficient in guiding parsing decisions. In a recent study, we showed that auditory speech boundaries evoke a specific positive shift in the listeners' event-related brain potentials (ERPs) that indicates the sentence segmentation and resulting changes in the understanding of the utterance (Steinhauer et al., 1999a). Here, we present three ERP reading experiments demonstrating that the human brain processes commas in a similar manner and that comma perception depends crucially on the reader's individual punctuation habits. Main results of the study are: (1) Commas can determine initial parsing as efficiently as speech boundaries because they trigger the same prosodic phrasing covertly, although phonological representations seem to be activated to a lesser extent. (2) Independent of the input modality, this phrasing is reflected online by the same ERP component, namely the Closure Positive Shift (CPS). (3) Both behavioral and ERP data suggest that comma processing varies with the readers' idiosyncratic punctuation habits. (4) A combined auditory and visual ERP experiment shows that the CPS is also elicited both by delexicalized prosody and while subjects replicate prosodic boundaries during silent reading. (5) A comma-induced reversed garden path turned out to be much more difficult than the classical garden path. Implications for psycholinguistic models and future ERP research are discussed.

[1]  Markus Bader,et al.  Prosodic Influences on Reading Syntactically Ambiguous Sentences , 1998 .

[2]  Colin M. Brown,et al.  The N400 as a function of the level of processing. , 1995, Psychophysiology.

[3]  A D Friederici,et al.  Processing relative clauses varying on syntactic and semantic dimensions: An analysis with event-related potentials , 1995, Memory & cognition.

[4]  J. Henderson,et al.  Recovery from misanalyses of garden-path sentences ☆ , 1991 .

[5]  James Coady,et al.  Psycholinguistic Approaches to a Theory of Punctuation , 1978 .

[6]  Markus Bader,et al.  Subject-Object Ambiguities in German Embedded Clauses: An Across-the-Board Comparison , 1999 .

[7]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[8]  Daniel C. O'Connell,et al.  Use of punctuation for pausing: Oral readings by German radio homilists , 1986 .

[9]  Mari Ostendorf,et al.  TOBI: a standard for labeling English prosody , 1992, ICSLP.

[10]  William D. Marslen-Wilson,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1992,45A (1) 73-87 Prosodic Effects in Minimal Attachment , 2022 .

[11]  M. Kutas,et al.  Expect the Unexpected: Event-related Brain Response to Morphosyntactic Violations , 1998 .

[12]  C. Perfetti Psycholinguistics and reading ability. , 1994 .

[13]  R. Ratcliff,et al.  Reliability of prosodic cues for resolving syntactic ambiguity. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[14]  M. Kjelgaard,et al.  Prosodic Facilitation and Interference in the Resolution of Temporary Syntactic Closure Ambiguity , 1999 .

[15]  A. Friederici,et al.  Lexical integration: Sequential effects of syntactic and semantic information , 1999, Memory & cognition.

[16]  Maryellen C. MacDonald,et al.  Probabilistic constraints and syntactic ambiguity resolution , 1994 .

[17]  D. Share Phonological recoding and orthographic learning: A direct test of the self-teaching hypothesis. , 1999, Journal of experimental child psychology.

[18]  L. Streeter Acoustic determinants of phrase boundary perception. , 1978, The Journal of the Acoustical Society of America.

[19]  Michael Meng,et al.  Mode of Disambiguation and Garden-Path Strength: An Investigation of Subject-Object Ambiguities in German , 2000 .

[20]  Janet Dean Fodor,et al.  The diagnosis and cure of garden paths , 1994 .

[21]  Mary E. Beckman,et al.  The Parsing of Prosody , 1996 .

[22]  Angela D. Friederici,et al.  De-accentuation: linguistic environments and prosodic realizations , 1998, ICSLP.

[23]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[24]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[25]  A. Friederici,et al.  Verb Argument Structure Processing: The Role of Verb-Specific and Argument-Specific Information☆☆☆ , 2000 .

[26]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[27]  Frontiers of Brain Mapping of Speech Prosody , 2000, Brain and Language.

[28]  Veronika Coltheart,et al.  Phonological processes in reading: A tutorial review. , 1987 .

[29]  P. Bryant,et al.  Difficulties in auditory organisation as a possible cause of reading backwardness , 1978, Nature.

[30]  A D Friederici,et al.  Syntactic parsing as revealed by brain responses: First-pass and second-pass parsing processes , 1996, Journal of psycholinguistic research.

[31]  P. Bruthiaux,et al.  Knowing when to stop: Investigating the nature of punctuation , 1993 .

[32]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[33]  R. Johnson,et al.  On the neural generators of the P300 component of the event-related potential. , 2007, Psychophysiology.

[34]  S R Speer,et al.  The influence of prosodic structure on the resolution of temporary syntactic closure ambiguities , 1996, Journal of psycholinguistic research.

[35]  M. Pell,et al.  The neural bases of prosody: Insights from lesion studies and neuroimaging , 1999 .

[36]  V. M. Holmes,et al.  The role of specific information about the verb in parsing sentences with local structural ambiguity , 1985 .

[37]  Martin Meyer,et al.  Working memory constraints on syntactic ambiguity resolution as revealed by electrical brain responses , 1998, Biological Psychology.

[38]  Lyn Frazier,et al.  Sentence processing: A tutorial review. , 1987 .

[39]  Paul Gorrell Syntax and Parsing , 1995 .

[40]  Angela D. Friederici,et al.  Brain potentials indicate immediate use of prosodic cues in natural speech processing , 1999, Nature Neuroscience.

[41]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[42]  Angela D. Friederici,et al.  Don't blame it (all) on the pause: further ERP evidence for a prosody-induced garden-path in running speech , 1998, ICSLP.

[43]  Ann Cutler,et al.  Prosody in the Comprehension of Spoken Language: A Literature Review , 1997, Language and speech.

[44]  Janet Dean Fodor,et al.  Learning To Parse? , 1998 .

[45]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[46]  G. Mulder,et al.  When syntax meets semantics. , 1997, Psychophysiology.

[47]  Joël Pynte,et al.  Prosodic Breaks and Attachment Decisions in Sentence Parsing. , 1996 .

[48]  Cheryl M. Beach,et al.  The interpretation of prosodic patterns at points of syntactic structure ambiguity: Evidence for cue trading relations☆ , 1991 .

[49]  Elisabeth Selkirk,et al.  Phonology and Syntax: The Relation between Sound and Structure , 1984 .

[50]  P. Hagoort,et al.  A superficial resemblance does not necessarily mean you are part of the family : Counterarguments to Coulson, King and Kutas (1998) in the P600/SPS-P300 debate , 1999 .

[51]  M. Kutas,et al.  Influences of semantic and syntactic context on open- and closed-class words , 1991, Memory & cognition.

[52]  Paul Bloom,et al.  Speech boundaries, syntax and the brain , 1999, Nature Neuroscience.

[53]  E Donchin,et al.  Syntactic parsing preferences and their on-line revisions: a spatio-temporal analysis of event-related brain potentials. , 2001, Brain research. Cognitive brain research.

[54]  A J Schafer,et al.  Intonational Disambiguation in Sentence Production and Comprehension , 2000, Journal of psycholinguistic research.

[55]  W. Chafe Punctuation and the Prosody of Written Language , 1988 .

[56]  A. Friederici The Time Course of Syntactic Activation During Language Processing: A Model Based on Neuropsychological and Neurophysiological Data , 1995, Brain and Language.

[57]  Angela D. Friederici,et al.  Wahrscheinlichkeit und Strategie: Eine EKP-Studie zur verarbeitung syntaktischer anomalien = Probability and strategy: An ERP study on the processing of syntactic anomalies , 1997 .

[58]  William E. Cooper,et al.  Syntax and Speech , 1980 .

[59]  Thomas Portele,et al.  PURR - A method for prosody evaluation and investigation , 1998, Comput. Speech Lang..

[60]  W S Murray,et al.  Prosodic form and parsing commitments , 1996, Journal of psycholinguistic research.

[61]  E. Grabe,et al.  Prosody, phonology and parsing in closure ambiguities , 1995 .

[62]  J. Hopf,et al.  Event-Related Brain Potentials and Case Information in Syntactic Ambiguities , 1998, Journal of Cognitive Neuroscience.

[63]  Colin M. Brown,et al.  The syntactic positive shift (sps) as an erp measure of syntactic processing , 1993 .