Event-related Brain Potentials Suggest a Late Interaction of Meter and Syntax in the P600

Many studies refer to the relevance of metric cues in speech segmentation during language acquisition and adult language processing. However, the on-line use (i.e., time-locking the unfolding of a sentence to EEG) of metric stress patterns that are manifested by the succession of stressed and unstressed syllables during auditory syntactic processing has not been investigated. This is surprising as both processes rely on abstract rules that allow the building up of expectancies of which element will occur next and at which point in time. Participants listened to metrically regular sentences that could either be correct, syntactically incorrect, metrically incorrect, or doubly incorrect. They either judged syntactic correctness or metric homogeneity in two different sessions. We provide first event-related potential evidence that the metric structure of a given language is processed in two stages as evidenced in a biphasic pattern of an early frontal negativity and a late posterior positivity. This pattern is comparable to the biphasic pattern reported in syntactic processing. However, metric cues are processed earlier than syntactic cues during the first stage (LAN), whereas both processes seem to interact at a later integrational stage (P600). The present results substantiate the important impact of metric cues during auditory syntactic language processing.

[1]  Anne Cutler,et al.  Competition and segmentation in spoken word recognition , 1994, ICSLP.

[2]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[3]  Gina R. Kuperberg,et al.  Neural mechanisms of language comprehension: Challenges to syntax , 2007, Brain Research.

[4]  G. Dell,et al.  Becoming syntactic. , 2006, Psychological review.

[5]  Daniel Gounot,et al.  Corrélats neurophysiologiques du traitement morphosyntaxique , 2006 .

[6]  Roni Y. Granot,et al.  Differential Brain Response to Metrical Accents in Isochronous Auditory Sequences , 2005 .

[7]  Brigitte Röder,et al.  A new method for detecting interactions between the senses in event-related potentials , 2006, Brain Research.

[8]  H. Kolk,et al.  The interplay of heuristics and parsing routines in sentence comprehension: Evidence from ERPs and reaction times , 2007, Biological Psychology.

[9]  H. Kolk,et al.  Structure and limited capacity in verbal working memory: A study with event-related potentials , 2003, Brain and Language.

[10]  M. Kutas,et al.  Who Did What and When? Using Word- and Clause-Level ERPs to Monitor Working Memory Usage in Reading , 1995, Journal of Cognitive Neuroscience.

[11]  F. Ramus,et al.  Language discrimination by human newborns and by cotton-top tamarin monkeys. , 2000, Science.

[12]  G. Mulder,et al.  When syntax meets semantics. , 1997, Psychophysiology.

[13]  D. Abercrombie,et al.  Elements of General Phonetics , 1967 .

[14]  Manuel Martín-Loeches,et al.  Brain potentials to mathematical syntax problems. , 2006, Psychophysiology.

[15]  A. Friederici,et al.  The brain basis of syntactic processes: functional imaging and lesion studies , 2003, NeuroImage.

[16]  Angela D. Friederici,et al.  Prosody-driven Sentence Processing: An Event-related Brain Potential Study , 2005, Journal of Cognitive Neuroscience.

[17]  B. MacWhinney,et al.  IMPLICIT AND EXPLICIT MEASURES OF SENSITIVITY TO VIOLATIONS IN SECOND LANGUAGE GRAMMAR: An Event-Related Potential Investigation , 2005, Studies in Second Language Acquisition.

[18]  Stefan Frisch Verb-Argument-Struktur, Kasus und thematische Interpretation beim Sprachverstehen , 2000 .

[19]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[20]  A. Friederici,et al.  Syntactic Gender and Semantic Expectancy: ERPs Reveal Early Autonomy and Late Interaction , 2000, Journal of Cognitive Neuroscience.

[21]  Shlomo Bentin,et al.  Syntactic and Semantic Factors in Processing Gender Agreement in Hebrew: Evidence from ERPs and Eye Movements ☆ , 2001 .

[22]  A. Friederici Event-related brain potential studies in language , 2004, Current neurology and neuroscience reports.

[23]  Sonja A. Kotz,et al.  Did you get the beat? Late proficient French-German learners extract strong–weak patterns in tonal but not in linguistic sequences , 2011, NeuroImage.

[24]  P. Fraisse 6 – Rhythm and Tempo , 1982 .

[25]  Neil P. McAngus Todd,et al.  Towards an auditory account of speech rhythm: application of a model of the auditory ‘primal sketch’ to two multi-language corpora , 2004, Cognition.

[26]  S. Kotz,et al.  Event-related potential responses to metric violations: rules versus meaning , 2010, Neuroreport.

[27]  J. Nicol,et al.  On the Distinctiveness, Independence, and Time Course of the Brain Responses to Syntactic and Semantic Anomalies. , 1999 .

[28]  Sonja A. Kotz,et al.  ERP evidence on the interaction of metrical and syntactic processing: The case of the P600 , 2007 .

[29]  Competition in spoken word recognition: Spotting words in other words , 1994 .

[30]  C. Drake,et al.  The “Ticktock” of Our Internal Clock , 2003, Psychological science.

[31]  Angela D. Friederici,et al.  It's Early: Event-related Potential Evidence for Initial Interaction of Syntax and Prosody in Speech Comprehension , 2006, Journal of Cognitive Neuroscience.

[32]  L. Jäncke,et al.  Refinement of metre perception – training increases hierarchical metre processing , 2010, The European journal of neuroscience.

[33]  Franck Ramus,et al.  Perception and acquisition of linguistic rhythm by infants , 2003, Speech Commun..

[34]  R. Kronland-Martinet,et al.  Influence of syllabic lengthening on semantic processing in spoken French: behavioral and electrophysiological evidence. , 2007, Cerebral cortex.

[35]  P. Hagoort,et al.  A superficial resemblance does not necessarily mean you are part of the family : Counterarguments to Coulson, King and Kutas (1998) in the P600/SPS-P300 debate , 1999 .

[36]  D. Barth,et al.  The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex , 1995, Brain Research.

[37]  John F. Kolen,et al.  Resonance and the Perception of Musical Meter , 1994, Connect. Sci..

[38]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[39]  Carolyn Drake Perceptual and performed accents in musical sequences , 1993 .

[40]  M. Schlesewsky,et al.  The processing of German word stress: evidence for the prosodic hierarchy* , 2008, Phonology.

[41]  J. Knott,et al.  Regarding the American Electroencephalographic Society guidelines for standard electrode position nomenclature: a commentary on the proposal to change the 10-20 electrode designators. , 1993, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[42]  Angela D. Friederici,et al.  Two stages in parsing : Early automatic and late controlled processes , 2022 .

[43]  J. Vroomen,et al.  An ERP correlate of metrical stress in spoken word recognition. , 1999, Psychophysiology.

[44]  E. Kaan,et al.  Repair, Revision, and Complexity in Syntactic Analysis: An Electrophysiological Differentiation , 2003, Journal of Cognitive Neuroscience.

[45]  Susanne Uhmann,et al.  Silben- und akzentzählende Sprachen: Literaturüberblick und Diskussion , 1988 .

[46]  Mireille Besson,et al.  Musicians and the Metric Structure of Words , 2011, Journal of Cognitive Neuroscience.

[47]  Robert F. Port,et al.  Rhythmic constraints on stress timing in English , 1998 .

[48]  Markus Jokela,et al.  Event-related potentials suggest early interaction between syntax and semantics during on-line sentence comprehension , 2005, Neuroscience Letters.

[49]  A. Cutler,et al.  Rhythmic cues to speech segmentation: Evidence from juncture misperception , 1992 .

[50]  Lisa D. Sanders,et al.  Lexical, syntactic, and stress-pattern cues for speech segmentation. , 2000, Journal of speech, language, and hearing research : JSLHR.

[51]  A. Friederici,et al.  Electrophysiological Evidence for Two Steps in Syntactic Analysis: Early Automatic and Late Controlled Processes , 1999, Journal of Cognitive Neuroscience.

[52]  P. Holcomb,et al.  Event-Related Brain Potentials Reflect Semantic Priming in an Object Decision Task , 1994, Brain and Cognition.

[53]  H. Kolk,et al.  An ERP study of P600 effects elicited by semantic anomalies. , 2005, Brain research. Cognitive brain research.

[54]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[55]  Alessandra Sansavini,et al.  Neonatal perception of the rhythmical structure of speech: the role of stress patterns , 1997 .

[56]  Helen J. Neville,et al.  Maturational Constraints on the Recruitment of Early Processes for Syntactic Processing , 2011, Journal of Cognitive Neuroscience.

[57]  Douglas Saddy,et al.  Distinct Neurophysiological Patterns Reflecting Aspects of Syntactic Complexity and Syntactic Repair , 2002, Journal of psycholinguistic research.

[58]  Maren Schmidt-Kassow,et al.  Attention and perceptual regularity in speech , 2009, Neuroreport.

[59]  Korinna Eckstein Interaktion von Syntax und Prosodie beim Sprachverstehen: Untersuchungen anhand ereigniskorrelierter Hirnpotentiale , 2007 .

[60]  E. Selkirk On derived domains in sentence phonology , 1986, Phonology.

[61]  Caroline Fery Uni und Studis: die besten Wörter des Deutschen , 1997 .

[62]  R. Jackendoff Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[63]  Peter W. Jusczyk,et al.  How infants begin to extract words from speech , 1999, Trends in Cognitive Sciences.

[64]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[65]  Ulrich Hans Frauenfelder,et al.  The syllable's role in speech segmentation , 1981 .

[66]  P. Friederici Language Comprehension: A Biological Perspective , 1999, Springer Berlin Heidelberg.

[67]  F. Ramus Language discrimination by newborns: Teasing apart phonotactic, rhythmic, and intonational cues , 2002 .

[68]  Louisa M. Slowiaczek,et al.  Effects of Lexical Stress in Auditory Word Recognition , 1990, Language and speech.

[69]  Z. Harris,et al.  Foundations of language , 1941 .

[70]  M. Besson,et al.  AN EVENT-RELATED POTENTIAL (ERP) STUDY OF MUSICAL EXPECTANCY : COMPARISON OF MUSICIANS WITH NONMUSICIANS , 1995 .

[71]  M. Pitt,et al.  The use of rhythm in attending to speech. , 1990, Journal of experimental psychology. Human perception and performance.

[72]  A. Cutler Phoneme-monitoring reaction time as a function of preceding intonation contour , 1976 .

[73]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[74]  Anne Cutler,et al.  The predominance of strong initial syllables in the English vocabulary , 1987 .

[75]  Satoru Saito,et al.  Rhythmic information in working memory: Effects of concurrent articulation on reproduction of rhythms. , 1998 .

[76]  C. Drake,et al.  The Quest for Universals in Temporal Processing in Music , 2001, Annals of the New York Academy of Sciences.

[77]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[78]  Michael Gasser,et al.  Meter as Mechanism: A Neural Network Model that Learns Metrical Patterns , 1999, Connect. Sci..

[79]  Hugo Quené,et al.  Effects of Timing Regularity and Metrical Expectancy on Spoken-Word Perception , 2005, Phonetica.

[80]  H Quené,et al.  Segment durations and accent as cues to word segmentation in Dutch. , 1993, The Journal of the Acoustical Society of America.

[81]  L L Cuddy,et al.  Effects of metric and harmonic rhythm on the detection of pitch alterations in melodic sequences. , 1989, Journal of experimental psychology. Human perception and performance.

[82]  A. Samuel,et al.  How lexical stress affects speech segmentation and interactivity : Evidence from the migration paradigm , 1997 .

[83]  Angela D. Friederici,et al.  Brain potentials indicate immediate use of prosodic cues in natural speech processing , 1999, Nature Neuroscience.

[84]  Peter Eisenberg,et al.  Syllabische Struktur und Wortakzent. Prinzipien der Prosodik deutscher Wörter , 1991 .

[85]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[86]  A. Friederici The Time Course of Syntactic Activation During Language Processing: A Model Based on Neuropsychological and Neurophysiological Data , 1995, Brain and Language.

[87]  Anne Cutler,et al.  The perception of rhythm in language , 1994, Cognition.

[88]  A. Friederici,et al.  Lexical integration: Sequential effects of syntactic and semantic information , 1999, Memory & cognition.

[89]  Manuel Carreiras,et al.  An ERP study of agreement features in Spanish , 2007, Brain Research.

[90]  M. Kutas,et al.  Expect the Unexpected: Event-related Brain Response to Morphosyntactic Violations , 1998 .

[91]  P C Gordon,et al.  Coming to terms with stress: Effects of stress location in sentence processing , 1993, Journal of psycholinguistic research.

[92]  Karsten Steinhauer Electrophysiological correlates of prosody and punctuation , 2003, Brain and Language.

[93]  A. Friederici,et al.  Concerning the automaticity of syntactic processing. , 1999, Psychophysiology.

[94]  H. Quené,et al.  Metrical Segmentation in Dutch: Vowel Quality or Stress? , 1998, Language and speech.

[95]  Jutta L. Mueller,et al.  The Role of Pause Cues in Language Learning: The Emergence of Event-related Potentials Related to Sequence Processing , 2008, Journal of Cognitive Neuroscience.

[96]  J. W. Aldridge,et al.  Sequential super-stereotypy of an instinctive fixed action pattern in hyper-dopaminergic mutant mice: a model of obsessive compulsive disorder and Tourette's , 2005, BMC Biology.

[97]  Peter Ford Dominey,et al.  ERP analysis of cognitive sequencing: a left anterior negativity related to structural transformation processing , 2000, Neuroreport.

[98]  Anne Cutler,et al.  The role of strong syllables in segmentation for lexical access , 1988 .

[99]  L. Osterhout,et al.  Morphological analysis in sentence processing: An ERP study , 2003 .