Syntactic Computations in the Language Network: Characterizing Dynamic Network Properties Using Representational Similarity Analysis

The core human capacity of syntactic analysis involves a left hemisphere network involving left inferior frontal gyrus (LIFG) and posterior middle temporal gyrus (LMTG) and the anatomical connections between them. Here we use magnetoencephalography (MEG) to determine the spatio-temporal properties of syntactic computations in this network. Listeners heard spoken sentences containing a local syntactic ambiguity (e.g., “… landing planes …”), at the offset of which they heard a disambiguating verb and decided whether it was an acceptable/unacceptable continuation of the sentence. We charted the time-course of processing and resolving syntactic ambiguity by measuring MEG responses from the onset of each word in the ambiguous phrase and the disambiguating word. We used representational similarity analysis (RSA) to characterize syntactic information represented in the LIFG and left posterior middle temporal gyrus (LpMTG) over time and to investigate their relationship to each other. Testing a variety of lexico-syntactic and ambiguity models against the MEG data, our results suggest early lexico-syntactic responses in the LpMTG and later effects of ambiguity in the LIFG, pointing to a clear differentiation in the functional roles of these two regions. Our results suggest the LpMTG represents and transmits lexical information to the LIFG, which responds to and resolves the ambiguity.

[1]  E. Kaan,et al.  Repair, Revision, and Complexity in Syntactic Analysis: An Electrophysiological Differentiation , 2003, Journal of Cognitive Neuroscience.

[2]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[3]  Lorraine K Tyler,et al.  Fronto-temporal brain systems supporting spoken language comprehension , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Timothy E. J. Behrens,et al.  The evolution of the arcuate fasciculus revealed with comparative DTI , 2008, Nature Neuroscience.

[5]  A. Friederici,et al.  Electrophysiological Evidence for Two Steps in Syntactic Analysis: Early Automatic and Late Controlled Processes , 1999, Journal of Cognitive Neuroscience.

[6]  W. Marslen-Wilson,et al.  The temporal structure of spoken language understanding , 1980, Cognition.

[7]  Susan M. Garnsey,et al.  The Contributions of Verb Bias and Plausibility to the Comprehension of Temporarily Ambiguous Sentences , 1997 .

[8]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[9]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[10]  Ted Briscoe,et al.  A Large Subcategorization Lexicon for Natural Language Processing Applications , 2006, LREC.

[11]  Billi Randall,et al.  Getting to the Meaning of the Regular Past Tense: Evidence from Neuropsychology , 2005, Journal of Cognitive Neuroscience.

[12]  S. Taulu,et al.  Applications of the signal space separation method , 2005, IEEE Transactions on Signal Processing.

[13]  A. Friederici,et al.  Lateralization of auditory language functions: A dynamic dual pathway model , 2004, Brain and Language.

[14]  William D. Marslen-Wilson,et al.  Is left fronto-temporal connectivity essential for syntax? Effective connectivity, tractography and performance in left-hemisphere damaged patients , 2011, NeuroImage.

[15]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[16]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[17]  Lorraine K. Tyler,et al.  Dynamic Processing in the Human Language System: Synergy between the Arcuate Fascicle and Extreme Capsule , 2011, The Journal of Neuroscience.

[18]  Emily B. Myers,et al.  Neural Correlates of Semantic Competition during Processing of Ambiguous Words , 2009, Journal of Cognitive Neuroscience.

[19]  Paola Merlo,et al.  A corpus-based analysis of verb continuation frequencies for syntactic processing , 1994 .

[20]  William D. Marslen-Wilson,et al.  Left inferior frontal cortex and syntax: function, structure and behaviour in patients with left hemisphere damage , 2011, Brain : a journal of neurology.

[21]  Y. Grodzinsky The neurology of syntax: Language use without Broca's area , 2000, Behavioral and Brain Sciences.

[22]  Karl J. Friston,et al.  Design and analysis of fMRI studies with neurologically impaired patients , 2006, Journal of magnetic resonance imaging : JMRI.

[23]  D. T. Ives,et al.  Bihemispheric foundations for human speech comprehension , 2010, Proceedings of the National Academy of Sciences.

[24]  Peter Hagoort,et al.  Retrieval and unification of syntactic structure in sentence comprehension: an FMRI study using word-category ambiguity. , 2009, Cerebral cortex.

[25]  Kara D. Federmeier Thinking ahead: the role and roots of prediction in language comprehension. , 2007, Psychophysiology.

[26]  P. Zwitserlood The locus of the effects of sentential-semantic context in spoken-word processing , 1989, Cognition.

[27]  David Badre,et al.  Selection, Integration, and Conflict Monitoring Assessing the Nature and Generality of Prefrontal Cognitive Control Mechanisms , 2004, Neuron.

[28]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[29]  Colin M. Brown,et al.  The syntactic positive shift (sps) as an erp measure of syntactic processing , 1993 .

[30]  Todd B. Parrish,et al.  Neural Correlates of Verb Argument Structure Processing , 2007, Journal of Cognitive Neuroscience.

[31]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[32]  Peter Hagoort,et al.  Effective connectivity of cortical and subcortical regions during unification of sentence structure , 2010, NeuroImage.

[33]  Frank Keller,et al.  Verb Frame Frequency as a Predictor of Verb Bias , 2001, Journal of psycholinguistic research.

[34]  WILLIAM MARSLEN-WILSON,et al.  Linguistic Structure and Speech Shadowing at Very Short Latencies , 1973, Nature.

[35]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[36]  Meredith A. Shafto,et al.  Preserving Syntactic Processing across the Adult Life Span: The Modulation of the Frontotemporal Language System in the Context of Age-Related Atrophy , 2009, Cerebral cortex.

[37]  Li Su,et al.  Spatiotemporal Searchlight Representational Similarity Analysis in EMEG Source Space , 2012, 2012 Second International Workshop on Pattern Recognition in NeuroImaging.

[38]  Lesley K. Fellows,et al.  Method Matters: An Empirical Study of Impact in Cognitive Neuroscience , 2005, Journal of Cognitive Neuroscience.

[39]  Sophie K. Scott,et al.  The functional neuroanatomy of prelexical processing in speech perception , 2004, Cognition.

[40]  Ellen F. Lau,et al.  The role of structural prediction in rapid syntactic analysis , 2006, Brain and Language.

[41]  Jennifer M. Rodd,et al.  The functional organisation of the fronto-temporal language system: Evidence from syntactic and semantic ambiguity , 2010, Neuropsychologia.

[42]  Matthew A. Lambon Ralph,et al.  Lateralization of ventral and dorsal auditory-language pathways in the human brain , 2005, NeuroImage.

[43]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[44]  William D. Marslen-Wilson,et al.  The On-Line Effects of Semantic Context on Syntactic Processing , 1977 .

[45]  William D. Marslen-Wilson,et al.  The Interaction of Lexical Semantics and Cohort Competition in Spoken Word Recognition: An fMRI Study , 2011, Journal of Cognitive Neuroscience.

[46]  M. Jung-Beeman Bilateral brain processes for comprehending natural language , 2005, Trends in Cognitive Sciences.

[47]  Anne Cutler,et al.  Prelexical and lexical processing in listening , 2004 .

[48]  W. Marslen-Wilson Functional parallelism in spoken word-recognition , 1987, Cognition.

[49]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[50]  Anjan Chatterjee,et al.  A Madness to the Methods in Cognitive Neuroscience? , 2005, Journal of Cognitive Neuroscience.

[51]  Emmanuel A Stamatakis,et al.  Functional organization of the neural language system: dorsal and ventral pathways are critical for syntax. , 2013, Cerebral cortex.

[52]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[53]  R. Wise,et al.  Temporal lobe regions engaged during normal speech comprehension. , 2003, Brain : a journal of neurology.

[54]  William D. Marslen-Wilson,et al.  Lexical Representations in Spoken Language Comprehension , 1988 .

[55]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[56]  Alfred Anwander,et al.  Neuroanatomical prerequisites for language functions in the maturing brain. , 2011, Cerebral cortex.

[57]  Billi Randall,et al.  Cortical Differentiation for Nouns and Verbs Depends on Grammatical Markers , 2008, Journal of Cognitive Neuroscience.

[58]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[59]  William D. Marslen-Wilson,et al.  Dissociating Linguistic and Task-related Activity in the Left Inferior Frontal Gyrus , 2011, Journal of Cognitive Neuroscience.