Cortical representation of the constituent structure of sentences

Linguistic analyses suggest that sentences are not mere strings of words but possess a hierarchical structure with constituents nested inside each other. We used functional magnetic resonance imaging (fMRI) to search for the cerebral mechanisms of this theoretical construct. We hypothesized that the neural assembly that encodes a constituent grows with its size, which can be approximately indexed by the number of words it encompasses. We therefore searched for brain regions where activation increased parametrically with the size of linguistic constituents, in response to a visual stream always comprising 12 written words or pseudowords. The results isolated a network of left-hemispheric regions that could be dissociated into two major subsets. Inferior frontal and posterior temporal regions showed constituent size effects regardless of whether actual content words were present or were replaced by pseudowords (jabberwocky stimuli). This observation suggests that these areas operate autonomously of other language areas and can extract abstract syntactic frames based on function words and morphological information alone. On the other hand, regions in the temporal pole, anterior superior temporal sulcus and temporo-parietal junction showed constituent size effect only in the presence of lexico-semantic information, suggesting that they may encode semantic constituents. In several inferior frontal and superior temporal regions, activation was delayed in response to the largest constituent structures, suggesting that nested linguistic structures take increasingly longer time to be computed and that these delays can be measured with fMRI.

[1]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[2]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[3]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[4]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[5]  Ravi S. Menon,et al.  Mental chronometry using latency-resolved functional MRI. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[6]  A. Schleicher,et al.  Broca's region revisited: Cytoarchitecture and intersubject variability , 1999, The Journal of comparative neurology.

[7]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.

[8]  D. V. von Cramon,et al.  Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. , 2000, Brain research. Cognitive brain research.

[9]  Alexandra A. Cleland,et al.  Syntactic co-ordination in dialogue , 2000, Cognition.

[10]  D. Shankweiler,et al.  An Event-related Neuroimaging Study Distinguishing Form and Content in Sentence Processing , 2000, Journal of Cognitive Neuroscience.

[11]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[12]  D. Perani,et al.  Syntax and the Brain: Disentangling Grammar by Selective Anomalies , 2001, NeuroImage.

[13]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[14]  P. Bandettini,et al.  Spatial Heterogeneity of the Nonlinear Dynamics in the FMRI BOLD Response , 2001, NeuroImage.

[15]  F. Rösler,et al.  Brain Activation Modulated by the Comprehension of Normal and Pseudo-word Sentences of Different Processing Demands: A Functional Magnetic Resonance Imaging Study , 2002, NeuroImage.

[16]  Andrea Moro,et al.  Neural Correlates for the Acquisition of Natural Language Syntax , 2002, NeuroImage.

[17]  E. Kaan,et al.  The brain circuitry of syntactic comprehension , 2002, Trends in Cognitive Sciences.

[18]  A. Nobre,et al.  The Response of Left Temporal Cortex to Sentences , 2002, Journal of Cognitive Neuroscience.

[19]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[20]  Peter Hagoort,et al.  How the brain solves the binding problem for language: a neurocomputational model of syntactic processing , 2003, NeuroImage.

[21]  G. Boynton,et al.  Orientation-Specific Adaptation in Human Visual Cortex , 2003, The Journal of Neuroscience.

[22]  C. Büchel,et al.  Broca's area and the language instinct , 2003, Nature Neuroscience.

[23]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[24]  J. Tanji,et al.  Representation of the temporal order of visual objects in the primate lateral prefrontal cortex. , 2003, Journal of neurophysiology.

[25]  P. Hagoort,et al.  Integration of Word Meaning and World Knowledge in Language Comprehension , 2004, Science.

[26]  J. Joseph,et al.  Prefrontal cortex and spatial sequencing in macaque monkey , 2004, Experimental Brain Research.

[27]  N. Dronkers,et al.  Lesion analysis of the brain areas involved in language comprehension , 2004, Cognition.

[28]  J. Tanji,et al.  Integration of temporal order and object information in the monkey lateral prefrontal cortex. , 2004, Journal of neurophysiology.

[29]  C. J. Price,et al.  An fMRI Study of Syntactic Adaptation , 2004, Journal of Cognitive Neuroscience.

[30]  Yosef Grodzinsky,et al.  Neural correlates of syntactic movement: converging evidence from two fMRI experiments , 2004, NeuroImage.

[31]  M. Manfredi,et al.  The masseter inhibitory reflex is evoked by innocuous stimuli and mediated by A beta afferent fibres , 2004, Experimental Brain Research.

[32]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[33]  A. Anwander,et al.  The brain differentiates human and non-human grammars: Functional localization and structural connectivity , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Matthias Schlesewsky,et al.  Processing linguistic complexity and grammaticality in the left frontal cortex. , 2005, Cerebral cortex.

[35]  Angela D. Friederici,et al.  Hierarchical and Linear Sequence Processing: An Electrophysiological Exploration of Two Different Grammar Types , 2006, Journal of Cognitive Neuroscience.

[36]  Yosef Grodzinsky,et al.  Neuroimaging of syntax and syntactic processing , 2006, Current Opinion in Neurobiology.

[37]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[38]  M. Sigman,et al.  Functional organization of perisylvian activation during presentation of sentences in preverbal infants , 2006, Proceedings of the National Academy of Sciences.

[39]  Yosef Grodzinsky,et al.  Working memory and syntax interact in Broca's area , 2007, NeuroImage.

[40]  Mariano Sigman,et al.  Parsing a sequence of brain activations at psychological times using fMRI , 2007, NeuroImage.

[41]  Lorraine K Tyler,et al.  Fronto-temporal brain systems supporting spoken language comprehension , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  L. Tyler,et al.  Grammatical categories in the brain: the role of morphological structure. , 2007, Cerebral cortex.

[43]  Colin Humphries,et al.  Time course of semantic processes during sentence comprehension: An fMRI study , 2007, NeuroImage.

[44]  G. Dell,et al.  Persistent structural priming from language comprehension to language production , 2007, Cognition.

[45]  Geoffrey M. Boynton,et al.  Differential transient MEG and fMRI responses to visual stimulation onset rate , 2008, Int. J. Imaging Syst. Technol..

[46]  M. Sigman,et al.  Brain Mechanisms of Serial and Parallel Processing during Dual-Task Performance , 2008, The Journal of Neuroscience.

[47]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[48]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[49]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[50]  Angela D. Friederici,et al.  Hierarchical artificial grammar processing engages Broca's area , 2008, NeuroImage.

[51]  Angela D. Friederici,et al.  Mathematical Logic in the Human Brain: Syntax , 2009, PloS one.

[52]  Peter Hagoort,et al.  Retrieval and unification of syntactic structure in sentence comprehension: an FMRI study using word-category ambiguity. , 2009, Cerebral cortex.

[53]  Meredith A. Shafto,et al.  Preserving Syntactic Processing across the Adult Life Span: The Modulation of the Frontotemporal Language System in the Context of Age-Related Atrophy , 2009, Cerebral cortex.

[54]  Peter Hagoort,et al.  Syntactic Unification Operations Are Reflected in Oscillatory Dynamics during On-line Sentence Comprehension , 2010, Journal of Cognitive Neuroscience.

[55]  Stefan Klöppel,et al.  Combining Functional and Anatomical Connectivity Reveals Brain Networks for Auditory Language Comprehension , 2022 .

[56]  Jennifer M. Rodd,et al.  The functional organisation of the fronto-temporal language system: Evidence from syntactic and semantic ambiguity , 2010, Neuropsychologia.

[57]  Yosef Grodzinsky,et al.  fMRI adaptation dissociates syntactic complexity dimensions , 2010, NeuroImage.

[58]  Angela D. Friederici,et al.  Mathematical Logic in the Human Brain: Semantics , 2013, PloS one.