The role of the IFG and pSTS in syntactic prediction: Evidence from a parametric study of hierarchical structure in fMRI

Sentences encode hierarchical structural relations among words. Several neuroimaging experiments aiming to localize combinatory operations responsible for creating this structure during sentence comprehension have contrasted short, simple phrases and sentences to unstructured controls. Some of these experiments have revealed activation in the left inferior frontal gyrus (IFG) and posterior superior temporal sulcus (pSTS), associating these regions with basic syntactic combination. However, the wide variability of these effects across studies raises questions about this interpretation. In an fMRI experiment, we provide support for an alternative hypothesis: these regions underlie top-down syntactic predictions that facilitate sentence processing but are not necessary for building syntactic structure. We presented stimuli with three levels of structure: unstructured lists, two-word phrases, and simple, short sentences; and two levels of content: natural stimuli with real words and stimuli with open-class items replaced with pseudowords (jabberwocky). While both the phrase and sentence conditions engaged syntactic combination, our experiment only encouraged syntactic prediction in the sentence condition. We found increased activity for both natural and jabberwocky sentences in the left IFG (pars triangularis and pars orbitalis) and pSTS relative to unstructured word lists and two-word phrases, but we did not find any such effects for two-word phrases relative to unstructured word lists in these areas. Our results are most consistent with the hypothesis that increased activity in IFG and pSTS for basic contrasts of structure reflects syntactic prediction. The pars opercularis of the IFG showed a response profile consistent with verbal working memory. We found incremental effects of structure in the anterior temporal lobe (ATL), and increased activation only for sentences in the angular gyrus (AG)/temporal-parietal junction (TPJ) - both regions showed these effects for stimuli with all real words. These findings support a role for the ATL in semantic combination and the AG/TPJ in thematic processing.

[1]  Maria Luisa Gorno-Tempini,et al.  The neural basis of syntactic deficits in primary progressive aphasia , 2012, Brain and Language.

[2]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[3]  Colin Phillips,et al.  Order and structure , 1996 .

[4]  Vincenzo Lombardo,et al.  Processing Coordinated Structures: Incrementality and Connectedness , 2005, Cogn. Sci..

[5]  Colin Phillips,et al.  The Quarterly Journal of Experimental Psychology Going the Distance: Memory and Control Processes in Active Dependency Construction , 2022 .

[6]  Anna S. Hasting,et al.  Generating predictions: Lesion evidence on the role of left inferior frontal cortex in rapid syntactic analysis , 2013, Cortex.

[7]  Y. Grodzinsky,et al.  Broca's area and sentence comprehension: A relationship parasitic on dependency, displacement or predictability? , 2012, Neuropsychologia.

[8]  William D. Marslen-Wilson,et al.  Temporal and frontal systems in speech comprehension: An fMRI study of past tense processing , 2005, Neuropsychologia.

[9]  Nancy Kanwisher,et al.  Language-Selective and Domain-General Regions Lie Side by Side within Broca’s Area , 2012, Current Biology.

[10]  L Konieczny,et al.  Locality and Parsing Complexity , 2000, Journal of psycholinguistic research.

[11]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[12]  Laurie A. Stowe,et al.  Parsing WH-constructions: Evidence for on-line gap location , 1986 .

[13]  Jonas Obleser,et al.  Disentangling syntax and intelligibility in auditory language comprehension , 2009, Human brain mapping.

[14]  R. Brener,et al.  An experimental investigation of memory span , 1940 .

[15]  Ellen F. Lau,et al.  Dissociating N400 Effects of Prediction from Association in Single-word Contexts , 2013, Journal of Cognitive Neuroscience.

[16]  Ellen F. Lau,et al.  The role of structural prediction in rapid syntactic analysis , 2006, Brain and Language.

[17]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[18]  A. A. Wijers,et al.  Localizing components of a complex task: sentence processing and working memory , 1998, Neuroreport.

[19]  William Matchin,et al.  Broca's Area, Sentence Comprehension, and Working Memory: An fMRI Study , 2008, Frontiers in human neuroscience.

[20]  Nancy Kanwisher,et al.  Functional specificity for high-level linguistic processing in the human brain , 2011, Proceedings of the National Academy of Sciences.

[21]  Noam Chomsky,et al.  Structures, Not Strings: Linguistics as Part of the Cognitive Sciences , 2015, Trends in Cognitive Sciences.

[22]  G. A. Miller,et al.  The role of semantic and syntactic constraints in the memorization of English sentences , 1964 .

[23]  Angela D. Friederici,et al.  Neural Systems Underlying the Processing of Complex Sentences , 2015 .

[24]  Corinna E. Bonhage,et al.  Combined eye tracking and fMRI reveals neural basis of linguistic predictions during sentence comprehension , 2015, Cortex.

[25]  N. Kanwisher,et al.  Lexical and syntactic representations in the brain: An fMRI investigation with multi-voxel pattern analyses , 2011, Neuropsychologia.

[26]  H. Funkenstein,et al.  Broca aphasia , 1978, Neurology.

[27]  Frank Keller,et al.  Expectation and Locality Effects in German Verb-final Structures. , 2013, Journal of memory and language.

[28]  Ray Jackendoff,et al.  Précis of Foundations of language: brain, meaning, grammar, evolution. , 2003, The Behavioral and brain sciences.

[29]  David Caplan,et al.  Individual differences in rCBF correlates of syntactic processing in sentence comprehension: effects of working memory and speed of processing , 2003, NeuroImage.

[30]  Gregory Hickok,et al.  Sentence processing selectivity in Broca's area: evident for structure but not syntactic movement , 2015, Language, cognition and neuroscience.

[31]  Malathi Thothathiri,et al.  The Neural Basis of Reversible Sentence Comprehension: Evidence from Voxel-based Lesion Symptom Mapping in Aphasia , 2012, Journal of Cognitive Neuroscience.

[32]  Peter Hagoort,et al.  The neurobiology of language beyond single words. , 2014, Annual review of neuroscience.

[33]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[34]  Jennifer E. Mack,et al.  Grammatical impairments in PPA , 2014, Aphasiology.

[35]  Grant M. Walker,et al.  Neuroanatomical dissociation for taxonomic and thematic knowledge in the human brain , 2011, Proceedings of the National Academy of Sciences.

[36]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[37]  A. Friederici The Neuroanatomical Pathway Model of Language: Syntactic and Semantic Networks , 2016 .

[38]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[39]  Kurt E. Weaver,et al.  Mapping anterior temporal lobe language areas with fMRI: A multicenter normative study , 2011, NeuroImage.

[40]  David Poeppel,et al.  The neural bases of taxonomic and thematic conceptual relations: An MEG study , 2015, Neuropsychologia.

[41]  B. Miller,et al.  Neural Correlates of Syntactic Processing in the Nonfluent Variant of Primary Progressive Aphasia , 2010, The Journal of Neuroscience.

[42]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[43]  G. Waters,et al.  Working memory and written sentence comprehension , 1987 .

[44]  Janet D. Fodor,et al.  The sausage machine: A new two-stage parsing model , 1978, Cognition.

[45]  David Poeppel,et al.  Towards a computational(ist) neurobiology of language: correlational, integrated and explanatory neurolinguistics , 2015, Language, cognition and neuroscience.

[46]  Elizabeth Bates,et al.  Differential Sensitivity to Errors of Agreement and Word Order in Broca's Aphasia , 1991, Journal of Cognitive Neuroscience.

[47]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[48]  Daniel N. Osherson,et al.  Evidence for conceptual combination in the left anterior temporal lobe , 2011, NeuroImage.

[49]  A. Schleicher,et al.  Broca's region revisited: Cytoarchitecture and intersubject variability , 1999, The Journal of comparative neurology.

[50]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[51]  Peter Hagoort,et al.  Retrieval and unification of syntactic structure in sentence comprehension: an FMRI study using word-category ambiguity. , 2009, Cerebral cortex.

[52]  Colin Humphries,et al.  Time course of semantic processes during sentence comprehension: An fMRI study , 2007, NeuroImage.

[53]  A. Friederici,et al.  The role of the posterior superior temporal cortex in sentence comprehension , 2009, Neuroreport.

[54]  A. Caramazza,et al.  Dissociation of algorithmic and heuristic processes in language comprehension: Evidence from aphasia , 1976, Brain and Language.

[55]  E. Gibson The dependency locality theory: A distance-based theory of linguistic complexity. , 2000 .

[56]  C. Rorden,et al.  Damage to left anterior temporal cortex predicts impairment of complex syntactic processing: A lesion‐symptom mapping study , 2013, Human brain mapping.

[57]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[58]  Masaya Yoshida,et al.  Predictive processing of syntactic structure: Sluicing and ellipsis in real-time sentence processing , 2013 .

[59]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[60]  L. Pylkkänen,et al.  Basic linguistic composition recruits the left anterior temporal lobe and left angular gyrus during both listening and reading. , 2013, Cerebral cortex.

[61]  Yosef Grodzinsky,et al.  Working memory and syntax interact in Broca's area , 2007, NeuroImage.

[62]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[63]  C. Clifton,et al.  Syntactic prediction in language comprehension: evidence from either...or. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[64]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[65]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[66]  Mark Steedman,et al.  The nite connectivity of linguistic structure , 1999 .

[67]  Stephen M. Wilson,et al.  Grammaticality Judgment in Aphasia: Deficits Are Not Specific to Syntactic Structures, Aphasic Syndromes, or Lesion Sites , 2004, Journal of Cognitive Neuroscience.

[68]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[69]  S. Dehaene,et al.  A role for left inferior frontal and posterior superior temporal cortex in extracting a syntactic tree from a sentence , 2016, Cortex.

[70]  Gregory Hickok,et al.  The Role of Broca's Area in Sentence Comprehension , 2011, Journal of Cognitive Neuroscience.

[71]  G. A. Miller,et al.  The intelligibility of speech as a function of the context of the test materials. , 1951, Journal of experimental psychology.

[72]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[73]  G. A. Miller,et al.  Some perceptual consequences of linguistic rules , 1963 .

[74]  Lars Meyer,et al.  Building by Syntax: The Neural Basis of Minimal Linguistic Structures , 2015, Cerebral cortex.

[75]  Liina Pylkkänen,et al.  Simple Composition: A Magnetoencephalography Investigation into the Comprehension of Minimal Linguistic Phrases , 2011, The Journal of Neuroscience.

[76]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[77]  Gregory Hickok,et al.  Selective attention to semantic and syntactic features modulates sentence processing networks in anterior temporal cortex. , 2009, Cerebral cortex.

[78]  J. Trueswell,et al.  Cognitive control and parsing: Reexamining the role of Broca’s area in sentence comprehension , 2005, Cognitive, affective & behavioral neuroscience.

[79]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[80]  Nina F. Dronkers,et al.  Neural correlates of arithmetic and language comprehension: A common substrate? , 2007, Neuropsychologia.

[81]  Chris Rorden,et al.  Chronic Broca's Aphasia Is Caused by Damage to Broca's and Wernicke's Areas. , 2015, Cerebral cortex.

[82]  Myrna F. Schwartz,et al.  Sensitivity to grammatical structure in so-called agrammatic aphasics , 1983, Cognition.

[83]  Gregory Hickok,et al.  A structural distance effect for backward anaphora in Broca’s area: An fMRI study , 2014, Brain and Language.

[84]  Colin Phillips,et al.  Hyper-active gap filling , 2015, Front. Psychol..

[85]  Randi C. Martin,et al.  Neural basis of semantic and syntactic interference in sentence comprehension , 2013, Brain and Language.

[86]  Matthias Schlesewsky,et al.  Processing linguistic complexity and grammaticality in the left frontal cortex. , 2005, Cerebral cortex.

[87]  Y. Miyashita,et al.  A syntactic specialization for Broca's area. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[88]  Richard L. Lewis,et al.  Computational principles of working memory in sentence comprehension , 2006, Trends in Cognitive Sciences.

[89]  Liina Pylkkänen,et al.  The LATL as locus of composition: MEG evidence from English and Arabic , 2015, Brain and Language.

[90]  Marc Brysbaert,et al.  Wuggy: A multilingual pseudoword generator , 2010, Behavior research methods.

[91]  N. Dronkers,et al.  Lesion analysis of the brain areas involved in language comprehension , 2004, Cognition.

[92]  Jayaram Chandrashekar,et al.  Sequential Processing of Lexical, Grammatical, and Phonological Information Within Broca's Area , 2009 .

[93]  Noam Chomsky Some Concepts and Consequences of the Theory of Government and Binding , 1982 .

[94]  D. Swinney,et al.  Response of anterior temporal cortex to syntactic and prosodic manipulations during sentence processing , 2005, Human brain mapping.

[95]  Janet Dean Fodor,et al.  Natural language parsing: How can grammars help parsers? , 1985 .

[96]  Simon B. Eickhoff,et al.  Analysis of neural mechanisms underlying verbal fluency in cytoarchitectonically defined stereotaxic space—The roles of Brodmann areas 44 and 45 , 2004, NeuroImage.

[97]  Angela D. Friederici,et al.  Merge in the Human Brain: A Sub-Region Based Functional Investigation in the Left Pars Opercularis , 2015, Front. Psychol..

[98]  Billi Randall,et al.  Cortical Differentiation for Nouns and Verbs Depends on Grammatical Markers , 2008, Journal of Cognitive Neuroscience.

[99]  A. Nobre,et al.  The Response of Left Temporal Cortex to Sentences , 2002, Journal of Cognitive Neuroscience.

[100]  Angela D. Friederici,et al.  Merge processing in the human brain: A sub-region based functional investigation in the left pars opercularis , 2015 .

[101]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.

[102]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[103]  D. Poeppel,et al.  Defining the Relation Between Linguistics and Neuroscience , 2017 .

[104]  John C. Trueswell,et al.  Compositionality and the angular gyrus: A multi-voxel similarity analysis of the semantic composition of nouns and verbs , 2015, Neuropsychologia.

[105]  Liina Pylkkänen,et al.  MEG evidence for conceptual combination but not numeral quantification in the left anterior temporal lobe during language production , 2014, Front. Psychol..

[106]  J. Zwart The Minimalist Program , 1998, Journal of Linguistics.

[107]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[108]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[109]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[110]  Todd B. Parrish,et al.  Neural Correlates of Verb Argument Structure Processing , 2007, Journal of Cognitive Neuroscience.