Word meanings and sentence structure recruit the same set of fronto-temporal regions during comprehension

To understand what you are reading now, your mind retrieves the meanings of words from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing and empirical evidence from language acquisition and processing have yielded a picture whereby lexico-semantic and syntactic processing are deeply inter-connected. In contrast, most current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support lexico-semantic storage/processing whereas others selectively support syntactic/combinatorial storage/processing, despite inconsistent evidence for this division of linguistic labor across brain regions. Here, we searched for a dissociation between lexico-semantic and syntactic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms (n=49 participants total): responses to lexico-semantic vs. syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in lexical items vs. syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the language network. Critically, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, lexico-semantic and syntactic/combinatorial processing are not separable at the level of brain regions – or even voxel subsets – within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral language research. The results further suggest that the language network may be generally more strongly concerned with meaning than structure, in line with the primary function of language – to share meanings across minds.

[1]  Dorothee J. Chwilla,et al.  Monitoring in Language Perception: Mild and Strong Conflicts Elicit Different ERP Patterns , 2010, Journal of Cognitive Neuroscience.

[2]  M. Pickering,et al.  An experimental approach to linguistic representation , 2016, Behavioral and Brain Sciences.

[3]  N. Kanwisher,et al.  New method for fMRI investigations of language: defining ROIs functionally in individual subjects. , 2010, Journal of neurophysiology.

[4]  Angela D. Friederici,et al.  Who did what to whom? The neural basis of argument hierarchies during language comprehension , 2005, NeuroImage.

[5]  R. Poldrack Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.

[6]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[7]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[8]  Emmanuel Mandonnet,et al.  A re-examination of neural basis of language processing: Proposal of a dynamic hodotopical model from data provided by brain stimulation mapping during picture naming , 2014, Brain and Language.

[9]  R. Poldrack Inferring Mental States from Neuroimaging Data: From Reverse Inference to Large-Scale Decoding , 2011, Neuron.

[10]  Evelina Fedorenko,et al.  Subject-specific functional localizers increase . . . , 2012 .

[11]  E. Wagenmakers,et al.  Erroneous analyses of interactions in neuroscience: a problem of significance , 2011, Nature Neuroscience.

[12]  Jing Wang,et al.  Identifying thematic roles from neural representations measured by functional magnetic resonance imaging , 2016, Cognitive neuropsychology.

[13]  A. Dale,et al.  Distinct Patterns of Neural Modulation during the Processing of Conceptual and Syntactic Anomalies , 2003, Journal of Cognitive Neuroscience.

[14]  S. Dehaene,et al.  Representation of Numerical and Sequential Patterns in Macaque and Human Brains , 2015, Current Biology.

[15]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[16]  Adele E. Goldberg,et al.  Structural priming: Purely syntactic? , 2020, Proceedings of the Twenty First Annual Conference of the Cognitive Science Society.

[17]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[18]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[19]  Noam Chomsky,et al.  Language, mind and brain , 2017, Nature Human Behaviour.

[20]  Angela D Friederici,et al.  The neural basis for human syntax: Broca's area and beyond , 2018, Current Opinion in Behavioral Sciences.

[21]  David Caplan,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1998, NeuroImage.

[22]  Evelina Fedorenko,et al.  Annals of the New York Academy of Sciences Language and Thought Are Not the Same Thing: Evidence from Neuroimaging and Neurological Patients , 2022 .

[23]  Evelina Fedorenko The role of domain-general cognitive control in language comprehension , 2014, Front. Psychol..

[24]  Evelina Fedorenko,et al.  An attempt to replicate a dissociation between syntax and semantics during sentence comprehension reported by Dapretto & Bookheimer (1999, Neuron) , 2017, bioRxiv.

[25]  A. Goldberg,et al.  Construction grammar. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[26]  Morten H. Christiansen,et al.  More Than Words: The Role of Multiword Sequences in Language Learning and Use , 2017, Top. Cogn. Sci..

[27]  Timothy O'Donnell,et al.  Productivity and Reuse in Language: A Theory of Linguistic Computation and Storage , 2015 .

[28]  Erika Hoff,et al.  What explains the correlation between growth in vocabulary and grammar? New evidence from latent change score analyses of simultaneous bilingual development. , 2018, Developmental science.

[29]  T. Florian Jaeger,et al.  Redundancy and reduction: Speakers manage syntactic information density , 2010, Cognitive Psychology.

[30]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[31]  Ronald W. Langacker,et al.  An Introduction to Cognitive Grammar , 1986, Cogn. Sci..

[32]  Z. Williams,et al.  Remaining Puzzles about Morpheme Production in the Posterior Temporal Lobe , 2018, Neuroscience.

[33]  A. Friederici The cortical language circuit: from auditory perception to sentence comprehension , 2012, Trends in Cognitive Sciences.

[34]  Nancy Kanwisher,et al.  Divide and conquer: A defense of functional localizers , 2006, NeuroImage.

[35]  Robin K. Morris,et al.  Processing Subject and Object Relative Clauses: Evidence from Eye Movements , 2002 .

[36]  M. Kutas,et al.  Expect the Unexpected: Event-related Brain Response to Morphosyntactic Violations , 1998 .

[37]  Michael Barlow,et al.  Usage-based models of language , 2000 .

[38]  John Field,et al.  Language and the mind , 1968 .

[39]  Beth Levin,et al.  English Verb Classes and Alternations: A Preliminary Investigation , 1993 .

[40]  Julian M. Pine,et al.  Constructing a Language: A Usage-Based Theory of Language Acquisition. , 2004 .

[41]  George Lakoff,et al.  Irregularity In Syntax , 1970 .

[42]  J. Meaning , Sound , and Syntax : Lexical Priming in Sentence Production , 2001 .

[43]  Karl G. D. Bailey,et al.  Good-Enough Representations in Language Comprehension , 2002 .

[44]  Yosef Grodzinsky,et al.  fMRI adaptation dissociates syntactic complexity dimensions , 2010, NeuroImage.

[45]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.

[46]  Ray Jackendoff,et al.  English particle constructions, the lexicon, and the autonomy of syntax , 2002 .

[47]  M. Pickering,et al.  Structural priming: a critical review. , 2008, Psychological bulletin.

[48]  Brian McElree,et al.  Structural and lexical constraints on filling gaps during sentence comprehension: A time-course analysis , 1998 .

[49]  F. Dick,et al.  Language deficits, localization, and grammar: evidence for a distributive model of language breakdown in aphasic patients and neurologically intact individuals. , 2001, Psychological review.

[50]  Giosuè Baggio,et al.  The balance between memory and unification in semantics: A dynamic account of the N400 , 2011 .

[51]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[52]  Karl J. Friston,et al.  A critique of functional localisers , 2006, NeuroImage.

[53]  A. Friederici The brain basis of language processing: from structure to function. , 2011, Physiological reviews.

[54]  Adele E. Goldberg,et al.  Can thematic roles leave traces of their places? , 2003, Cognition.

[55]  G. Boynton,et al.  Adaptation: from single cells to BOLD signals , 2006, Trends in Neurosciences.

[56]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[57]  A. Goldberg Constructions at Work: The Nature of Generalization in Language , 2006 .

[58]  Nancy Kanwisher,et al.  Functional specificity for high-level linguistic processing in the human brain , 2011, Proceedings of the National Academy of Sciences.

[59]  Joan L. Bybee,et al.  From Usage to Grammar: The Mind's Response to Repetition , 2007 .

[60]  E. Bates,et al.  INDIVIDUAL DIFFERENCES AND THEIR IMPLICATIONS FOR THEORIES OF LANGUAGE DEVELOPMENT , 1995 .

[61]  Joan L. Bybee,et al.  A FUNCTIONALIST APPROACH TO GRAMMAR AND ITS EvoLUTION , 1998 .

[62]  Tal Linzen,et al.  Issues in evaluating semantic spaces using word analogies , 2016, RepEval@ACL.

[63]  Katrin Amunts,et al.  Cortical Folding Patterns and Predicting Cytoarchitecture , 2007, Cerebral cortex.

[64]  Rens Bod,et al.  Beyond Grammar: An Experience-Based Theory of Language , 1998 .

[65]  Peter W. Culicover,et al.  The View from the Periphery: The English Comparative Correlative , 1999, Linguistic Inquiry.

[66]  C. J. Price,et al.  An fMRI Study of Syntactic Adaptation , 2004, Journal of Cognitive Neuroscience.

[67]  M. Kutas,et al.  Event-related brain potentials to semantically inappropriate and surprisingly large words , 1980, Biological Psychology.

[68]  H. Kolk,et al.  Monitoring in language perception: The effect of misspellings of words in highly constrained sentences , 2006, Brain Research.

[69]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[70]  Morten H. Christiansen,et al.  Processing of relative clauses is made easier by frequency of occurrence , 2007 .

[71]  Rens Bod,et al.  Exemplar-based syntax: How to get productivity from examples , 2006 .

[72]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[73]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[74]  Stanislas Dehaene,et al.  Neurophysiological dynamics of phrase-structure building during sentence processing , 2017, Proceedings of the National Academy of Sciences.

[75]  V. Marchman,et al.  Grammar and the lexicon: developmental ordering in language acquisition. , 2007, Child development.

[76]  Franziska Frankfurter,et al.  Constructions: A construction grammar approach to argument structure: Adele E. Goldberg, Chicago, IL: The University of Chicago Press, 1995. xi + 265 pp , 1998 .

[77]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[78]  M. Schlesewsky,et al.  Think globally: Cross-linguistic variation in electrophysiological activity during sentence comprehension , 2011, Brain and Language.

[79]  Z. Ye,et al.  Involvement of cognitive control in sentence comprehension: Evidence from ERPs , 2008, Brain Research.

[80]  H. Kolk,et al.  Late positivities in unusual situations , 2007, Brain and Language.

[81]  E. Dąbrowska University of Birmingham Experience , aptitude and individual differences in native language ultimate attainment , 2018 .

[82]  Wendy Bergervoet,et al.  Monitoring in language perception , 2017 .

[83]  Roger Levy,et al.  RNNs as psycholinguistic subjects: Syntactic state and grammatical dependency , 2018, ArXiv.

[84]  V. Ferreira,et al.  The functions of structural priming , 2006, Language and cognitive processes.

[85]  Edouard Grave,et al.  Colorless Green Recurrent Networks Dream Hierarchically , 2018, NAACL.

[86]  Eva Wittenberg,et al.  Event Structures Drive Semantic Structural Priming, Not Thematic Roles: Evidence From Idioms and Light Verbs , 2018, Cogn. Sci..

[87]  Jonas Obleser,et al.  Disentangling syntax and intelligibility in auditory language comprehension , 2009, Human brain mapping.

[88]  E. Gibson,et al.  A meta-analysis of syntactic priming in language production , 2016 .

[89]  Peter Hagoort,et al.  From Reference to Sense: How the Brain Encodes Meaning for Speaking , 2012, Front. Psychology.

[90]  J. Gee,et al.  Large-scale neural network for sentence processing , 2006, Brain and Language.

[91]  Lyn Frazier,et al.  Lexical Expectations in Sentence Comprehension. , 1984 .

[92]  Holly P. Branigan,et al.  Mapping Concepts to Syntax: Evidence from Structural Priming in Mandarin Chinese. , 2012 .

[93]  Christoph Scheepers,et al.  The lexical boost effect is not diagnostic of lexically-specific syntactic representations , 2017 .

[94]  Michael T. Ullman Chapter 76 – The Declarative/Procedural Model: A Neurobiological Model of Language Learning, Knowledge, and Use , 2016 .

[95]  Y. Miyashita,et al.  A syntactic specialization for Broca's area. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[96]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[97]  S. Goldinger Words and voices: episodic traces in spoken word identification and recognition memory. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[98]  D. Mirman,et al.  Effects of phonological and semantic deficits on facilitative and inhibitory consequences of item repetition in spoken word comprehension , 2013, Neuropsychologia.

[99]  H. Kolk,et al.  Structure and limited capacity in verbal working memory: A study with event-related potentials , 2003, Brain and Language.

[100]  Emmanuel Dupoux,et al.  Cerebral bases of subliminal speech priming , 2010, NeuroImage.

[101]  Elizabeth Bates,et al.  On the inseparability of grammar and the lexicon: Evidence from acquisition. , 1997 .

[102]  R. Jackendoff Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[103]  J. Snedeker,et al.  How broad are thematic roles? Evidence from structural priming , 2018, Cognition.

[104]  Colin M. Brown,et al.  The syntactic positive shift (sps) as an erp measure of syntactic processing , 1993 .

[105]  M. Just,et al.  The neural bases of sentence comprehension: a fMRI examination of syntactic and lexical processing. , 2001, Cerebral cortex.

[106]  Caroline F. Rowland,et al.  Avoiding dative overgeneralisation errors: semantics, statistics or both? , 2014 .

[107]  Yoshua Bengio,et al.  End-to-end attention-based large vocabulary speech recognition , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[108]  William D. Marslen-Wilson,et al.  Left inferior frontal cortex and syntax: function, structure and behaviour in patients with left hemisphere damage , 2011, Brain : a journal of neurology.

[109]  Sylvia Vitello,et al.  Localising semantic and syntactic processing in spoken and written language comprehension: An Activation Likelihood Estimation meta-analysis , 2015, Brain and Language.

[110]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[111]  Evelina Fedorenko,et al.  Syntactic processing is distributed across the language system , 2016, NeuroImage.

[112]  Evelina Fedorenko,et al.  A new fun and robust version of an fMRI localizer for the frontotemporal language system , 2017, Cognitive neuroscience.

[113]  P. Hagoort,et al.  What artificial grammar learning reveals about the neurobiology of syntax , 2012, Brain and Language.

[114]  R. Levy,et al.  Abstract knowledge versus direct experience in processing of binomial expressions , 2016, Cognition.

[115]  Alexa Bautista,et al.  Neural responses to grammatically and lexically degraded speech , 2016, Language, cognition and neuroscience.

[116]  Steven M Frankland,et al.  An architecture for encoding sentence meaning in left mid-superior temporal cortex , 2015, Proceedings of the National Academy of Sciences.

[117]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[118]  J. Obleser,et al.  Dissociable neural imprints of perception and grammar in auditory functional imaging , 2012, Human brain mapping.

[119]  F. Rösler,et al.  Brain Activation Modulated by the Comprehension of Normal and Pseudo-word Sentences of Different Processing Demands: A Functional Magnetic Resonance Imaging Study , 2002, NeuroImage.

[120]  A. Anwander,et al.  The brain differentiates human and non-human grammars: Functional localization and structural connectivity , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[121]  Ray Jackendoff,et al.  A Parallel Architecture perspective on language processing , 2007, Brain Research.

[122]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[123]  Peter Hagoort,et al.  Shared Syntax in Language Production and Language Comprehension—An fMRI Study , 2011, Cerebral cortex.

[124]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[125]  E. Szathmáry,et al.  Semantics boosts syntax in artificial grammar learning tasks with recursion. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[126]  Alison Wray,et al.  Formulaic Language and the Lexicon: List of Figures and Tables , 2002 .

[127]  N. Snider,et al.  More than words: Frequency effects for multi-word phrases , 2010 .

[128]  Brian MacWhinney,et al.  The Handbook of Child Language , 1995 .

[129]  H. Kolk,et al.  The interplay of heuristics and parsing routines in sentence comprehension: Evidence from ERPs and reaction times , 2007, Biological Psychology.

[130]  Noam Chomsky,et al.  Evolution, brain, and the nature of language , 2013, Trends in Cognitive Sciences.

[131]  Stefan Evert,et al.  Corpora and collocations , 2007 .

[132]  M. Ullman Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[133]  Maximilian Riesenhuber,et al.  Individual Variability in Location Impacts Orthographic Selectivity in the “Visual Word Form Area” , 2013, The Journal of Neuroscience.

[134]  Leon Bergen,et al.  Rational integration of noisy evidence and prior semantic expectations in sentence interpretation , 2013, Proceedings of the National Academy of Sciences.

[135]  C. Fiebach,et al.  Revisiting the role of Broca's area in sentence processing: Syntactic integration versus syntactic working memory , 2005, Human brain mapping.

[136]  Eugene Charniak,et al.  Statistical Parsing with a Context-Free Grammar and Word Statistics , 1997, AAAI/IAAI.

[137]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[138]  S. Pinker Learnability and Cognition: The Acquisition of Argument Structure , 1989 .

[139]  Susan M. Garnsey,et al.  The Contributions of Verb Bias and Plausibility to the Comprehension of Temporarily Ambiguous Sentences , 1997 .

[140]  Peter Hagoort,et al.  The neurobiology of language beyond single words. , 2014, Annual review of neuroscience.

[141]  Rainer Goebel,et al.  Measuring structural–functional correspondence: Spatial variability of specialised brain regions after macro-anatomical alignment , 2012, NeuroImage.

[142]  N. Kanwisher,et al.  Lexical and syntactic representations in the brain: An fMRI investigation with multi-voxel pattern analyses , 2011, Neuropsychologia.

[143]  Frederick J. Newmeyer,et al.  Grammar is Grammar and Usage is Usage , 2003 .