Syntactic processing in the human brain: What we know, what we don’t know, and a suggestion for how to proceed

For every claim in the neuroimaging literature about a particular brain region supporting syntactic processing, there exist other claims implicating the target region in different linguistic processes, and, in many cases, in non-linguistic cognitive processes (e.g., Blumstein, 2009). We argue that traditional group analysis methods in neuroimaging may obscure functional specificity because of inter-subject anatomical variability (Fedorenko & Kanwisher, 2009). In Fedorenko, Hsieh, Nieto-Castanon, Whitfield-Gabrieli, and Kanwisher (2010) we presented a functional localizer that allows quick and reliable identification of key language-sensitive regions in each individual brain. This approach enables pooling data from corresponding functional regions across subjects rather than from the same locations in stereotaxic space that may differ functionally due to inter-subject anatomical variability. In the current paper we demonstrate that the individual-subjects functional localization approach is superior to the traditional methods in its ability to distinguish among conditions in a brain region's response. This ability is at the core of all neuroimaging research and is critical for answering questions of functional specialization (e.g., does a brain region specialize for processing syntactic aspects of the linguistic signal), which is in turn essential for making inferences about the precise computations conducted in each brain region. Based on our results, we argue that supplementing existing methods with an individual-subjects functional localization approach may lead to a clearer picture of the neural basis of syntactic processing, as it has in some other domains, such as high-level vision (e.g., Kanwisher, 2010) and social cognition (e.g., Saxe & Kanwisher, 2003).

[1]  K. Brodmann Vergleichende Lokalisationslehre der Großhirnrinde : in ihren Prinzipien dargestellt auf Grund des Zellenbaues , 1985 .

[2]  D. Swinney,et al.  Response of anterior temporal cortex to syntactic and prosodic manipulations during sentence processing , 2005, Human brain mapping.

[3]  John C. Trueswell,et al.  Co-localization of Stroop and Syntactic Ambiguity Resolution in Broca's Area: Implications for the Neural Basis of Sentence Processing , 2009, Journal of Cognitive Neuroscience.

[4]  Matthew H. Davis,et al.  The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. , 2005, Cerebral cortex.

[5]  M. Burton Understanding the role of the prefrontal cortex in phonological processing , 2009, Clinical linguistics & phonetics.

[6]  Y. Grodzinsky,et al.  The battle for Broca’s region , 2008, Trends in Cognitive Sciences.

[7]  M. Harris Language Comprehension in Ape and Child , 1994 .

[8]  William D. Marslen-Wilson,et al.  Dissociating Linguistic and Task-related Activity in the Left Inferior Frontal Gyrus , 2011, Journal of Cognitive Neuroscience.

[9]  O. Hikosaka,et al.  Converging patterns of finger representation and complex response properties of neurons in area 1 of the first somatosensory cortex of the conscious monkey , 1983, Experimental Brain Research.

[10]  Robert T. Knight,et al.  Superior Temporal SulcusIt's My Area: Or Is It? , 2008, Journal of Cognitive Neuroscience.

[11]  L. Craighero,et al.  Broca's Area in Language, Action, and Music , 2009, Annals of the New York Academy of Sciences.

[12]  A. Braun,et al.  Activation of Broca’s area during the production of spoken and signed language: a combined cytoarchitectonic mapping and PET analysis , 2003, Neuropsychologia.

[13]  K. Zuberbühler,et al.  Campbell's Monkeys Use Affixation to Alter Call Meaning , 2009, PloS one.

[14]  Nancy Kanwisher,et al.  Neuroimaging of Language: Why Hasn't a Clearer Picture Emerged? , 2009, Lang. Linguistics Compass.

[15]  David Caplan,et al.  Functional Neuroimaging Studies of Syntactic Processing in Sentence Comprehension: A Critical Selective Review , 2007, Lang. Linguistics Compass.

[16]  P. Matthews,et al.  Semantic Processing in the Left Inferior Prefrontal Cortex: A Combined Functional Magnetic Resonance Imaging and Transcranial Magnetic Stimulation Study , 2003, Journal of Cognitive Neuroscience.

[17]  Elena Plante,et al.  Dissociating Sentential Prosody from Sentence Processing: Activation Interacts with Task Demands , 2002, NeuroImage.

[18]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[19]  Yosef Grodzinsky,et al.  Neuroimaging of syntax and syntactic processing , 2006, Current Opinion in Neurobiology.

[20]  Marily Ford,et al.  A method for obtaining measures of local parsing complexity throughout sentences , 1983 .

[21]  Elizabeth A. Hirshorn,et al.  Localizing interference during naming: Convergent neuroimaging and neuropsychological evidence for the function of Broca's area , 2009, Proceedings of the National Academy of Sciences.

[22]  The emergence of the unmarked: language specific functions of Broca´s area , 2005 .

[23]  R. Poldrack Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.

[24]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[25]  Nancy Kanwisher,et al.  Divide and conquer: A defense of functional localizers , 2006, NeuroImage.

[26]  David Badre,et al.  Left ventrolateral prefrontal cortex and the cognitive control of memory , 2007, Neuropsychologia.

[27]  P. Morosan,et al.  Probabilistic Mapping and Volume Measurement of Human Primary Auditory Cortex , 2001, NeuroImage.

[28]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[29]  Yosef Grodzinsky,et al.  Neural correlates of syntactic movement: converging evidence from two fMRI experiments , 2004, NeuroImage.

[30]  Kayoko Okada,et al.  Area Spt in the Human Planum Temporale Supports Sensory-motor Integration for Speech Processing Establishing the Existence of Distinct Sen- Sory versus Motor Activation Patterns Would Establish That , 2022 .

[31]  Matthias Schlesewsky,et al.  On incremental interpretation: Degrees of meaning accessed during sentence comprehension , 2004 .

[32]  Gregory Hickok,et al.  Selective attention to semantic and syntactic features modulates sentence processing networks in anterior temporal cortex. , 2009, Cerebral cortex.

[33]  J. Trueswell,et al.  Cognitive control and parsing: Reexamining the role of Broca’s area in sentence comprehension , 2005, Cognitive, affective & behavioral neuroscience.

[34]  Alan C. Evans,et al.  Quantifying variability in the planum temporale: a probability map. , 1999, Cerebral cortex.

[35]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[36]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[37]  Colin M. Brown,et al.  The Neural Circuitry Involved in the Reading of German Words and Pseudowords: A PET Study , 1999, Journal of Cognitive Neuroscience.

[38]  J. Duncan An adaptive coding model of neural function in prefrontal cortex , 2001 .

[39]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[40]  Katrin Amunts,et al.  From intersubject variability in clinical syndromes to anatomical variability , 2006, Brain and Language.

[41]  M. D’Esposito,et al.  Is the rostro-caudal axis of the frontal lobe hierarchical? , 2009, Nature Reviews Neuroscience.

[42]  K Amunts,et al.  Quantitative analysis of sulci in the human cerebral cortex: Development, regional heterogeneity, gender difference, asymmetry, intersubject variability and cortical architecture , 1997, Human brain mapping.

[43]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[44]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[45]  J. Fiez Phonology, Semantics, and the Role of the Left Inferior Prefrontal Cortex , 2022 .

[46]  Peter,et al.  Semantic Unification , 2008 .

[47]  K. Amunts,et al.  The role of the left Brodmann's areas 44 and 45 in reading words and pseudowords. , 2005, Brain research. Cognitive brain research.

[48]  G Hickok,et al.  Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study , 2001, Neuroreport.

[49]  A. Dale,et al.  Visual motion aftereffect in human cortical area MT revealed by functional magnetic resonance imaging , 1995, Nature.

[50]  L. Cosmides From : The Cognitive Neurosciences , 1995 .

[51]  G. Rizzolatti,et al.  Functional Organization of Inferior Parietal Lobule Convexity in the Macaque Monkey: Electrophysiological Characterization of Motor, Sensory and Mirror Responses and Their Correlation with Cytoarchitectonic Areas , 2022 .

[52]  Colin Humphries,et al.  Time course of semantic processes during sentence comprehension: An fMRI study , 2007, NeuroImage.

[53]  D Bavelier,et al.  Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[54]  A. Friederici,et al.  Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study , 2000, Human brain mapping.

[55]  E. Vul,et al.  Begging the Question: The Nonindependence Error in fMRI Data Analysis , 2010 .

[56]  N. Kanwisher,et al.  New method for fMRI investigations of language: defining ROIs functionally in individual subjects. , 2010, Journal of neurophysiology.

[57]  Nancy Kanwisher,et al.  Functionally Localizing Language-Sensitive Regions in Individual Subjects With fMRI: A Reply to Grodzinsky's Critique of Fedorenko and Kanwisher (2009) , 2011, Lang. Linguistics Compass.

[58]  A. Schleicher,et al.  Broca's region revisited: Cytoarchitecture and intersubject variability , 1999, The Journal of comparative neurology.

[59]  J. Call,et al.  Word Learning in a Domestic Dog: Evidence for "Fast Mapping" , 2004, Science.

[60]  Simon B. Eickhoff,et al.  Assignment of functional activations to probabilistic cytoarchitectonic areas revisited , 2007, NeuroImage.

[61]  P Hagoort,et al.  A neural correlate of syntactic encoding during speech production , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[62]  P. Gordon,et al.  Memory interference during language processing. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[63]  A. Nobre,et al.  Dissociating Linguistic Processes in the Left Inferior Frontal Cortex with Transcranial Magnetic Stimulation , 2022 .

[64]  R T Constable,et al.  Functional MRI of Language Processing: Dependence on Input Modality and Temporal Lobe Epilepsy , 2001, Epilepsia.

[65]  Brian Everitt,et al.  A systematic review and quantitative appraisal of fMRI studies of verbal fluency: Role of the left inferior frontal gyrus , 2006, Human brain mapping.

[66]  A. Friederici,et al.  The brain basis of syntactic processes: functional imaging and lesion studies , 2003, NeuroImage.

[67]  P. Hagoort,et al.  Integration of Word Meaning and World Knowledge in Language Comprehension , 2004, Science.

[68]  Steven L. Small,et al.  Repetition Suppression for Spoken Sentences and the Effect of Task Demands , 2006, Journal of Cognitive Neuroscience.

[69]  A. Nobre,et al.  The Response of Left Temporal Cortex to Sentences , 2002, Journal of Cognitive Neuroscience.

[70]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[71]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.

[72]  M. Just,et al.  Individual differences in syntactic processing: The role of working memory , 1991 .

[73]  B. Horwitz,et al.  Functional Interactions of the Inferior Frontal Cortex during the Processing of Words and Word-like Stimuli , 2001, Neuron.

[74]  U Noppeney,et al.  The neural areas that control the retrieval and selection of semantics , 2004, Neuropsychologia.

[75]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[76]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[77]  N. Kanwisher Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[78]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[79]  Robert Lindenberg,et al.  “Broca’s area” as a collective term? , 2007, Brain and Language.

[80]  Yosef Grodzinsky,et al.  The Picture of the Linguistic Brain: How Sharp Can It Be? Reply to Fedorenko & Kanwisher , 2010, Lang. Linguistics Compass.

[81]  Emily B. Myers,et al.  Inferior Frontal Regions Underlie the Perception of Phonetic Category Invariance , 2009, Psychological science.

[82]  T Schormann,et al.  Three‐Dimensional linear and nonlinear transformations: An integration of light microscopical and MRI data , 1998, Human brain mapping.

[83]  G. Rizzolatti,et al.  Architecture of superior and mesial area 6 and the adjacent cingulate cortex in the macaque monkey , 1991, The Journal of comparative neurology.

[84]  Matthias Schlesewsky,et al.  Processing linguistic complexity and grammaticality in the left frontal cortex. , 2005, Cerebral cortex.

[85]  D. V. von Cramon,et al.  Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. , 2000, Brain research. Cognitive brain research.

[86]  Angela D. Friederici,et al.  Neuroimaging studies of sentence and discourse comprehension , 2007 .

[87]  V. M. Holmes,et al.  Eye fixation patterns during the reading of relative-clause sentences. , 1981 .

[88]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[89]  Sharon L. Thompson-Schill,et al.  Prefrontal Cortical Response to Conflict during Semantic and Phonological Tasks , 2007, Journal of Cognitive Neuroscience.

[90]  Erica B. Michael,et al.  fMRI investigation of sentence comprehension by eye and by ear: Modality fingerprints on cognitive processes , 2001, Human brain mapping.

[91]  Katrin Amunts,et al.  Cortical Folding Patterns and Predicting Cytoarchitecture , 2007, Cerebral cortex.

[92]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[93]  I. Olson,et al.  The Enigmatic temporal pole: a review of findings on social and emotional processing. , 2007, Brain : a journal of neurology.

[94]  A. Caramazza,et al.  Dissociation of algorithmic and heuristic processes in language comprehension: Evidence from aphasia , 1976, Brain and Language.

[95]  I. Pepperberg The Alex Studies: Cognitive and Communicative Abilities of Grey Parrots , 2000 .

[96]  Yosef Grodzinsky,et al.  Working memory and syntax interact in Broca's area , 2007, NeuroImage.

[97]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[98]  James J. Pekar,et al.  Differential components of sentence comprehension: Beyond single word reading and memory , 2006, NeuroImage.

[99]  L. Osterhout,et al.  Brain potentials elicited by prose-embedded linguistic anomalies , 2002, Memory & cognition.

[100]  R. Buckner,et al.  Dissociation of human prefrontal cortical areas across different speech production tasks and gender groups. , 1995, Journal of neurophysiology.

[101]  Timothy Q. Gentner,et al.  Recursive syntactic pattern learning by songbirds , 2006, Nature.

[102]  Emily B. Myers,et al.  The Perception of Voice Onset Time: An fMRI Investigation of Phonetic Category Structure , 2005, Journal of Cognitive Neuroscience.

[103]  Weijia Ni,et al.  Sentence complexity and input modality effects in sentence comprehension: an fMRI study , 2004, NeuroImage.

[104]  Thomas J. Grabowski,et al.  The Left Posterior Superior Temporal Gyrus Participates Specifically in Accessing Lexical Phonology , 2008, Journal of Cognitive Neuroscience.

[105]  J. Desmond,et al.  Functional Specialization for Semantic and Phonological Processing in the Left Inferior Prefrontal Cortex , 1999, NeuroImage.

[106]  Simon B. Eickhoff,et al.  Different roles of cytoarchitectonic BA 44 and BA 45 in phonological and semantic verbal fluency as revealed by dynamic causal modelling , 2009, NeuroImage.

[107]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[108]  Martha W. Burton,et al.  The role of inferior frontal cortex in phonological processing , 2001, Cogn. Sci..

[109]  E. Kaan,et al.  The brain circuitry of syntactic comprehension , 2002, Trends in Cognitive Sciences.

[110]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[111]  S. Petersen,et al.  Activation of extrastriate and frontal cortical areas by visual words and word-like stimuli. , 1990, Science.

[112]  J. Duncan The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[113]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[114]  J. Gee,et al.  Neural basis for sentence comprehension: Grammatical and short‐term memory components , 2002, Human brain mapping.

[115]  N. Alpert,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1996, Brain and Language.

[116]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[117]  Roel M. Willems,et al.  Broca's region: battles are not won by ignoring half of the facts , 2009, Trends in Cognitive Sciences.

[118]  C. J. Price,et al.  An fMRI Study of Syntactic Adaptation , 2004, Journal of Cognitive Neuroscience.

[119]  A. Schleicher,et al.  21 – Quantitative Analysis of Cyto- and Receptor Architecture of the Human Brain , 2002 .

[120]  K. Amunts,et al.  Broca's region subserves imagery of motion: A combined cytoarchitectonic and fMRI study , 2000, Human brain mapping.