Who did what to whom? The neural basis of argument hierarchies during language comprehension

The present fMRI study aimed at identifying neural correlates of the syntax-semantics interface in language comprehension. This was achieved by examining what we refer to as "argument hierarchy construction", i.e., determining which participant in a sentence is the "Actor" and which is the "Undergoer" of the event expressed by the verb. In order to identify the neural bases of argument hierarchy processing, we manipulated three factors known to influence the complexity of argument hierarchy construction in German, namely argument order, verb class and morphological ambiguity. Increased argument hierarchization demands engendered enhanced activation in a network of inferior frontal, posterior superior temporal, premotor and parietal areas. Moreover, components of this network were differentially modulated by the individual factors. In particular, the left posterior superior temporal sulcus showed an enhanced sensitivity for morphological information and the syntactic realization of the verb-based argument hierarchy, while the activation of the left inferior frontal gyrus (pars opercularis) corresponded to linearization demands and was independent of morphological information. We therefore argue that, for German, posterior superior temporal and inferior frontal regions engage in the extraction of actorhood from morphosyntactic structure and in the sequential realization of hierarchical interpretive dependencies, respectively.

[1]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[2]  M. D’Esposito,et al.  Empirical Analyses of BOLD fMRI Statistics , 1997, NeuroImage.

[3]  Matthias Schlesewsky,et al.  Beyond syntax: Language-related positivities reflect the revision of hierarchies , 2002, Neuroreport.

[4]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[5]  A. Friederici Processing local transitions versus long-distance syntactic hierarchies , 2004, Trends in Cognitive Sciences.

[6]  C. Fiebach,et al.  Distinct neural correlates of legal and illegal word-order variations in German: How can fMRI inform cognitive models of sentence processing? , 2004 .

[7]  G Lohmann,et al.  LIPSIA--a new software system for the evaluation of functional magnetic resonance images of the human brain. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[8]  Eliot Hazeltine,et al.  Dissociable Contributions of Prefrontal and Parietal Cortices to Response Selection , 2002, NeuroImage.

[9]  N. Alpert,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1996, Brain and Language.

[10]  S. Petersen,et al.  Characterizing the Hemodynamic Response: Effects of Presentation Rate, Sampling Procedure, and the Possibility of Ordering Brain Activity Based on Relative Timing , 2000, NeuroImage.

[11]  Lars Konieczny,et al.  German Sentence Processing , 1999 .

[12]  T. Braver,et al.  The Role of Frontopolar Cortex in Subgoal Processing during Working Memory , 2002, NeuroImage.

[13]  Randy J. LaPolla,et al.  Syntax: Structure, Meaning, and Function , 1999 .

[14]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[15]  Jürgen Lenerz,et al.  Zur Abfolge nominaler Satzglieder im Deutschen , 1977 .

[16]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[17]  Ravi S. Menon,et al.  Imaging at high magnetic fields: initial experiences at 4 T. , 1993, Magnetic resonance quarterly.

[18]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[19]  A M Dale,et al.  Randomized event‐related experimental designs allow for extremely rapid presentation rates using functional MRI , 1998, Neuroreport.

[20]  Ralph-Axel Müller,et al.  Linguistic theory and neuroimaging evidence: an fMRI study of Broca’s area in lexical semantics , 2003, Neuropsychologia.

[21]  D. Yves von Cramon,et al.  A Blueprint for Target Motion: fMRI Reveals Perceived Sequential Complexity to Modulate Premotor Cortex , 2002, NeuroImage.

[22]  G. Calvert Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[23]  Beatrice Primus,et al.  Cases and thematic roles , 1999 .

[24]  Christoph Scheepers,et al.  Linking Syntactic Functions with Thematic Roles: Psych-Verbs and the Resolution of Subject-Object Ambiguity , 2000 .

[25]  Philip K. McGuire,et al.  Dissociating linguistic and nonlinguistic gestural communication in the brain , 2004, NeuroImage.

[26]  Gregory McCarthy,et al.  Polysensory interactions along lateral temporal regions evoked by audiovisual speech. , 2003, Cerebral cortex.

[27]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[28]  M. Brass,et al.  Decomposing Components of Task Preparation with Functional Magnetic Resonance Imaging , 2004, Journal of Cognitive Neuroscience.

[29]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[30]  Christian J Fiebach,et al.  On the cost of syntactic ambiguity in human language comprehension: an individual differences approach. , 2004, Brain research. Cognitive brain research.

[31]  S. Scott,et al.  The neuroanatomical and functional organization of speech perception , 2003, Trends in Neurosciences.

[32]  Thomas G. Bever,et al.  Sentence Comprehension: The Integration of Habits and Rules , 2001 .

[33]  Matthias Schlesewsky,et al.  The emergence of the unmarked: A new perspective on the language‐specific function of Broca's area , 2005, Human brain mapping.

[34]  E. Kaan,et al.  The brain circuitry of syntactic comprehension , 2002, Trends in Cognitive Sciences.

[35]  Dieter Wunderlich,et al.  Lexicon in Focus , 2000 .

[36]  Dieter Wunderlich,et al.  Cause and the structure of verbs , 1997 .

[37]  Morten H. Christiansen,et al.  Sequential learning in non-human primates , 2001, Trends in Cognitive Sciences.

[38]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[39]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[40]  Y. Miyashita,et al.  A syntactic specialization for Broca's area. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[41]  D. V. Cramon,et al.  Functional–anatomical concepts of human premotor cortex: evidence from fMRI and PET studies , 2003, NeuroImage.

[42]  Yosef Grodzinsky,et al.  Neural correlates of syntactic movement: converging evidence from two fMRI experiments , 2004, NeuroImage.

[43]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[44]  G. Lohmann,et al.  Color-Word Matching Stroop Task: Separating Interference and Response Conflict , 2001, NeuroImage.

[45]  Matthias Schlesewsky,et al.  Ungrammaticality detection and garden path strength: A commentary on Meng and Bader"s (2000) evidence for serial parsing , 2003 .

[46]  C. Fiebach,et al.  Revisiting the role of Broca's area in sentence processing: Syntactic integration versus syntactic working memory , 2005, Human brain mapping.

[47]  Matthias Schlesewsky,et al.  On incremental interpretation: Degrees of meaning accessed during sentence comprehension , 2004 .

[48]  C. Fiebach,et al.  Neural Correlates of Syntactic Ambiguity in Sentence Comprehension for Low and High Span Readers , 2004, Journal of Cognitive Neuroscience.

[49]  Y. Sugita,et al.  Auditory-visual speech perception examined by fMRI and PET , 2003, Neuroscience Research.

[50]  Y. Grodzinsky The neurology of syntax: Language use without Broca's area , 2000, Behavioral and Brain Sciences.

[51]  M. D’Esposito,et al.  Empirical Analyses of BOLD fMRI Statistics , 1997, NeuroImage.

[52]  R J Wise,et al.  Separate neural subsystems within 'Wernicke's area'. , 2001, Brain : a journal of neurology.

[53]  Karsten Specht,et al.  Functional segregation of the temporal lobes into highly differentiated subsystems for auditory perception: an auditory rapid event-related fMRI-task , 2003, NeuroImage.

[54]  Matthias Schlesewsky,et al.  The P600 as an indicator of syntactic ambiguity , 2002, Cognition.

[55]  F. Rösler,et al.  Brain Activation Modulated by the Comprehension of Normal and Pseudo-word Sentences of Different Processing Demands: A Functional Magnetic Resonance Imaging Study , 2002, NeuroImage.

[56]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[57]  Jonathan D. Cohen,et al.  An fMRI Investigation of Emotional Engagement in Moral Judgment , 2001, Science.

[58]  Comrie Bernard Language Universals and Linguistic Typology , 1982 .

[59]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[60]  G. Waters,et al.  Activation of Broca's area by syntactic processing under conditions of concurrent articulation , 2000, Human brain mapping.

[61]  C. Frith,et al.  Development and neurophysiology of mentalizing. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  G. Waters,et al.  Vascular responses to syntactic processing: Event‐related fMRI study of relative clauses , 2002, Human brain mapping.

[63]  B. McElree,et al.  Multi-dimensional contributions to garden path strength: Dissociating phrase structure from case marking , 2004 .

[64]  Beatrice Primus,et al.  Cases and thematic roles : ergative, accusative and active , 1999 .

[65]  A. Friederici,et al.  Eliciting thematic reanalysis effects: The role of syntax-independent information during parsing , 2003 .

[66]  Markus Bader,et al.  Subject-Object Ambiguities in German Embedded Clauses: An Across-the-Board Comparison , 1999 .

[67]  D G Norris,et al.  Reduced power multislice MDEFT imaging , 2000, Journal of magnetic resonance imaging : JMRI.

[68]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[69]  M. Brass,et al.  The role of the frontal cortex in task preparation. , 2002, Cerebral cortex.

[70]  Richard Shillcock,et al.  The On-line Study of Sentence Comprehension , 2004 .

[71]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[72]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[73]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[74]  Hubert Haider,et al.  Scrambling: Nontriggered Chain Formation in OV Languages , 2003, Journal of Germanic Linguistics.

[75]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.