Simple Composition: A Magnetoencephalography Investigation into the Comprehension of Minimal Linguistic Phrases

The expressive power of language lies in its ability to construct an infinite array of ideas out of a finite set of pieces. Surprisingly, few neurolinguistic investigations probe the basic processes that constitute the foundation of this ability, choosing instead to focus on relatively complex combinatorial operations. Contrastingly, in the present work, we investigate the neural circuits underlying simple linguistic composition, such as required by the minimal phrase “red boat.” Using magnetoencephalography, we examined activity in humans generated at the visual presentation of target nouns, such as “boat,” and varied the combinatorial operations induced by its surrounding context. Nouns in minimal compositional contexts (“red boat”) were compared with those appearing in matched non-compositional contexts, such as after an unpronounceable consonant string (“xkq boat”) or within a list (“cup, boat”). Source analysis did not implicate traditional language areas (inferior frontal gyrus, posterior temporal regions) in such basic composition. Instead, we found increased combinatorial-related activity in the left anterior temporal lobe (LATL) and ventromedial prefrontal cortex (vmPFC). These regions have been linked previously to syntactic (LATL) and semantic (vmPFC) combinatorial processing in more complex linguistic contexts. Thus, we suggest that these regions play a role in basic syntactic and semantic composition, respectively. Importantly, the temporal ordering of the effects, in which LATL activity (∼225 ms) precedes vmPFC activity (∼400 ms), is consistent with many processing models that posit syntactic composition before semantic composition during the construction of linguistic representations.

[1]  T. Allison,et al.  Word recognition in the human inferior temporal lobe , 1994, Nature.

[2]  W Grodd,et al.  Opposite hemispheric lateralization effects during speaking and singing at motor cortex, insula and cerebellum , 2000, Neuroreport.

[3]  B. J. Casey,et al.  Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI , 1994, Human brain mapping.

[4]  G. A. Miller,et al.  Finitary models of language users , 1963 .

[5]  S. Thompson-Schill,et al.  The frontal lobes and the regulation of mental activity , 2005, Current Opinion in Neurobiology.

[6]  D. Swinney,et al.  Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[7]  M. Kutas,et al.  Interactions between sentence context and word frequencyinevent-related brainpotentials , 1990, Memory & cognition.

[8]  R. Salmelin,et al.  Dynamics of letter string perception in the human occipitotemporal cortex. , 1999, Brain : a journal of neurology.

[9]  Alan C. Evans,et al.  Functional activation of the human frontal cortex during the performance of verbal working memory tasks. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[10]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[11]  Charles D. Smith,et al.  Dissociation of Automatic and Strategic Lexical-Semantics: Functional Magnetic Resonance Imaging Evidence for Differing Roles of Multiple Frontotemporal Regions , 2006, The Journal of Neuroscience.

[12]  Matthew Flatt,et al.  PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers , 1993 .

[13]  Richard S. J. Frackowiak,et al.  Functional anatomy of a common semantic system for words and pictures , 1996, Nature.

[14]  A. A. Wijers,et al.  Localizing components of a complex task: sentence processing and working memory , 1998, Neuroreport.

[15]  L. Pylkkänen,et al.  Semantics vs. world knowledge in prefrontal cortex , 2009 .

[16]  Andrea E. Martin,et al.  The Anterior Midline Field: coercion or decision making? , 2009 .

[17]  Friedemann Pulvermüller,et al.  Motor cortex maps articulatory features of speech sounds , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[18]  L. Pylkkänen,et al.  Processing psych verbs: Behavioural and MEG measures of two different types of semantic complexity , 2010 .

[19]  P. Hagoort,et al.  Integration of Word Meaning and World Knowledge in Language Comprehension , 2004, Science.

[20]  C. D. Frith,et al.  Brain Activations during Visual Search: Contributions of Search Efficiency versus Feature Binding , 2003, NeuroImage.

[21]  Y. Grodzinsky,et al.  The battle for Broca’s region , 2008, Trends in Cognitive Sciences.

[22]  John C Gore,et al.  The role of the parietal cortex in visual feature binding , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Charles R. G. Guttmann,et al.  Functional MRI of auditory verbal working memory: long-term reproducibility analysis , 2004, NeuroImage.

[24]  David Caplan,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1998, NeuroImage.

[25]  S. Bookheimer,et al.  Regional cerebral blood flow during object naming and word reading , 1995 .

[26]  J.C. Mosher,et al.  Recursive MUSIC: A framework for EEG and MEG source localization , 1998, IEEE Transactions on Biomedical Engineering.

[27]  T. Carr,et al.  Comparing cortical activations for silent and overt speech using event‐related fMRI , 2002, Human brain mapping.

[28]  L. Osterhout,et al.  Morphological analysis in sentence processing: An ERP study , 2003 .

[29]  Liina Pylkkänen,et al.  An MEG Study of Silent Meaning , 2007, Journal of Cognitive Neuroscience.

[30]  Gregory Hickok,et al.  Selective attention to semantic and syntactic features modulates sentence processing networks in anterior temporal cortex. , 2009, Cerebral cortex.

[31]  P. Broca Perte de la parole, ramouissement chronique et destruction partielle du lobe antérieur gauche du cerveau , 1861 .

[32]  A. Treisman,et al.  The Interaction of Spatial and Object Pathways: Evidence from Balint's Syndrome , 1997, Journal of Cognitive Neuroscience.

[33]  L. Pylkkänen,et al.  Neuromagnetic Evidence for the Timing of Lexical Activation: An MEG Component Sensitive to Phonotactic Probability but Not to Neighborhood Density , 2002, Brain and Language.

[34]  Leslie G. Ungerleider,et al.  Object and spatial visual working memory activate separate neural systems in human cortex. , 1996, Cerebral cortex.

[35]  Liina Pylkkänen,et al.  Mismatching Meanings in Brain and Behavior , 2008, Lang. Linguistics Compass.

[36]  Jeffrey R. Binder,et al.  Some neurophysiological constraints on models of word naming , 2005, NeuroImage.

[37]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[38]  C. Wernicke Der aphasische Symptomencomplex: Eine psychologische Studie auf anatomischer Basis , 1874 .

[39]  Richard S. J. Frackowiak,et al.  The role of the right hemisphere in the interpretation of figurative aspects of language. A positron emission tomography activation study. , 1994, Brain : a journal of neurology.

[40]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[41]  Arno Villringer,et al.  Visual Feature and Conjunction Searches of Equal Difficulty Engage Only Partially Overlapping Frontoparietal Networks , 2002, NeuroImage.

[42]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[43]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[44]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[45]  Y. Grodzinsky,et al.  Taxing working memory with syntax: Bihemispheric modulations , 2007, Human brain mapping.

[46]  Masato Taira,et al.  Reading in a Regular Orthography: An fMRI Study Investigating the Role of Visual Familiarity , 2004, Journal of Cognitive Neuroscience.

[47]  L. Pylkkänen,et al.  Tracking the time course of word recognition with MEG , 2003, Trends in Cognitive Sciences.

[48]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[49]  S. Blumstein,et al.  An Event-Related fMRI Investigation of Implicit Semantic Priming , 2003, Journal of Cognitive Neuroscience.

[50]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[51]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[52]  G Hickok,et al.  Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study , 2001, Neuroreport.

[53]  M. Rugg The effects of semantic priming and work repetition on event-related potentials. , 1985, Psychophysiology.

[54]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[55]  Edward E. Smith,et al.  Dissociation of Storage and Rehearsal in Verbal Working Memory: Evidence From Positron Emission Tomography , 1996 .

[56]  R L Buckner,et al.  Spatiotemporal Maps of Brain Activity Underlying Word Generation and Their Modification during Repetition Priming , 2001, The Journal of Neuroscience.

[57]  C. J. Price,et al.  An fMRI Study of Syntactic Adaptation , 2004, Journal of Cognitive Neuroscience.

[58]  J. Desmond,et al.  Load-Dependent Roles of Frontal Brain Regions in the Maintenance of Working Memory , 1999, NeuroImage.

[59]  David Badre,et al.  Left ventrolateral prefrontal cortex and the cognitive control of memory , 2007, Neuropsychologia.

[60]  Angela D. Friederici,et al.  Lateral Inferotemporal Cortex Maintains ConceptualSemantic Representations in Verbal Working Memory , 2007, Journal of Cognitive Neuroscience.

[61]  S. Sternberg Retrieval of contextual information from memory , 1967 .

[62]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[63]  P. Holcomb Semantic priming and stimulus degradation: implications for the role of the N400 in language processing. , 2007, Psychophysiology.

[64]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[65]  A. Marantz,et al.  A magnetoencephalographic component whose latency reflects lexical frequency. , 2001, Brain research. Cognitive brain research.

[66]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[67]  Matthias Schlesewsky,et al.  Processing linguistic complexity and grammaticality in the left frontal cortex. , 2005, Cerebral cortex.

[68]  G. R. Barnes,et al.  A Quantitative Assessment of the Sensitivity of Whole-Head MEG to Activity in the Adult Human Cortex , 2002, NeuroImage.

[69]  Liina Pylkkänen,et al.  journal homepage: www.elsevier.com/locate/b&l Processing events: Behavioral and neuromagnetic correlates of Aspectual Coercion , 2022 .

[70]  Valerie A. Carr,et al.  Spatiotemporal Dynamics of Modality-Specific and Supramodal Word Processing , 2003, Neuron.

[71]  R. Poldrack,et al.  Dissociable Controlled Retrieval and Generalized Selection Mechanisms in Ventrolateral Prefrontal Cortex , 2005, Neuron.

[72]  Colin Humphries,et al.  Time course of semantic processes during sentence comprehension: An fMRI study , 2007, NeuroImage.

[73]  A. Treisman,et al.  Parietal contributions to visual feature binding: evidence from a patient with bilateral lesions , 1995, Science.

[74]  R. Salmelin Clinical neurophysiology of language: The MEG approach , 2007, Clinical Neurophysiology.

[75]  Thomas G. Bever,et al.  The cognitive basis for linguistic structures1 , 2013 .

[76]  T. Shallice,et al.  Dual-Process Model in Semantic Priming: A Functional Imaging Perspective , 1999, NeuroImage.

[77]  S E Petersen,et al.  A positron emission tomography study of the short-term maintenance of verbal information , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[78]  G. Waters,et al.  Activation of Broca's area by syntactic processing under conditions of concurrent articulation , 2000, Human brain mapping.

[79]  Ayumu Matani,et al.  Early neural activation for lexico-semantic access in the left anterior temporal area analyzed by an fMRI-assisted MEG multidipole method , 2009, NeuroImage.

[80]  Todd B. Parrish,et al.  Language network specializations: An analysis with parallel task designs and functional magnetic resonance imaging , 2005, NeuroImage.

[81]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 2. Depth-recorded potentials in the human frontal and Rolandic cortices , 1994, Journal of Physiology-Paris.

[82]  A. Nobre,et al.  The Response of Left Temporal Cortex to Sentences , 2002, Journal of Cognitive Neuroscience.

[83]  R. Turner,et al.  Sentence Reading: A Functional MRI Study at 4 Tesla , 1997, Journal of Cognitive Neuroscience.

[84]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[85]  M. Corbetta,et al.  Superior Parietal Cortex Activation During Spatial Attention Shifts and Visual Feature Conjunction , 1995, Science.

[86]  Rsenl A. FaulcoNpR Understanding Noun Phrases , 2005 .

[87]  Alec Marantz,et al.  A neural response sensitive to repetition and phonotactic probability: MEG investigations of lexical access , 2000 .

[88]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[89]  D. Swinney,et al.  Response of anterior temporal cortex to syntactic and prosodic manipulations during sentence processing , 2005, Human brain mapping.