Composition of complex numbers: Delineating the computational role of the left anterior temporal lobe

What is the neurobiological basis of our ability to create complex messages with language? Results from multiple methodologies have converged on a set of brain regions as relevant for this general process, but the computational details of these areas remain to be characterized. The left anterior temporal lobe (LATL) has been a consistent node within this network, with results suggesting that although it rather systematically shows increased activation for semantically complex structured stimuli, this effect does not extend to number phrases such as 'three books.' In the present work we used magnetoencephalography to investigate whether numbers in general are an invalid input to the combinatory operations housed in the LATL or whether the lack of LATL engagement for stimuli such as 'three books' is due to the quantificational nature of such phrases. As a relevant test case, we employed complex number terms such as 'twenty-three', where one number term is not a quantifier of the other but rather, the two terms form a type of complex concept. In a number naming paradigm, participants viewed rows of numbers and depending on task instruction, named them as complex number terms ('twenty-three'), numerical quantifications ('two threes'), adjectival modifications ('blue threes') or non-combinatory lists (e.g., 'two, three'). While quantificational phrases failed to engage the LATL as compared to non-combinatory controls, both complex number terms and adjectival modifications elicited a reliable activity increase in the LATL. Our results show that while the LATL does not participate in the enumeration of tokens within a set, exemplified by the quantificational phrases, it does support conceptual combination, including the composition of complex number concepts.

[1]  D. Medin,et al.  Context and structure in conceptual combination , 1988, Cognitive Psychology.

[2]  Sarah M. E. Gierhan,et al.  Shared Language , 2011, Psychological science.

[3]  Tucker Matthew,et al.  "Representing number in the real-time processing of agreement: Self-paced reading evidence from Arabic": Compressed data in RData format for direct download. , 2017 .

[4]  L. Pylkkänen,et al.  Restrictive vs. non-restrictive composition: a magnetoencephalography study , 2014, Language, cognition and neuroscience.

[5]  H. Ijzerman,et al.  Is comfort food really good for the soul? A replication of Troisi and Gabriel's (2011) Study 2 , 2015, Front. Psychol..

[6]  Koen Lamberts,et al.  Knowledge, Concepts, and Categories , 1997 .

[7]  James R. Hurford,et al.  Language and Number: The Emergence of a Cognitive System , 1987 .

[8]  J C Mazziotta,et al.  Automated labeling of the human brain: A preliminary report on the development and evaluation of a forward‐transform method , 1997, Human brain mapping.

[9]  J. Barwise,et al.  Generalized quantifiers and natural language , 1981 .

[10]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[11]  M. McCloskey Cognitive mechanisms in numerical processing: Evidence from acquired dyscalculia , 1992, Cognition.

[12]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Alfonso Caramazza,et al.  Cognitive mechanisms in number processing and calculation: Evidence from dyscalculia , 1985, Brain and Cognition.

[14]  E. Wisniewski Construal and Similarity in Conceptual Combination , 1996 .

[15]  James R. Hurford,et al.  The interaction between numerals and nouns , 1998 .

[16]  Klaus Willmes,et al.  Decade breaks in the mental number line? Putting the tens and units back in different bins , 2001, Cognition.

[17]  A. Inkeles,et al.  International Encyclopedia of the Social Sciences. , 1968 .

[18]  Liina Pylkkänen,et al.  Simple Composition: A Magnetoencephalography Investigation into the Comprehension of Minimal Linguistic Phrases , 2011, The Journal of Neuroscience.

[19]  A. Nobre,et al.  The Response of Left Temporal Cortex to Sentences , 2002, Journal of Cognitive Neuroscience.

[20]  A. Meyer Lexical Access in Phrase and Sentence Production: Results from Picture–Word Interference Experiments , 1996 .

[21]  Manuel Carreiras,et al.  Where syntax meets math: Right intraparietal sulcus activation in response to grammatical number agreement violations , 2010, NeuroImage.

[22]  M. Erb,et al.  Overt sentence production in event-related fMRI , 2005, Neuropsychologia.

[23]  D. Pandya,et al.  Association areas of the cerebral cortex , 1982, Trends in Neurosciences.

[24]  Xinlin Zhou,et al.  Holistic or compositional representation of two-digit numbers? Evidence from the distance, magnitude, and SNARC effects in a number-matching task , 2008, Cognition.

[25]  Ali Idrissi,et al.  Representing number in the real-time processing of agreement: self-paced reading evidence from Arabic , 2015, Front. Psychol..

[26]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[27]  Xavier Seron,et al.  Numerical transcoding: A general production model. , 1987 .

[28]  Y. Adachi,et al.  Reduction of non-periodic environmental magnetic noise in MEG measurement by continuously adjusted least squares method , 2001 .

[29]  Godehard Link The Logical Analysis of Plurals and Mass Terms: A Lattice‐theoretical Approach , 2008 .

[30]  A. Damasio,et al.  A role for left temporal pole in the retrieval of words for unique entities , 2001, Human brain mapping.

[31]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[32]  Jiang Xu,et al.  Language in context: emergent features of word, sentence, and narrative comprehension , 2005, NeuroImage.

[33]  S. Dehaene Varieties of numerical abilities , 1992, Cognition.

[34]  Liina Pylkkänen,et al.  MEG evidence for conceptual combination but not numeral quantification in the left anterior temporal lobe during language production , 2014, Front. Psychol..

[35]  Peter Hagoort,et al.  The neurobiology of language beyond single words. , 2014, Annual review of neuroscience.

[36]  Peter Indefrey,et al.  Hemodynamic studies of syntactic processing , 2012 .

[37]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[38]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[39]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[40]  L. Pylkkänen,et al.  Basic linguistic composition recruits the left anterior temporal lobe and left angular gyrus during both listening and reading. , 2013, Cerebral cortex.

[41]  A. A. Wijers,et al.  Localizing components of a complex task: sentence processing and working memory , 1998, Neuroreport.

[42]  Liina Pylkkänen,et al.  The role of the left anterior temporal lobe in semantic composition vs. semantic memory , 2014, Neuropsychologia.

[43]  W. R. Garner,et al.  Reaction time as a measure of span of attention. , 1948, The Journal of psychology.

[44]  Liina Pylkkänen,et al.  The interplay of composition and concept specificity in the left anterior temporal lobe: An MEG study , 2015, NeuroImage.

[45]  Michael Ruisdael Bennett,et al.  Some extensions of a montague fragment of English , 1974 .

[46]  Arne Nagels,et al.  Where the Mass Counts: Common Cortical Activation for Different Kinds of Nonsingularity , 2012, Journal of Cognitive Neuroscience.

[47]  M. Brysbaert Arabic number reading: On the nature of the numerical scale and the origin of phonological recoding. , 1995 .

[48]  M. Guha The Handbook of the Neuropsychology of Language , 2012 .

[49]  Colin Humphries,et al.  Time course of semantic processes during sentence comprehension: An fMRI study , 2007, NeuroImage.

[50]  S. Dehaene,et al.  Is numerical comparison digital? Analogical and symbolic effects in two-digit number comparison. , 1990, Journal of experimental psychology. Human perception and performance.

[51]  Simon B. Eickhoff,et al.  Specialisation in Broca's region for semantic, phonological, and syntactic fluency? , 2008, NeuroImage.

[52]  William D. Marslen-Wilson,et al.  Left inferior frontal cortex and syntax: function, structure and behaviour in patients with left hemisphere damage , 2011, Brain : a journal of neurology.

[53]  Alex Clarke,et al.  The Evolution of Meaning: Spatio-temporal Dynamics of Visual Object Recognition , 2011, Journal of Cognitive Neuroscience.

[54]  Daniel N. Osherson,et al.  Evidence for conceptual combination in the left anterior temporal lobe , 2011, NeuroImage.

[55]  J.C. Mosher,et al.  Recursive MUSIC: A framework for EEG and MEG source localization , 1998, IEEE Transactions on Biomedical Engineering.

[56]  Gregory L. Murphy,et al.  Noun phrase interpretation and conceptual combination , 1990 .

[57]  Alan C. Bale,et al.  Cross-linguistic representations of numerals and number marking , 2010 .

[58]  T. Rogers,et al.  Anterior temporal cortex and semantic memory: Reconciling findings from neuropsychology and functional imaging , 2006, Cognitive, affective & behavioral neuroscience.

[59]  P Hagoort,et al.  A neural correlate of syntactic encoding during speech production , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Ora Matushansky,et al.  The Composition of Complex Cardinals , 2006, J. Semant..

[61]  Billi Randall,et al.  From perception to conception: how meaningful objects are processed over time. , 2013, Cerebral cortex.

[62]  Ellen F. Lau,et al.  Agreement Attraction in Comprehension: Representations and Processes. , 2009 .

[63]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[64]  Stephen Grossberg,et al.  A neural model of how the brain represents and compares multi-digit numbers: spatial and categorical processes , 2003, Neural Networks.

[65]  M. McCloskey,et al.  Cognitive processes in verbal-number production: inferences from the performance of brain-damaged subjects. , 1986, Journal of experimental psychology. General.

[66]  H. Schriefers,et al.  Parallelism in the Production of Noun Phrases: Experiments and Reaction Time Models. , 1999 .

[67]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[68]  Philip A. Cook,et al.  Heteromodal conceptual processing in the angular gyrus , 2013, NeuroImage.

[69]  J. Rodd,et al.  Processing Objects at Different Levels of Specificity , 2004, Journal of Cognitive Neuroscience.

[70]  S. Dehaene,et al.  THREE PARIETAL CIRCUITS FOR NUMBER PROCESSING , 2003, Cognitive neuropsychology.

[71]  Tom Verguts,et al.  Two-digit comparison: decomposed, holistic, or hybrid? , 2005, Experimental psychology.

[72]  Frans Plank,et al.  Noun phrase structure in the languages of Europe , 2002 .

[73]  Liina Pylkkänen,et al.  Building phrases in language production: An MEG study of simple composition , 2014, Cognition.

[74]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[75]  Amit Almor,et al.  The neural representation of plural discourse entities , 2014, Brain and Language.

[76]  Liina Pylkkänen,et al.  MEG evidence that the LIFG effect of object extraction requires similarity-based interference , 2013, Language and cognitive processes.

[77]  James R. Hurford,et al.  The linguistic theory of numerals , 1975 .

[78]  D. Pandya,et al.  Corticothalamic connections of the posterior parietal cortex in the rhesus monkey , 1985, The Journal of comparative neurology.

[79]  Colin M. Brown,et al.  Syntactic Processing in Left Prefrontal Cortex Is Independent of Lexical Meaning , 2001, NeuroImage.

[80]  N. Alpert,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1996, Brain and Language.

[81]  M. Pickering,et al.  An integrated theory of language production and comprehension. , 2013, The Behavioral and brain sciences.

[82]  F.-Xavier Alario,et al.  Frequency effects in noun phrase production: Implications for models of lexical access , 2002 .

[83]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[84]  Michael F. Bonner,et al.  Converging Evidence for the Neuroanatomic Basis of Combinatorial Semantics in the Angular Gyrus , 2015, The Journal of Neuroscience.

[85]  Liina Pylkkänen,et al.  The LATL as locus of composition: MEG evidence from English and Arabic , 2015, Brain and Language.

[86]  Liina Pylkkänen,et al.  The time-course and spatial distribution of brain activity associated with sentence processing , 2012, NeuroImage.

[87]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[88]  E. L. Kaufman,et al.  The discrimination of visual number. , 1949, The American journal of psychology.

[89]  M. Tarr,et al.  Levels of categorization in visual recognition studied using functional magnetic resonance imaging , 1997, Current Biology.

[90]  L. Tyler,et al.  Unitary vs multiple semantics: PET studies of word and picture processing , 2004, Brain and Language.

[91]  Marc Brysbaert,et al.  Single-digit and two-digit Arabic numerals address the same semantic number line , 1999, Cognition.

[92]  Colin Humphries,et al.  Syntactic and Semantic Modulation of Neural Activity during Auditory Sentence Comprehension , 2006, Journal of Cognitive Neuroscience.

[93]  Max J. Cresswell,et al.  Formal philosophy, selected papers of richard montague , 1976 .

[94]  J. Hampton Conceptual combination , 2003 .

[95]  R. Scha Distributive, Collective and Cumulative Quantification , 1984 .

[96]  A. Friederici The brain basis of language processing: from structure to function. , 2011, Physiological reviews.

[97]  Gregory Hickok,et al.  Selective attention to semantic and syntactic features modulates sentence processing networks in anterior temporal cortex. , 2009, Cerebral cortex.

[98]  Peter Hagoort,et al.  Shared Syntax in Language Production and Language Comprehension—An fMRI Study , 2011, Cerebral cortex.

[99]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[100]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[101]  Naama Friedmann,et al.  Breaking down number syntax: Spared comprehension of multi-digit numbers in a patient with impaired digit-to-word conversion , 2014, Cortex.