Representation of associative and affective semantic similarity of abstract words in the lateral temporal perisylvian language regions

The examination of semantic cognition has traditionally identified word concreteness as well as valence as two of the principal dimensions in the representation of conceptual knowledge. More recently, corpus-based vector space models as well as graph-theoretical analysis of large-scale task-related behavioural responses have revolutionized our insight into how the meaning of words is structured. In this fMRI study, we apply representational similarity analysis to investigate the conceptual representation of abstract words. Brain activity patterns were related to a cued-association based graph as well as to a vector-based co-occurrence model of word meaning. Twenty-six subjects (19 females and 7 males) performed an overt repetition task during fMRI. First, we performed a searchlight classification procedure to identify regions where activity is discriminable between abstract and concrete words. These regions were left inferior frontal gyrus, the upper and lower bank of the superior temporal sulcus bilaterally, posterior middle temporal gyrus and left fusiform gyrus. Representational Similarity Analysis demonstrated that for abstract words, the similarity of activity patterns in the cortex surrounding the superior temporal sulcus bilaterally and in the left anterior superior temporal gyrus reflects the similarity in word meaning. These effects were strongest for semantic similarity derived from the cued association-based graph and for affective similarity derived from either of the two models. The latter effect was mainly driven by positive valence words. This research highlights the close neurobiological link between the information structure of abstract and affective word content and the similarity in activity pattern in the lateral and anterior temporal language system.

[1]  A. Caramazza,et al.  Neural representation of visual concepts in people born blind , 2018, Nature Communications.

[2]  G. Storms,et al.  Estimating affective word covariates using word association data , 2015, Behavior Research Methods.

[3]  J. Cummine,et al.  Imaging Imageability: Behavioral Effects and Neural Correlates of Its Interaction with Affect and Context , 2016, Front. Hum. Neurosci..

[4]  Anna M. Borghi,et al.  Words as Social Tools: An Embodied View on Abstract Concepts , 2014 .

[5]  A. Paivio Dual coding theory: Retrospect and current status. , 1991 .

[6]  V. Marian,et al.  CLEARPOND: Cross-Linguistic Easy-Access Resource for Phonological and Orthographic Neighborhood Densities , 2012, PloS one.

[7]  Benny B. Briesemeister,et al.  Avoid violence, rioting, and outrage; approach celebration, delight, and strength: Using large text corpora to compute valence, arousal, and the basic emotions , 2015, Quarterly journal of experimental psychology.

[8]  S. Cappa,et al.  The neural representation of abstract words: the role of emotion. , 2014, Cerebral cortex.

[9]  Sharon L. Thompson-Schill,et al.  Resolving conflict: A response to Martin and Cheng (2006) , 2006, Psychonomic bulletin & review.

[10]  S. Cappa,et al.  Abstract and concrete categories? Evidences from neurodegenerative diseases , 2014, Neuropsychologia.

[11]  Gert Storms,et al.  Word associations: Network and semantic properties , 2008, Behavior research methods.

[12]  J. Haxby,et al.  Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects , 1999, Nature Neuroscience.

[13]  R. Laforce,et al.  Comprehension of concrete and abstract words in semantic variant primary progressive aphasia and Alzheimer’s disease: A behavioral and neuroimaging study , 2017, Brain and Language.

[14]  Gabriella Vigliocco,et al.  The left inferior frontal gyrus: A neural crossroads between abstract and concrete knowledge , 2018, NeuroImage.

[15]  Richard J. Binney,et al.  A Neuropsychological Perspective on Abstract Word Representation: From Theory to Treatment of Acquired Language Disorders , 2016, Current Neurology and Neuroscience Reports.

[16]  Markus J. Hofmann,et al.  Now you see it, now you don't: on emotion, context, and the algorithmic prediction of human imageability judgments , 2013, Front. Psychol..

[17]  S. Shinkareva,et al.  Neural representation of abstract and concrete concepts: A meta‐analysis of neuroimaging studies , 2010, Human brain mapping.

[18]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[19]  E. Warrington,et al.  The differential dependence of abstract and concrete words upon associative and similarity-based information: Complementary semantic interference and facilitation effects , 2010, Cognitive neuropsychology.

[20]  Elizabeth Jefferies,et al.  Exploring the role of the posterior middle temporal gyrus in semantic cognition: Integration of anterior temporal lobe with executive processes , 2016, NeuroImage.

[21]  Massimo Poesio,et al.  Visually Grounded and Textual Semantic Models Differentially Decode Brain Activity Associated with Concrete and Abstract Nouns , 2017, TACL.

[22]  Wolf Vanpaemel,et al.  Exemplar by feature applicability matrices and other Dutch normative data for semantic concepts , 2008, Behavior research methods.

[23]  Christian Biemann,et al.  Simple Co-Occurrence Statistics Reproducibly Predict Association Ratings , 2018, Cogn. Sci..

[24]  Paul Hoffman,et al.  The Semantic Network at Work and Rest: Differential Connectivity of Anterior Temporal Lobe Subregions , 2016, The Journal of Neuroscience.

[25]  Gerrit Storms,et al.  Predicting Lexical Norms Using a Word Association Corpus , 2015, CogSci.

[26]  Rutvik H Desai,et al.  The multifaceted abstract brain , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Wei Wu,et al.  Organizational Principles of Abstract Words in the Human Brain , 2018, Cerebral cortex.

[28]  T. Rogers,et al.  The neural and computational bases of semantic cognition , 2016, Nature Reviews Neuroscience.

[29]  Birk Diedenhofen,et al.  cocor: A Comprehensive Solution for the Statistical Comparison of Correlations , 2015, PloS one.

[30]  P. Dupont,et al.  Left perirhinal cortex codes for similarity in meaning between written words: Comparison with auditory word input , 2015, Neuropsychologia.

[31]  B. Bergmans,et al.  Multivariate analysis reveals anatomical correlates of naming errors in primary progressive aphasia , 2019, Neurobiology of Aging.

[32]  Simon De Deyne,et al.  Redefining the resolution of semantic knowledge in the brain: Advances made by the introduction of models of semantics in neuroimaging , 2019, Neuroscience & Biobehavioral Reviews.

[33]  C. Unkelbach,et al.  Why Good Is More Alike Than Bad: Processing Implications , 2017, Trends in Cognitive Sciences.

[34]  Gert Storms,et al.  Examining assortativity in the mental lexicon: Evidence from word associations , 2015, Psychonomic bulletin & review.

[35]  Grant M. Walker,et al.  Neuroanatomical dissociation for taxonomic and thematic knowledge in the human brain , 2011, Proceedings of the National Academy of Sciences.

[36]  Michaël A. Stevens,et al.  Word knowledge in the crowd: Measuring vocabulary size and word prevalence in a massive online experiment , 2015, Quarterly journal of experimental psychology.

[37]  Marc Brysbaert,et al.  SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles , 2010, Behavior research methods.

[38]  Amy Perfors,et al.  The “Small World of Words” English word association norms for over 12,000 cue words , 2018, Behavior Research Methods.

[39]  Jeffrey R. Binder,et al.  Modulation of the semantic system by word imageability , 2005, NeuroImage.

[40]  Patrick Dupont,et al.  Left perirhinal cortex codes for semantic similarity between written words defined from cued word association , 2019, NeuroImage.

[41]  M. Brysbaert,et al.  Norms of valence, arousal, dominance, and age of acquisition for 4,300 Dutch words , 2013, Behavior research methods.

[42]  Max M. Louwerse,et al.  Symbol Interdependency in Symbolic and Embodied Cognition , 2011, Top. Cogn. Sci..

[43]  Lewis Pollock,et al.  Statistical and methodological problems with concreteness and other semantic variables: A list memory experiment case study , 2018, Behavior research methods.

[44]  Rutvik H. Desai,et al.  Effects of semantic neighborhood density in abstract and concrete words , 2017, Cognition.

[45]  M. Brysbaert,et al.  Explaining human performance in psycholinguistic tasks with models of semantic similarity based on prediction and counting : A review and empirical validation , 2017 .

[46]  Geoff Hollis,et al.  Extrapolating human judgments from skip-gram vector representations of word meaning , 2017, Quarterly journal of experimental psychology.

[47]  P. Hoffman The meaning of ‘life’ and other abstract words: Insights from neuropsychology , 2015, Journal of neuropsychology.

[48]  M. Louwerse,et al.  The linguistic and embodied nature of conceptual processing , 2010, Cognition.

[49]  Jing Wang,et al.  Decoding abstract and concrete concept representations based on single‐trial fMRI data , 2013, Human brain mapping.

[50]  L. Otten,et al.  Concreteness in word processing: ERP and behavioral effects in a lexical decision task , 2013, Brain and Language.

[51]  Friedemann Pulvermüller,et al.  Representational Similarity Mapping of Distributional Semantics in Left Inferior Frontal, Middle Temporal, and Motor Cortex , 2017, Cerebral cortex.

[52]  David A. Medler,et al.  Distinct Brain Systems for Processing Concrete and Abstract Concepts , 2005, Journal of Cognitive Neuroscience.

[53]  C. Norbury,et al.  Acquisition of abstract concepts is influenced by emotional valence. , 2018, Developmental science.

[54]  Danielle J. Navarro,et al.  Better explanations of lexical and semantic cognition using networks derived from continued rather than single-word associations , 2012, Behavior Research Methods.

[55]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[56]  Michael F. Bonner,et al.  Reversal of the concreteness effect in semantic dementia , 2009, Cognitive neuropsychology.

[57]  J. B. Jackson,et al.  "How do you know what you know?". , 2004, HIV prevention plus!.

[58]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[59]  J. M. Kittross The measurement of meaning , 1959 .

[60]  Roy W Jones,et al.  Comprehension of concrete and abstract words in semantic dementia. , 2009, Neuropsychology.

[61]  Michaël A. Stevens,et al.  Norms of age of acquisition and concreteness for 30,000 Dutch words. , 2014, Acta psychologica.

[62]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[63]  Christopher Barry,et al.  When Does a Deep Dyslexic Make a Semantic Error? The Roles of Age-of-Acquisition, Concreteness, and Frequency , 2000, Brain and Language.

[64]  Roy W Jones,et al.  Be concrete to be comprehended: Consistent imageability effects in semantic dementia for nouns, verbs, synonyms and associates , 2013, Cortex.

[65]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[66]  Martin N. Hebart,et al.  The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data , 2015, Front. Neuroinform..

[67]  Richard J. Binney,et al.  Differing contributions of inferior prefrontal and anterior temporal cortex to concrete and abstract conceptual knowledge , 2015, Cortex.

[68]  E. Shoben,et al.  Differential Context Effects in the Comprehension of Abstract and Concrete Verbal Materials , 1983 .

[69]  M. L. Lambon Ralph,et al.  The role of the anterior temporal lobes in the comprehension of concrete and abstract words: rTMS evidence , 2009, Cortex.

[70]  P. Dupont,et al.  Similarity of fMRI Activity Patterns in Left Perirhinal Cortex Reflects Semantic Similarity between Words , 2013, The Journal of Neuroscience.

[71]  D. Mirman,et al.  Damage to temporo-parietal cortex decreases incidental activation of thematic relations during spoken word comprehension , 2012, Neuropsychologia.

[72]  Klaus Fliessbach,et al.  The effect of word concreteness on recognition memory , 2006, NeuroImage.

[73]  A. Jacobs,et al.  Neuroscience and Biobehavioral Reviews Interactive Activation and Competition Models and Semantic Context: from Behavioral to Brain Data , 2022 .

[74]  Randi C. Martin,et al.  Selection demands versus association strength in the verb generation task , 2006 .

[75]  Patrick Dupont,et al.  Cross-modal representation of spoken and written word meaning in left pars triangularis , 2017, NeuroImage.

[76]  E. Warrington,et al.  Abstract and concrete concepts have structurally different representational frameworks. , 2005, Brain : a journal of neurology.

[77]  G. Vigliocco,et al.  The representation of abstract words: why emotion matters. , 2011, Journal of experimental psychology. General.

[78]  Richard J. Binney,et al.  The ventral and inferolateral aspects of the anterior temporal lobe are crucial in semantic memory: evidence from a novel direct comparison of distortion-corrected fMRI, rTMS, and semantic dementia. , 2010, Cerebral cortex.