Duality of Function: Activation for Meaningless Nonwords and Semantic Codes in the Same Brain Areas

Abstract Studies of the neural substrates of semantic (word meaning) processing have typically focused on semantic manipulations, with less consideration for potential differences in difficulty across conditions. While the idea that particular brain regions can support multiple functions is widely accepted, studies of specific cognitive domains rarely test for co-location with other functions. Here we start with standard univariate analyses comparing words to meaningless nonwords, replicating our recent finding that this contrast can activate task-positive regions for words, and default-mode regions in the putative semantic network for nonwords, pointing to difficulty effects. Critically, this was followed up with a multivariate analysis to test whether the same areas activated for meaningless nonwords contained semantic information sufficient to distinguish high- from low-imageability words. Indeed, this classification was performed reliably better than chance at 75% accuracy. This is compatible with two non-exclusive interpretations. Numerous areas in the default-mode network are task-negative in the sense of activating for less demanding conditions, and the same areas contain information supporting semantic cognition. Therefore, while areas of the default mode network have been hypothesized to support semantic cognition, we offer evidence that these areas can respond to both domain-general difficulty effects, and to specific aspects of semantics.

[1]  R. Buckner,et al.  Functional-Anatomic Fractionation of the Brain's Default Network , 2010, Neuron.

[2]  Bradley G. Goodyear,et al.  Neural Correlates of Concreteness in Semantic Categorization , 2007, Journal of Cognitive Neuroscience.

[3]  A. Paivio Dual coding theory: Retrospect and current status. , 1991 .

[4]  W. F. Battig,et al.  Handbook of semantic word norms , 1978 .

[5]  Allan Paivio,et al.  Extensions of the Paivio, Yuille, and Madigan (1968) norms , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[6]  Elizabeth Jefferies,et al.  Semantic Processing in the Anterior Temporal Lobes: A Meta-analysis of the Functional Neuroimaging Literature , 2010, Journal of Cognitive Neuroscience.

[7]  Daniel L. Schacter,et al.  Default network activity, coupled with the frontoparietal control network, supports goal-directed cognition , 2010, NeuroImage.

[8]  Jeffrey R. Binder,et al.  Modulation of the semantic system by word imageability , 2005, NeuroImage.

[9]  James R. Booth,et al.  Task dependent lexicality effects support interactive models of reading: A meta-analytic neuroimaging review , 2015, Neuropsychologia.

[10]  Ian S. Hargreaves,et al.  Is more always better? Effects of semantic richness on lexical decision, speeded pronunciation, and semantic classification , 2011, Psychonomic bulletin & review.

[11]  Xingshan Li,et al.  Fine Subdivisions of the Semantic Network Supporting Social and Sensory–Motor Semantic Processing , 2018, Cerebral cortex.

[12]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[13]  A. Paivio,et al.  Concreteness, imagery, and meaningfulness values for 925 nouns. , 1968, Journal of experimental psychology.

[14]  Ian S. Hargreaves,et al.  There are many ways to be rich: Effects of three measures of semantic richness on visual word recognition , 2008, Psychonomic bulletin & review.

[15]  R. Turner,et al.  Detecting Latency Differences in Event-Related BOLD Responses: Application to Words versus Nonwords and Initial versus Repeated Face Presentations , 2002, NeuroImage.

[16]  Markus J. Hofmann,et al.  Now you see it, now you don't: on emotion, context, and the algorithmic prediction of human imageability judgments , 2013, Front. Psychol..

[17]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[18]  S. Shinkareva,et al.  Neural representation of abstract and concrete concepts: A meta‐analysis of neuroimaging studies , 2010, Human brain mapping.

[19]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[20]  J. A. Frost,et al.  Conceptual Processing during the Conscious Resting State: A Functional MRI Study , 1999, Journal of Cognitive Neuroscience.

[21]  David A. Medler,et al.  Distinct Brain Systems for Processing Concrete and Abstract Concepts , 2005, Journal of Cognitive Neuroscience.

[22]  Jing Wang,et al.  Decoding abstract and concrete concept representations based on single‐trial fMRI data , 2013, Human brain mapping.

[23]  D. Perani,et al.  The Effects of Semantic Category and Knowledge Type on Lexical-Semantic Access: A PET Study , 1998, NeuroImage.

[24]  E. T. Possing,et al.  Neural Correlates of Lexical Access during Visual Word Recognition , 2003, Journal of Cognitive Neuroscience.

[25]  Justin L. Vincent,et al.  Distinct brain networks for adaptive and stable task control in humans , 2007, Proceedings of the National Academy of Sciences.

[26]  Lars Kuchinke,et al.  Incidental effects of emotional valence in single word processing: An fMRI study , 2005, NeuroImage.

[27]  William W. Graves,et al.  Reversing the Standard Neural Signature of the Word–Nonword Distinction , 2017, Journal of Cognitive Neuroscience.

[28]  Yi Chen,et al.  Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): Random permutations and cluster size control , 2011, NeuroImage.

[29]  K. Durkin,et al.  Polysemy and the subjective lexicon: Semantic relatedness and the salience of intraword senses , 1989, Journal of psycholinguistic research.

[30]  Mark J. Huff,et al.  An Abundance of Riches: Cross-Task Comparisons of Semantic Richness Effects in Visual Word Recognition , 2012, Front. Hum. Neurosci..

[31]  M. Erb,et al.  The Concreteness Effect: Evidence for Dual Coding and Context Availability , 2000, Brain and Language.

[32]  Karl J. Friston,et al.  Functional ontologies for cognition: The systematic definition of structure and function , 2005, Cognitive neuropsychology.

[33]  J. Duncan The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[34]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[35]  L. Uddin Salience processing and insular cortical function and dysfunction , 2014, Nature Reviews Neuroscience.

[36]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[37]  Michael J Cortese,et al.  Visual word recognition of single-syllable words. , 2004, Journal of experimental psychology. General.

[38]  S. Blumstein,et al.  An Event-Related fMRI Investigation of Implicit Semantic Priming , 2003, Journal of Cognitive Neuroscience.

[39]  M. Denis,et al.  Cortical anatomy of mental imagery of concrete nouns based on their dictionary definition , 1998, Neuroreport.

[40]  Sharon L. Thompson-Schill,et al.  Neuroanatomically separable effects of imageability and grammatical class during single-word comprehension , 2006, Brain and Language.

[41]  Timothy T. Rogers,et al.  Connecting functional brain imaging and Parallel Distributed Processing , 2015 .

[42]  Tamiko Azuma,et al.  Why SAFE Is Better Than FAST: The Relatedness of a Word's Meanings Affects Lexical Decision Times , 1997 .

[43]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[44]  S. Petersen,et al.  Separable Roles for Attentional Control Sub-Systems in Reading Tasks: A Combined Behavioral and fMRI Study , 2013, Cerebral cortex.

[45]  G. Glover,et al.  Dissociable Intrinsic Connectivity Networks for Salience Processing and Executive Control , 2007, The Journal of Neuroscience.

[46]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[47]  William D. Marslen-Wilson,et al.  Modelling the effects of semantic ambiguity in word recognition , 2004, Cogn. Sci..

[48]  M. Raichle The brain's default mode network. , 2015, Annual review of neuroscience.

[49]  Russell A Poldrack,et al.  Science Perspectives on Psychological Mapping Mental Function to Brain Structure: How Can Cognitive Neuroimaging Succeed? on Behalf Of: Association for Psychological Science , 2022 .

[50]  J. Cummine,et al.  Imaging Imageability: Behavioral Effects and Neural Correlates of Its Interaction with Affect and Context , 2016, Front. Hum. Neurosci..

[51]  M. Coltheart,et al.  358,534 nonwords: The ARC Nonword Database , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[52]  R. Poldrack,et al.  Distinct Patterns of Temporal and Directional Connectivity among Intrinsic Networks in the Human Brain , 2017, The Journal of Neuroscience.

[53]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[54]  Russell A. Poldrack,et al.  Analyses of regional-average activation and multivoxel pattern information tell complementary stories , 2012, Neuropsychologia.

[55]  Mark S. Seidenberg,et al.  Computing the meanings of words in reading: cooperative division of labor between visual and phonological processes. , 2004, Psychological review.

[56]  C. Fiebach,et al.  fMRI Evidence for Dual Routes to the Mental Lexicon in Visual Word Recognition , 2002, Journal of Cognitive Neuroscience.

[57]  Matthew H. Davis,et al.  Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging , 2008, The European journal of neuroscience.

[58]  Evelina Fedorenko,et al.  Domain-General Brain Regions Do Not Track Linguistic Input as Closely as Language-Selective Regions , 2017, The Journal of Neuroscience.

[59]  Tamiko Azuma,et al.  Familiarity and relatedness of word meanings: Ratings for 110 homographs , 1996 .

[60]  Jonathan D. Power,et al.  Control-related systems in the human brain , 2013, Current Opinion in Neurobiology.

[61]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[62]  K. Kiehl,et al.  Neural pathways involved in the processing of concrete and abstract words , 1999, Human brain mapping.

[63]  Richard S. J. Frackowiak,et al.  The anatomy of phonological and semantic processing in normal subjects. , 1992, Brain : a journal of neurology.

[64]  Masato Taira,et al.  Reading in a Regular Orthography: An fMRI Study Investigating the Role of Visual Familiarity , 2004, Journal of Cognitive Neuroscience.

[65]  Michael J Cortese,et al.  Imageability ratings for 3,000 monosyllabic words , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[66]  R. Logie,et al.  Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words , 1980 .

[67]  William W. Graves,et al.  Neural Systems for Reading Aloud: A Multiparametric Approach , 2009, Cerebral cortex.

[68]  Xiaoping Hu,et al.  Differential activity in left inferior frontal gyrus for pseudowords and real words: An event‐related fMRI study on auditory lexical decision , 2005, Human brain mapping.

[69]  B. Christensen,et al.  Measuring premorbid IQ in traumatic brain injury: An examination of the validity of the Wechsler Test of Adult Reading (WTAR) , 2008, Journal of clinical and experimental neuropsychology.

[70]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[71]  Stefan Pollmann,et al.  PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI Data , 2009, Neuroinformatics.

[72]  V. Marian,et al.  CLEARPOND: Cross-Linguistic Easy-Access Resource for Phonological and Orthographic Neighborhood Densities , 2012, PloS one.

[73]  Ian S. Hargreaves,et al.  The Neural Consequences of Semantic Richness , 2007, Psychological science.

[74]  D. Howard,et al.  Age of acquisition and imageability ratings for a large set of words, including verbs and function words , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[75]  Matthew H. Davis,et al.  Neural Response Suppression Predicts Repetition Priming of Spoken Words and Pseudowords , 2006, Journal of Cognitive Neuroscience.

[76]  A. Mechelli,et al.  Neuroimaging Studies of Word and Pseudoword Reading: Consistencies, Inconsistencies, and Limitations , 2003, Journal of Cognitive Neuroscience.