Semantic domain-specific functional integration for action-related vs. abstract concepts

A central topic in cognitive neuroscience concerns the representation of concepts and the specific neural mechanisms that mediate conceptual knowledge. Recently proposed modal theories assert that concepts are grounded on the integration of multimodal, distributed representations. The aim of the present work is to complement the available neuropsychological and neuroimaging evidence suggesting partially segregated anatomo-functional correlates for concrete vs. abstract concepts, by directly testing the semantic domain-specific patterns of functional integration between language and modal semantic brain regions. We report evidence from a functional magnetic resonance imaging study, in which healthy participants listened to sentences with either an action-related (actions involving physical entities) or an abstract (no physical entities involved) content. We measured functional integration using dynamic causal modeling, and found that the left superior temporal gyrus was more strongly connected: (1) for action-related vs. abstract sentences, with the left-hemispheric action representation system, including sensorimotor areas; (2) for abstract vs. action-related sentences, with left infero-ventral frontal, temporal, and retrosplenial cingulate areas. A selective directionality effect was observed, with causal modulatory effects exerted by perisylvian language regions on peripheral modal areas, and not vice versa. The observed condition-specific modulatory effects are consistent with embodied and situated language processing theories, and indicate that linguistic areas promote a semantic content-specific reactivation of modal simulations by top-down mechanisms.

[1]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[2]  B. Bahrami,et al.  Motion Detection and Motion Verbs , 2007, Psychological science.

[3]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[4]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[5]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[6]  J. Kounios,et al.  Dual-coding, context-availability, and concreteness effects in sentence comprehension: an electrophysiological investigation. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Jeffrey R. Binder,et al.  Modulation of the semantic system by word imageability , 2005, NeuroImage.

[8]  J. Binder,et al.  A Parametric Manipulation of Factors Affecting Task-induced Deactivation in Functional Neuroimaging , 2003, Journal of Cognitive Neuroscience.

[9]  A. Glenberg,et al.  Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning , 2000 .

[10]  Karl J. Friston,et al.  Large-scale neural models and dynamic causal modelling , 2006, NeuroImage.

[11]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[12]  Michael P. Kaschak,et al.  Perception of Auditory Motion Affects Language Processing , 2006, Cogn. Sci..

[13]  D. Perani,et al.  Different neural systems for the recognition of animals and man‐made tools , 1995, Neuroreport.

[14]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Applications , 2002, NeuroImage.

[15]  Bradley G. Goodyear,et al.  Neural Correlates of Concreteness in Semantic Categorization , 2007, Journal of Cognitive Neuroscience.

[16]  W. Levelt Models of word production , 1999, Trends in Cognitive Sciences.

[17]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[18]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[19]  O. Hauk,et al.  Neurophysiological distinction of action words in the fronto‐central cortex , 2004, Human brain mapping.

[20]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[21]  Friedemann Pulvermüller,et al.  Brain Signatures of Meaning Access in Action Word Recognition , 2005, Journal of Cognitive Neuroscience.

[22]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[23]  Paolo Vitali,et al.  Generating animal and tool names: An fMRI study of effective connectivity , 2005, Brain and Language.

[24]  F. Pulvermüller,et al.  Category-specific conceptual processing of color and form in left fronto-temporal cortex. , 2006, Cerebral cortex.

[25]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[26]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[27]  G. Rizzolatti,et al.  Congruent Embodied Representations for Visually Presented Actions and Linguistic Phrases Describing Actions , 2006, Current Biology.

[28]  F. Pulvermüller,et al.  Distributed neuronal networks for encoding category‐specific semantic information: the mismatch negativity to action words , 2004, The European journal of neuroscience.

[29]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[30]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[31]  Xiaoping P. Hu,et al.  fMRI evidence for word association and situated simulation in conceptual processing , 2008, Journal of Physiology-Paris.

[32]  Karl J. Friston,et al.  Dynamic causal models of neural system dynamics: current state and future extensions , 2007, Journal of Biosciences.

[33]  M. Denis,et al.  Cortical anatomy of mental imagery of concrete nouns based on their dictionary definition , 1998, Neuroreport.

[34]  Marc Jeannerod,et al.  Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing , 2006, Journal of Cognitive Neuroscience.

[35]  M. Erb,et al.  The Concreteness Effect: Evidence for Dual Coding and Context Availability , 2000, Brain and Language.

[36]  M. Lucas,et al.  Semantic priming without association: A meta-analytic review , 2000, Psychonomic bulletin & review.

[37]  J. Vizmuller-Zocco,et al.  Lessico di frequenza dell'italiano parlato , 1994 .

[38]  Keith A Hutchison,et al.  Is semantic priming due to association strength or feature overlap? A microanalytic review , 2003, Psychonomic bulletin & review.

[39]  Günter Holtus Tullio De Mauro/Federico Mancini/Massimo Vedovelli/Miriam Voghera, Lessico di frequenza dell'italiano parlato, Ricerca a cura dell'Osservatorio linguistico e culturale italiano OLCI dell'Universita di Roma "La Sapienza", Elaborazione e lemmatizzazione automatica dei testi: Federico Mancini , 1995 .

[40]  Edouard Machery,et al.  Concept empiricism: A methodological critique , 2007, Cognition.

[41]  A. Paivio Dual coding theory: Retrospect and current status. , 1991 .

[42]  Tim Shallice,et al.  The different neural correlates of action and functional knowledge in semantic memory: an FMRI study. , 2008, Cerebral cortex.

[43]  Vittorio Gallese,et al.  Task related modulation of the motor system during language processing , 2008, Brain and Language.

[44]  V. Gallese Before and below ‘theory of mind’: embodied simulation and the neural correlates of social cognition , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[46]  Bradford Z. Mahon,et al.  Action-Related Properties Shape Object Representations in the Ventral Stream , 2007, Neuron.

[47]  K. Kiehl,et al.  Neural pathways involved in the processing of concrete and abstract words , 1999, Human brain mapping.

[48]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[49]  D. Perani,et al.  The neural correlates of verb and noun processing. A PET study. , 1999, Brain : a journal of neurology.

[50]  R. W. Stowe,et al.  Context availability and lexical decisions for abstract and concrete words , 1988 .

[51]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[52]  Uta Noppeney,et al.  Retrieval of abstract semantics , 2004, NeuroImage.

[53]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[54]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[55]  M. Greicius,et al.  Default-Mode Activity during a Passive Sensory Task: Uncoupled from Deactivation but Impacting Activation , 2004, Journal of Cognitive Neuroscience.

[56]  Murray Grossman,et al.  The Neural Basis for Category-Specific Knowledge: An fMRI Study , 2002, NeuroImage.

[57]  Andrea Moro,et al.  Negation in the brain: Modulating action representations , 2008, NeuroImage.

[58]  Peter Mariën,et al.  Neuropsychological Research : A Review , 2008 .

[59]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[60]  Friedemann Pulvermüller,et al.  Reading cinnamon activates olfactory brain regions , 2006, NeuroImage.

[61]  Karl J. Friston,et al.  Modelling Geometric Deformations in Epi Time Series , 2022 .

[62]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[63]  M. Farah,et al.  A functional MRI study of mental image generation , 1997, Neuropsychologia.

[64]  W. K. Simmons,et al.  Pictures of appetizing foods activate gustatory cortices for taste and reward. , 2005, Cerebral cortex.

[65]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[66]  L. Buxbaum,et al.  Distinctions between manipulation and function knowledge of objects: evidence from functional magnetic resonance imaging. , 2005, Brain research. Cognitive brain research.

[67]  J. Fadili,et al.  The neural representation of nouns and verbs: PET studies. , 2001, Brain : a journal of neurology.

[68]  M. Raichle,et al.  Searching for a baseline: Functional imaging and the resting human brain , 2001, Nature Reviews Neuroscience.

[69]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[70]  Karl J. Friston,et al.  Two distinct neural mechanisms for category-selective responses. , 2006, Cerebral cortex.

[71]  F. Pulvermüller,et al.  Neurophysiological distinction of verb categories , 2000, Neuroreport.

[72]  J. Kounios,et al.  Concreteness effects in semantic processing: ERP evidence supporting dual-coding theory. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[73]  Guido Gainotti,et al.  A metanalysis of impaired and spared naming for different categories of knowledge in patients with a visuo-verbal disconnection , 2004, Neuropsychologia.

[74]  David A. Medler,et al.  Distinct Brain Systems for Processing Concrete and Abstract Concepts , 2005, Journal of Cognitive Neuroscience.

[75]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[76]  Deepak N. Pandya,et al.  Neural circuitry underlying language , 2008 .

[77]  F Pulvermüller,et al.  The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory–motor networks by sounds associated with finger and tongue movements , 2006, The European journal of neuroscience.

[78]  D. McDermott LANGUAGE OF THOUGHT , 2012 .

[79]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.