A neuroanatomical examination of embodied cognition: semantic generation to action-related stimuli

The theory of embodied cognition postulates that the brain represents semantic knowledge as a function of the interaction between the body and the environment. The goal of our research was to provide a neuroanatomical examination of embodied cognition using action-related pictures and words. We used functional magnetic resonance imaging (fMRI) to examine whether there were shared and/or unique regions of activation between an ecologically valid semantic generation task and a motor task in the parietal-frontocentral network (PFN), as a function of stimulus format (pictures versus words) for two stimulus types (hand and foot). Unlike other methods for neuroimaging analyses involving subtractive logic or conjoint analyses, this method first isolates shared and unique regions of activation within-participants before generating an averaged map. The results demonstrated shared activation between the semantic generation and motor tasks, which was organized somatotopically in the PFN, as well as unique activation for the semantic generation tasks in proximity to the hand or foot motor cortex. We also found unique and shared regions of activation in the PFN as a function of stimulus format (pictures versus words). These results further elucidate embodied cognition in that they show that brain regions activated during actual motor movements were also activated when an individual verbally generates action-related semantic information. Disembodied cognition theories and limitations are also discussed.

[1]  W. Penfield,et al.  The Cerebral Cortex of Man: A Clinical Study of Localization of Function , 1968 .

[2]  F. Lhermitte,et al.  A visual-speech disconnexion syndrome. Report of a case with optic aphasia, agnosic alexia and colour agnosia. , 1973, Brain : a journal of neurology.

[3]  S. Black,et al.  Semantic encoding of pictures and words: Some neuropsychological observations , 1988 .

[4]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[5]  John Hart,et al.  Delineation of single‐word semantic comprehension deficits in aphasia, with anatomical correlation , 1990, Annals of neurology.

[6]  Alfonso Caramazza,et al.  The multiple semantics hypothesis: Multiple confusions? , 1990 .

[7]  S. Kosslyn,et al.  Topographical representations of mental images in primary visual cortex , 1995, Nature.

[8]  Richard S. J. Frackowiak,et al.  Functional anatomy of a common semantic system for words and pictures , 1996, Nature.

[9]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[10]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[11]  F Pulvermüller,et al.  Nouns and verbs in the intact brain: evidence from event-related potentials and high-frequency cortical responses. , 1999, Cerebral cortex.

[12]  David Howard,et al.  GOGI APHASIA OR SEMANTIC DEMENTIA? SIMULATING AND ASSESSING POOR VERBAL COMPREHENSION IN A CASE OF PROGRESSIVE FLUENT APHASIA , 2000, Cognitive neuropsychology.

[13]  F. Pulvermüller,et al.  Neurophysiological distinction of verb categories , 2000, Neuroreport.

[14]  Alex Martin,et al.  Functional Neuroimaging of Semantic Memory , 2001 .

[15]  R. Cabeza,et al.  Handbook of functional neuroimaging of cognition , 2001 .

[16]  J R Hodges,et al.  Selective impairment of verb processing associated with pathological changes in Brodmann areas 44 and 45 in the motor neurone disease-dementia-aphasia syndrome. , 2001, Brain : a journal of neurology.

[17]  Alex Martin,et al.  Semantic memory and the brain: structure and processes , 2001, Current Opinion in Neurobiology.

[18]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[19]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[20]  Glyn W Humphreys,et al.  Privileged access to action for objects relative to words , 2002, Psychonomic bulletin & review.

[21]  Matthew T. Keener,et al.  Differences in word associations to pictures and words , 2003, Neuropsychologia.

[22]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[23]  T. Ziemke,et al.  Making sense of embodiment : simulation theories and the sharing of neural circuitry , 2004 .

[24]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[25]  R. Gibbs.  Embodiment and Cognitive Science: Concepts , 2005 .

[26]  Ron Borowsky,et al.  Functional MRI activation maps from empirically defined curve fitting , 2005 .

[27]  Alfonso Caramazza,et al.  The orchestration of the sensory-motor systems: Clues from Neuropsychology , 2005, Cognitive neuropsychology.

[28]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[29]  Friedemann Pulvermüller,et al.  Brain Signatures of Meaning Access in Action Word Recognition , 2005, Journal of Cognitive Neuroscience.

[30]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[31]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[32]  Ron Borowsky,et al.  Modularity and Intersection of “What”, “Where” and “How” Processing of Visual Stimuli: A New Method of fMRI Localization , 2005, Brain Topography.

[33]  Ron Borowsky,et al.  Neuroimaging of language processes: fMRI of silent and overt lexical processing and the promise of multiple process imaging in single brain studies. , 2005, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[34]  G. Rizzolatti,et al.  Congruent Embodied Representations for Visually Presented Actions and Linguistic Phrases Describing Actions , 2006, Current Biology.

[35]  S. Cappa,et al.  Action and object naming in frontotemporal dementia, progressive supranuclear palsy, and corticobasal degeneration. , 2006, Neuropsychology.

[36]  Carlo Miniussi,et al.  Effect of transcranial magnetic stimulation on action naming in patients with Alzheimer disease. , 2006, Archives of neurology.

[37]  Ron Borowsky,et al.  FMRI of Ventral and Dorsal Processing Streams in Basic Reading Processes: Insular Sensitivity to Phonology , 2006, Brain Topography.

[38]  Alfonso Caramazza,et al.  What is the role of motor simulation in action and object recognition? Evidence from apraxia , 2007, Cognitive neuropsychology.

[39]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[40]  Ron Borowsky,et al.  Neural Representations of Visual Words and Objects: A Functional MRI Study on the Modularity of Reading and Object Processing , 2007, Brain Topography.

[41]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[42]  Roel M. Willems,et al.  Neural evidence for the interplay between language, gesture, and action: A review , 2007, Brain and Language.

[43]  C. Esopenko,et al.  Mapping the Semantic Homunculus: A Functional and Behavioural Analysis of Overt Semantic Generation , 2008, Brain Topography.

[44]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[45]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[46]  Penny M. Pexman,et al.  Evidence for the activation of sensorimotor information during visual word recognition: The body–object interaction effect , 2008, Cognition.

[47]  Kim Wilson,et al.  The Benefits of Sensorimotor Knowledge: Body-Object Interaction Facilitates Semantic Processing , 2008, Cogn. Sci..

[48]  M. Jeannerod,et al.  Word processing in Parkinson's disease is impaired for action verbs but not for concrete nouns , 2008, Neuropsychologia.

[49]  Lawrence W Barsalou,et al.  Simulation, situated conceptualization, and prediction , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  L. Tyler,et al.  Modulation of motor and premotor cortices by actions, action words and action sentences , 2009, Neuropsychologia.

[51]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[52]  Scott T. Grafton.  Embodied Cognition and the Simulation of Action to Understand Others , 2009, Annals of the New York Academy of Sciences.

[53]  T. Nazir,et al.  Interwoven Functionality of the Brain's Action and Language Systems , 2010 .

[54]  C. Esopenko,et al.  Naming and semantic processing of action-related stimuli following right versus left hemispherectomy , 2011, Epilepsy & Behavior.

[55]  C. Esopenko,et al.  Localisation of function for noun and verb reading: Converging evidence for shared processing from fMRI activation and reaction time , 2013 .