Flexibility in Embodied Language Understanding

Do people use sensori-motor cortices to understand language? Here we review neurocognitive studies of language comprehension in healthy adults and evaluate their possible contributions to theories of language in the brain. We start by sketching the minimal predictions that an embodied theory of language understanding makes for empirical research, and then survey studies that have been offered as evidence for embodied semantic representations. We explore four debated issues: first, does activation of sensori-motor cortices during action language understanding imply that action semantics relies on mirror neurons? Second, what is the evidence that activity in sensori-motor cortices plays a functional role in understanding language? Third, to what extent do responses in perceptual and motor areas depend on the linguistic and extra-linguistic context? And finally, can embodied theories accommodate language about abstract concepts? Based on the available evidence, we conclude that sensori-motor cortices are activated during a variety of language comprehension tasks, for both concrete and abstract language. Yet, this activity depends on the context in which perception and action words are encountered. Although modality-specific cortical activity is not a sine qua non of language processing even for language about perception and action, sensori-motor regions of the brain appear to make functional contributions to the construction of meaning, and should therefore be incorporated into models of the neurocognitive architecture of language.

[1]  Daniel A. Weiskopf,et al.  The plurality of concepts , 2009, Synthese.

[2]  Richard B. Ivry,et al.  The Influence of Language on Perception: Listening to Sentences about Faces Affects the Perception of Faces , 2010, The Journal of Neuroscience.

[3]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[4]  T. Aflalo,et al.  Mapping Behavioral Repertoire onto the Cortex , 2007, Neuron.

[5]  Roel M. Willems,et al.  Add a picture for suspense: neural correlates of the interaction between language and visual information in the perception of fear. , 2011, Social cognitive and affective neuroscience.

[6]  J. Bargh,et al.  Experiencing Physical Warmth Promotes Interpersonal Warmth , 2008, Science.

[7]  Michael D. Robinson,et al.  Why the Sunny Side Is Up , 2004, Psychological science.

[8]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[9]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[10]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[11]  Roel M. Willems,et al.  Neural evidence for the interplay between language, gesture, and action: A review , 2007, Brain and Language.

[12]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[13]  S. Dehaene,et al.  Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. , 2002, Brain : a journal of neurology.

[14]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[15]  Sian L. Beilock,et al.  Sports experience changes the neural processing of action language , 2008, Proceedings of the National Academy of Sciences.

[16]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[17]  Sharon L. Thompson-Schill,et al.  Conceptual Representations of Action in the Lateral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[18]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[19]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[20]  M. van Elk,et al.  Short-term action intentions overrule long-term semantic knowledge , 2009, Cognition.

[21]  D. Casasanto,et al.  Similarity and proximity: When does close in space mean close in mind? , 2008, Memory & cognition.

[22]  A. Bianchi FURNISHING THE MIND , 2006 .

[23]  Katie L. McMahon,et al.  Action word meaning representations in cytoarchitectonically defined primary and premotor cortices , 2008, NeuroImage.

[24]  Ludovica Labruna,et al.  A Functional Role for the Motor System in Language Understanding , 2011, Psychological science.

[25]  Jerome A. Feldman,et al.  From Molecule to Metaphor - A Neural Theory of Language , 2006 .

[26]  Matthew H. Davis,et al.  Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging , 2008, The European journal of neuroscience.

[27]  R. Gibbs Embodiment and Cognitive Science: Concepts , 2005 .

[28]  L. Boroditsky Metaphoric structuring: understanding time through spatial metaphors , 2000, Cognition.

[29]  A. Glenberg Language and action: creating sensible combinations of ideas , 2007 .

[30]  Andrea Moro,et al.  Negation in the brain: Modulating action representations , 2008, NeuroImage.

[31]  D. Casasanto,et al.  Motor action and emotional memory , 2010, Cognition.

[32]  Marco Iacoboni,et al.  Are cortical motor maps based on body parts or coordinated actions? Implications for embodied semantics , 2010, Brain and Language.

[33]  Daniel Casasanto,et al.  Neural Dissociations between Action Verb Understanding and Motor Imagery , 2010, Journal of Cognitive Neuroscience.

[34]  Gregory Hickok,et al.  Eight Problems for the Mirror Neuron Theory of Action Understanding in Monkeys and Humans , 2009, Journal of Cognitive Neuroscience.

[35]  Vittorio Gallese,et al.  Task related modulation of the motor system during language processing , 2008, Brain and Language.

[36]  Friedemann Pulvermüller,et al.  Brain Signatures of Meaning Access in Action Word Recognition , 2005, Journal of Cognitive Neuroscience.

[37]  F. Copleston History of Philosophy , 1980 .

[38]  Eleanor M. Saffran,et al.  Clues to the functional and neural architecture of word meaning , 2000 .

[39]  Jiang Xu,et al.  Language in context: emergent features of word, sentence, and narrative comprehension , 2005, NeuroImage.

[40]  R. Ivry,et al.  Please Scroll down for Article Social Neuroscience Modulation of the Ffa and Ppa by Language Related to Faces and Places Modulation of the Ffa and Ppa by Language Related to Faces and Places , 2022 .

[41]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[42]  Michael L. Anderson On the Grounds of (X)-Grounded Cognition , 2008 .

[43]  M. D’Esposito,et al.  An Area within Human Ventral Cortex Sensitive to “Building” Stimuli Evidence and Implications , 1998, Neuron.

[44]  Rolf A. Zwaan,et al.  Motor Resonance and Linguistic Focus , 2008, Quarterly journal of experimental psychology.

[45]  Mareike M. Menz,et al.  Grasping language – A short story on embodiment , 2010, Consciousness and Cognition.

[46]  C N WOOLSEY COMPARATIVE STUDIES ON LOCALIZATION IN PRECENTRAL AND SUPPLEMENTARY MOTOR AREAS. , 1963, International journal of neurology.

[47]  Charles A. Perfetti,et al.  Comprehending written language: a blueprint of the reader , 2000 .

[48]  Holcombe Ingleby Kick the bucket , 1904 .

[49]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[50]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[51]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[52]  A. Glenberg,et al.  Processing Abstract Language Modulates Motor System Activity , 2008, Quarterly journal of experimental psychology.

[53]  O. Hauk,et al.  Neurophysiological distinction of action words in the fronto‐central cortex , 2004, Human brain mapping.

[54]  G. Rizzolatti,et al.  Congruent Embodied Representations for Visually Presented Actions and Linguistic Phrases Describing Actions , 2006, Current Biology.

[55]  Anne Cutler,et al.  Prelexical and lexical processing in listening , 2004 .

[56]  Russell A. Epstein,et al.  The Parahippocampal Place Area Recognition, Navigation, or Encoding? , 1999, Neuron.

[57]  Alex Martin,et al.  Grounding Object Concepts in Perception and Action: Evidence from FMRI Studies of Tools , 2007, Cortex.

[58]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[59]  Sian L. Beilock,et al.  The role of personal experience in the neural processing of action-related language , 2010, Brain and Language.

[60]  W. K. Simmons,et al.  A common neural substrate for perceiving and knowing about color , 2007, Neuropsychologia.

[61]  Roel M. Willems,et al.  Body-specific representations of action verbs: Neural evidence from right- and left-handers , 2009, NeuroImage.

[62]  Friedemann Pulvermüller,et al.  Category specificity in the processing of color-related and form-related words: An ERP study , 2006, NeuroImage.

[63]  M. Arbib From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics , 2005, Behavioral and Brain Sciences.

[64]  J. Elman On the Meaning of Words and Dinosaur Bones: Lexical Knowledge Without a Lexicon , 2009, Cogn. Sci..

[65]  M. Corballis From mouth to hand: Gesture, speech, and the evolution of right-handedness , 2003, Behavioral and Brain Sciences.

[66]  J. Kable,et al.  Neural Substrates of Action Event Knowledge , 2002, Journal of Cognitive Neuroscience.

[67]  Roel M. Willems,et al.  Body-specific representations of action verbs: Neural evidence from right- and left-handers , 2009, NeuroImage.

[68]  E. Stern,et al.  Linguistic threat activates the human amygdala. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[69]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[70]  Bradford Z. Mahon,et al.  Concepts and categories: a cognitive neuropsychological perspective. , 2009, Annual review of psychology.

[71]  Rolf A. Zwaan,et al.  The functional role of motor activation in language processing: Motor cortical oscillations support lexical-semantic retrieval , 2010, NeuroImage.

[72]  Willem J. M. Levelt,et al.  Producing spoken language: A blueprint of the speaker , 1999 .

[73]  C. Woolsey,et al.  Localization in somatic sensory and motor areas of human cerebral cortex as determined by direct recording of evoked potentials and electrical stimulation. , 1979, Journal of neurosurgery.

[74]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[75]  Riitta Hari,et al.  Actor's and observer's primary motor cortices stabilize similarly after seen or heard motor actions , 2007, Proceedings of the National Academy of Sciences.

[76]  Claire L. Moody,et al.  Effects of implied physical effort in sensory-motor and pre-frontal cortex during language comprehension , 2010, NeuroImage.

[77]  Anne Cutler,et al.  Comprehending spoken language: A blueprint of the listener , 1999 .

[78]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[79]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[80]  D. Casasanto,et al.  of Experimental Psychology , 2022 .

[81]  Karl J. Friston,et al.  Brain Mechanisms for Detecting Perceptual, Semantic, and Emotional Deviance , 2000, NeuroImage.

[82]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[83]  Harold Bekkering,et al.  How specifically are action verbs represented in the neural motor system: An fMRI study , 2010, NeuroImage.

[84]  N. J. Enfield,et al.  The Body as a Cognitive Artifact in Kinship Representations , 2005, Current Anthropology.

[85]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[86]  Rolf A. Zwaan,et al.  Motor resonance as a function of narrative time: Further tests of the linguistic focus hypothesis , 2010, Brain and Language.

[87]  T. Talavage,et al.  Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI , 2008, Brain and Language.

[88]  Luigi Cattaneo,et al.  Use-induced motor plasticity affects the processing of abstract and concrete language , 2008, Current Biology.

[89]  Mark S. Seidenberg,et al.  Activation of sensory-motor areas in sentence comprehension. , 2010, Cerebral cortex.

[90]  J. Rothwell,et al.  Theta Burst Stimulation of the Human Motor Cortex , 2005, Neuron.

[91]  Nina F. Dronkers,et al.  What do brain lesions tell us about theories of embodied semantics and the human mirror neuron system? , 2012, Cortex.

[92]  J. Bransford,et al.  Comprehension and semantic flexibility , 1974 .

[93]  A. Clark,et al.  The Extended Mind , 1998, Analysis.

[94]  J. Elman An alternative view of the mental lexicon , 2004, Trends in Cognitive Sciences.

[95]  Michael L. Anderson Embodied Cognition: A field guide , 2003, Artif. Intell..

[96]  P. Calvo,et al.  Handbook of cognitive science : an embodied approach , 2008 .

[97]  Luca Turella,et al.  Mirror neurons in humans: Consisting or confounding evidence? , 2009, Brain and Language.

[98]  John A. Pyles,et al.  fMR-Adaptation Reveals Invariant Coding of Biological Motion on the Human STS , 2009, Front. Hum. Neurosci..

[99]  L. Tyler,et al.  Modulation of motor and premotor cortices by actions, action words and action sentences , 2009, Neuropsychologia.

[100]  Angela D. Friederici,et al.  Comprehending Prehending: Neural Correlates of Processing Verbs with Motor Stems , 2007, Journal of Cognitive Neuroscience.

[101]  Michael P. Kaschak,et al.  The Cambridge Handbook of Situated Cognition: Language in the Brain, Body, and World , 2008 .

[102]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[103]  D. Weiskopf Embodied cognition and linguistic comprehension. , 2010, Studies in history and philosophy of science.

[104]  C. Koch The Neural Basis of Mental Imagery , 2010 .

[105]  Guido Gainotti,et al.  What the Locus of Brain Lesion Tells us About the Nature of the Cognitive Defect Underlying Category-Specific Disorders: A Review , 2000, Cortex.

[106]  F. Donders,et al.  For Review Only The Function of Words: Distinct neural correlates for words denoting differently manipulable objects , 2009 .

[107]  Karen Emmorey,et al.  Modulation of BOLD Response in Motion-sensitive Lateral Temporal Cortex by Real and Fictive Motion Sentences , 2010, Journal of Cognitive Neuroscience.

[108]  Antonino Vallesi,et al.  Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex , 2009, PloS one.

[109]  Rolf A. Zwaan The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[110]  Bruno L. Giordano,et al.  Spatial representation of pitch height: the SMARC effect , 2006, Cognition.

[111]  G. Seagrim Furnishing the mind , 1980 .

[112]  Wolfgang Grodd,et al.  Amygdala activation during reading of emotional adjectives--an advantage for pleasant content. , 2009, Social cognitive and affective neuroscience.

[113]  Marco Tettamanti,et al.  Semantic domain-specific functional integration for action-related vs. abstract concepts , 2010, Brain and Language.

[114]  D. Kemmerer,et al.  The Two-Level Theory of verb meaning: An approach to integrating the semantics of action with the mirror neuron system , 2010, Brain and Language.

[115]  Thomas W. Schubert Your highness: vertical positions as perceptual symbols of power. , 2005, Journal of personality and social psychology.

[116]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[117]  Jeffrey M. Zacks,et al.  Reading Stories Activates Neural Representations of Visual and Motor Experiences , 2009, Psychological science.

[118]  Hein T. van Schie,et al.  You'll never crawl alone: Neurophysiological evidence for experience-dependent motor resonance in infancy , 2008, NeuroImage.