Body part representations in verbal semantics

Embodied theories of language propose that word meaning is inextricably tied to—grounded in—mental representations of perceptual, motor, and affective experiences of the world. The four experiments described in this article demonstrate that accessing the meanings of action verbs like smile, punch, and kick requires language understanders to activate modality-specific cognitive representations responsible for performing and perceiving those same actions. The main task used is a word-image matching task, where participants see an action verb and an image depicting an action. Their task is to decide as quickly as possible whether the verb and the image depict the same action. Of critical interest is participants’ behavior when the verb and image do not match, in which case the two actions can use the same effector or different effectors. In Experiment 1, we found that participants took significantly longer to reject a verb-image pair when the actions depicted by the image and denoted by the verb used the same effector than when they used different effectors. Experiment 2 yielded the same result when the order of presentation was reversed, replicating the effect in Cantonese. Experiment 3 replicated the effect in English with a verb-verb near-synonym task, and in Experiment 4, we once again replicated the effect with learners of English as a second language. This robust interference effect, whereby a shared effector slows discrimination, shows that language understanders activate effector-specific neurocognitive representations during both picture perception and action word understanding.

[1]  Rolf A. Zwaan,et al.  Seeing, acting, understanding: motor resonance in language comprehension. , 2006, Journal of experimental psychology. General.

[2]  M. Kiefer,et al.  The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems , 2008, The Journal of Neuroscience.

[3]  U. Windhorst ON THE ROLE OF RECURRENT INHIBITORY FEEDBACK IN MOTOR CONTROL , 1996, Progress in Neurobiology.

[4]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[5]  Daniel C. Richardson,et al.  Spatial representations activated during real-time comprehension of verbs , 2003, Cogn. Sci..

[6]  A. Glenberg,et al.  Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning , 2000 .

[7]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[8]  B. Bergen,et al.  Lexical Processing Drives Motor Simulation , 2005 .

[9]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[10]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[11]  A. Sirigu,et al.  The Mental Representation of Hand Movements After Parietal Cortex Damage , 1996, Science.

[12]  L. Barsalou,et al.  Head Up, Foot Down , 2008, Psychological science.

[13]  Rolf A. Zwaan Embodied cognition, perceptual symbols, and situation models , 1999 .

[14]  D. Bub,et al.  Kicking Calculators: Contribution of Embodied Representations to Sentence Comprehension. , 2008 .

[15]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[16]  J. Decety,et al.  The cerebellum participates in mental activity: tomographic measurements of regional cerebral blood flow , 1990, Brain Research.

[17]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[18]  J. Pich The Role of Subvocalization in Rehearsal and Maintenance of Rhythmic Patterns , 2000, The Spanish Journal of Psychology.

[19]  J. Feldman,et al.  Embodied meaning in a neural theory of language , 2004, Brain and Language.

[20]  B. Bergen,et al.  Grammatical aspect and mental simulation , 2010, Brain and Language.

[21]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[22]  P. Roland,et al.  Supplementary motor area and other cortical areas in organization of voluntary movements in man. , 1980, Journal of neurophysiology.

[23]  F. Pulvermüller,et al.  Walking or Talking?: Behavioral and Neurophysiological Correlates of Action Verb Processing , 2001, Brain and Language.

[24]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[25]  Benjamin K. Bergen,et al.  Embodied Construction Grammar in Simulation-Based Language Understanding , 2003 .

[26]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Brian MacWhinney,et al.  Perspective taking 1 The Emergence of Grammar from Perspective , 2004 .

[28]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[29]  C. Clifton,et al.  Subvocalization and reading for meaning , 1980 .

[30]  Jerome A. Feldman,et al.  Extending Embodied Lexical Development , 1998 .

[31]  Katie L. McMahon,et al.  Action word meaning representations in cytoarchitectonically defined primary and premotor cortices , 2008, NeuroImage.

[32]  Srini Narayanan,et al.  Spatial and Linguistic Aspects of Visual Imagery in Sentence Comprehension , 2007, Cogn. Sci..

[33]  Bucciarelli,et al.  Proceedings of the Twenty-Seventh Annual Conference of the Cognitive Science Society , 2005 .

[34]  S. Narayanan,et al.  Spatial and Linguistic Aspects of Visual Imagery , 2007 .

[35]  Markus Graf,et al.  The role of action representations in visual object recognition , 2006, Experimental Brain Research.

[36]  Stefan Geyer,et al.  Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. , 2003, Journal of neurophysiology.

[37]  Michael P. Kaschak,et al.  The Action-Sentence Compatibility Effect: It's All in the Timing , 2006, Cogn. Sci..

[38]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[39]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[40]  Benjamin K. Bergen,et al.  Sentence Understanding Engages Motor Processes , 2005 .

[41]  Rolf A. Zwaan,et al.  Grounding Cognition: Introduction to Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking , 2005 .

[42]  Lars-Göran Nilsson,et al.  Reactivation of Motor Brain Areas during Explicit Memory for Actions , 2001, NeuroImage.

[43]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[44]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[45]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[46]  Brian MacWhinney,et al.  Grounding Cognition: The Emergence of Grammar from Perspective , 2005 .

[47]  Susan T. Dumais,et al.  The latent semantic analysis theory of knowledge , 1997 .

[48]  T. Matlock Fictive motion as cognitive simulation , 2004, Memory & cognition.

[49]  B. Bergen Experimental methods for simulation semantics , 2007 .

[50]  Mirjam Fried,et al.  Construction grammars : cognitive grounding and theoretical extensions , 2005 .

[51]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .

[52]  Jerome A. Feldman,et al.  From Molecule to Metaphor - A Neural Theory of Language , 2006 .

[53]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[54]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.