Bidirectional semantic interference between action and speech

Research on embodied cognition assumes that language processing involves modal simulations that recruit the same neural systems that are usually used for action execution. If this is true, one should find evidence for bidirectional crosstalk between action and language. Using a direct matching paradigm, this study tested if action–languages interactions are bidirectional (Experiments 1 and 2), and whether the effect of crosstalk between action perception and language production is due to facilitation or interference (Experiment 3). Replicating previous findings, we found evidence for crosstalk when manual actions had to be performed simultaneously to action–word perception (Experiment 1) and also when language had to be produced during simultaneous perception of hand actions (Experiment 2). These findings suggest a clear bidirectional relationship between action and language. The latter crosstalk effect was due to interference between action and language (Experiment 3). By extending previous research of embodied cognition, the present findings provide novel evidence suggesting that bidirectional functional relations between action and language are based on similar conceptual–semantic representations.

[1]  Willem J. M. Levelt,et al.  Pointing and voicing in deictic expressions , 1985 .

[2]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[3]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[4]  Vittorio Gallese,et al.  Task related modulation of the motor system during language processing , 2008, Brain and Language.

[5]  Luigi Cattaneo,et al.  Use-induced motor plasticity affects the processing of abstract and concrete language , 2008, Current Biology.

[6]  Michael P. Kaschak,et al.  Constructing Meaning: The Role of Affordances and Grammatical Constructions in Sentence Comprehension , 2000 .

[7]  W. Prinz,et al.  Compatibility between Observed and Executed Finger Movements: Comparing Symbolic, Spatial, and Imitative Cues , 2000, Brain and Cognition.

[8]  Tom Ziemke,et al.  Sentence Processing: Linking Language to Motor Chains , 2010, Front. Neurorobot..

[9]  Sarah-Jayne Blakemore,et al.  The role of motor contagion in the prediction of action , 2005, Neuropsychologia.

[10]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[11]  Matthew R Longo,et al.  Imitative response tendencies following observation of intransitive actions. , 2006, Journal of experimental psychology. Human perception and performance.

[12]  R. Krauss,et al.  The Communicative Value of Conversational Hand Gesture , 1995 .

[13]  Marcel Brass,et al.  What is matched in direct matching? Intention attribution modulates motor priming. , 2008, Journal of experimental psychology. Human perception and performance.

[14]  Marcel Brass,et al.  How do we infer others' goals from non-stereotypic actions? The outcome of context-sensitive inferential processing in right inferior parietal and posterior temporal cortex , 2008, NeuroImage.

[15]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[16]  R. Krauss,et al.  Do conversational hand gestures communicate? , 1991, Journal of personality and social psychology.

[17]  Andrew N. Meltzoff,et al.  Explaining facial imitation , 1997 .

[18]  Anne Springer,et al.  Action Semantics Modulate Action Prediction , 2010, Quarterly journal of experimental psychology.

[19]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[20]  K. Amunts,et al.  Broca's region: from action to language. , 2005, Physiology.

[21]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[22]  R. C. Oldfield.  THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[23]  J. Fodor.  The Modularity of mind. An essay on faculty psychology , 1986 .

[24]  C. Heyes.  Causes and consequences of imitation , 2001, Trends in Cognitive Sciences.

[25]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[26]  Michael A. Arbib,et al.  From grasping to speech: imitation might provide a missing link: Reply , 1999, Trends in Neurosciences.

[27]  J. Mazziotta,et al.  Mapping motor representations with positron emission tomography , 1994, Nature.

[28]  Eliot R. Smith,et al.  Embodied Grounding: Social, Cognitive, Affective, and Neuroscientific Approaches , 2008 .

[29]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[30]  Marco Iacoboni,et al.  Beyond a Single Area: Motor Control and Language Within a Neural Architecture Encompassing Broca's Area , 2006, Cortex.

[31]  C. Heyes,et al.  Robotic movement elicits automatic imitation. , 2005, Brain research. Cognitive brain research.

[32]  M. Gentilucci,et al.  When the hands speak , 2008, Journal of Physiology-Paris.

[33]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[34]  A. Glenberg,et al.  Processing Abstract Language Modulates Motor System Activity , 2008, Quarterly journal of experimental psychology.

[35]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[36]  L. Barsalou.  Grounding Symbolic Operations in the Brain's Modal Systems , 2008 .

[37]  Marc Jeannerod,et al.  Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing , 2006, Journal of Cognitive Neuroscience.

[38]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[39]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[40]  A. Meltzoff,et al.  Explaining Facial Imitation: A Theoretical Model. , 1997, Early development & parenting.

[41]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[42]  J. Mazziotta,et al.  Modulation of motor and premotor activity during imitation of target-directed actions. , 2002, Cerebral cortex.

[43]  Listening to action-related sentences impairs postural control. , 2011, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[44]  Harold Bekkering,et al.  Effects of intentional motor actions on embodied language processing. , 2010, Experimental psychology.

[45]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[46]  L. Fadiga,et al.  The Motor Somatotopy of Speech Perception , 2009, Current Biology.

[47]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[48]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[49]  Maurizio Gentilucci,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Spoken Language and Arm Gestures Are Controlled by the Same Motor Control System , 2022 .

[50]  Maurizio Gentilucci,et al.  Speech and gesture share the same communication system , 2006, Neuropsychologia.

[51]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[52]  R. E Passingham,et al.  Activations related to “mirror” and “canonical” neurones in the human brain: an fMRI study , 2003, NeuroImage.

[53]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[54]  G Aschersleben,et al.  Correspondence effects with manual gestures and postures: a study of imitation. , 2000, Journal of experimental psychology. Human perception and performance.