Sentence Processing: Linking Language to Motor Chains

A growing body of evidence in cognitive science and neuroscience points towards the existence of a deep interconnection between cognition, perception and action. According to this embodied perspective language is grounded in the sensorimotor system and language understanding is based on a mental simulation process (Jeannerod, 2007; Gallese, 2008; Barsalou, 2009). This means that during action words and sentence comprehension the same perception, action, and emotion mechanisms implied during interaction with objects are recruited. Among the neural underpinnings of this simulation process an important role is played by a sensorimotor matching system known as the mirror neuron system (Rizzolatti and Craighero, 2004). Despite a growing number of studies, the precise dynamics underlying the relation between language and action are not yet well understood. In fact, experimental studies are not always coherent as some report that language processing interferes with action execution while others find facilitation. In this work we present a detailed neural network model capable of reproducing experimentally observed influences of the processing of action-related sentences on the execution of motor sequences. The proposed model is based on three main points. The first is that the processing of action-related sentences causes the resonance of motor and mirror neurons encoding the corresponding actions. The second is that there exists a varying degree of crosstalk between neuronal populations depending on whether they encode the same motor act, the same effector or the same action-goal. The third is the fact that neuronal populations’ internal dynamics, which results from the combination of multiple processes taking place at different time scales, can facilitate or interfere with successive activations of the same or of partially overlapping pools.

[1]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[2]  M. Binder,et al.  Multiple mechanisms of spike-frequency adaptation in motoneurones , 1999, Journal of Physiology-Paris.

[3]  V. Gallese Mirror neurons and the social nature of language: The neural exploitation hypothesis , 2008, Social neuroscience.

[4]  Marc Jeannerod,et al.  Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing , 2006, Journal of Cognitive Neuroscience.

[5]  Alfonso Caramazza,et al.  All Talk and No Action: A Transcranial Magnetic Stimulation Study of Motor Cortex Activation during Action Word Production , 2004, Journal of Cognitive Neuroscience.

[6]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[7]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[8]  J. Decety,et al.  The power of simulation: Imagining one's own and other's behavior , 2006, Brain Research.

[9]  Tom Ziemke,et al.  ROSSI: Emergence of communication in Robots through Sensorimotor and Social Interaction , 2008 .

[10]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[11]  D. McCormick,et al.  Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. , 1985, Journal of neurophysiology.

[12]  Francesca Ugolotti Serventi,et al.  Ventral premotor and inferior parietal cortices make distinct contribution to action organization and intention understanding. , 2010, Cerebral cortex.

[13]  F. Pulvermüller,et al.  Walking or Talking?: Behavioral and Neurophysiological Correlates of Action Verb Processing , 2001, Brain and Language.

[14]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[15]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[16]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[17]  Antonino Vallesi,et al.  Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex , 2009, PloS one.

[18]  Vittorio Gallese,et al.  Task related modulation of the motor system during language processing , 2008, Brain and Language.

[19]  Lawrence W Barsalou,et al.  Simulation, situated conceptualization, and prediction , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  W. Prinz,et al.  Movement observation affects movement execution in a simple response task. , 2001, Acta psychologica.

[21]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[22]  Michael P. Kaschak,et al.  On doing two things at once: Temporal constraints on actions in language comprehension , 2004, Memory & cognition.

[23]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[24]  K. Jellinger Motor Cognition What Actions Tell the Self , 2007 .

[25]  P. Hagoort,et al.  Language beyond action , 2008, Journal of Physiology-Paris.

[26]  Pankaj Sah,et al.  Ca2+-activated K+ currents in neurones: types, physiological roles and modulation , 1996, Trends in Neurosciences.