Action relevance in linguistic context drives word-induced motor activity

Many neurocognitive studies on the role of motor structures in action-language processing have implicitly adopted a “dictionary-like” framework within which lexical meaning is constructed on the basis of an invariant set of semantic features. The debate has thus been centered on the question of whether motor activation is an integral part of the lexical semantics (embodied theories) or the result of a post-lexical construction of a situation model (disembodied theories). However, research in psycholinguistics show that lexical semantic processing and context-dependent meaning construction are narrowly integrated. An understanding of the role of motor structures in action-language processing might thus be better achieved by focusing on the linguistic contexts under which such structures are recruited. Here, we therefore analyzed online modulations of grip force while subjects listened to target words embedded in different linguistic contexts. When the target word was a hand action verb and when the sentence focused on that action (John signs the contract) an early increase of grip force was observed. No comparable increase was detected when the same word occurred in a context that shifted the focus toward the agent's mental state (John wants to sign the contract). There mere presence of an action word is thus not sufficient to trigger motor activation. Moreover, when the linguistic context set up a strong expectation for a hand action, a grip force increase was observed even when the tested word was a pseudo-verb. The presence of a known action word is thus not required to trigger motor activation. Importantly, however, the same linguistic contexts that sufficed to trigger motor activation with pseudo-verbs failed to trigger motor activation when the target words were verbs with no motor action reference. Context is thus not by itself sufficient to supersede an “incompatible” word meaning. We argue that motor structure activation is part of a dynamic process that integrates the lexical meaning potential of a term and the context in the online construction of a situation model, which is a crucial process for fluent and efficient online language comprehension.

[1]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[2]  Rolf A. Zwaan,et al.  Motor Resonance and Linguistic Focus , 2008, Quarterly journal of experimental psychology.

[3]  Markus Kiefer,et al.  Conceptual Flexibility in the Human Brain: Dynamic Recruitment of Semantic Maps from Visual, Motor, and Motion-related Areas , 2008, Journal of Cognitive Neuroscience.

[4]  Jeffrey L Elman,et al.  Lexical knowledge without a lexicon? , 2011, The mental lexicon.

[5]  F. Donders,et al.  For Review Only The Function of Words: Distinct neural correlates for words denoting differently manipulable objects , 2009 .

[6]  Jens Allwood,et al.  MEANING POTENTIALS AND CONTEXT : SOME CONSEQUENCES FOR THE ANALYSIS OF VARIATION IN MEANING , 2003 .

[7]  Vyvyan Evans,et al.  Cognitive Linguistics: An Introduction , 2001 .

[8]  Rolf A. Zwaan,et al.  Motor resonance as a function of narrative time: Further tests of the linguistic focus hypothesis , 2010, Brain and Language.

[9]  J. Magnuson,et al.  The time course of anticipatory constraint integration , 2011, Cognition.

[10]  Rolf A. Zwaan,et al.  The functional role of motor activation in language processing: Motor cortical oscillations support lexical-semantic retrieval , 2010, NeuroImage.

[11]  Mante S. Nieuwland,et al.  When Peanuts Fall in Love: N400 Evidence for the Power of Discourse , 2005, Journal of Cognitive Neuroscience.

[12]  Stephanie Huette,et al.  Towards a situated view of language , 2016 .

[13]  Susan Easton The Body as Evidence , 2014 .

[14]  Antonino Vallesi,et al.  Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex , 2009, PloS one.

[15]  Roel M. Willems,et al.  Embodied Cognition: Taking the Next Step , 2012, Front. Psychology.

[16]  Friedemann Pulvermüller,et al.  Early and parallel processing of pragmatic and semantic information in speech acts: neurophysiological evidence , 2013, Front. Hum. Neurosci..

[17]  Maryellen C. MacDonald,et al.  Constraint Satisfaction Accounts of Lexical and Sentence Comprehension , 2006 .

[18]  Alfonso Caramazza,et al.  Perception, action, and word meanings in the human brain: the case from action verbs , 2011, Annals of the New York Academy of Sciences.

[19]  Kara D. Federmeier Thinking ahead: the role and roots of prediction in language comprehension. , 2007, Psychophysiology.

[20]  Daniel Casasanto,et al.  Flexibility in Embodied Language Understanding , 2011, Front. Psychology.

[21]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[22]  F. Pulvermüller,et al.  The time course of action and action-word comprehension in the human brain as revealed by neurophysiology , 2008, Journal of Physiology-Paris.

[23]  A. Chatterjee Disembodying cognition , 2010, Language and Cognition.

[24]  Lawrence W Barsalou,et al.  Simulation, situated conceptualization, and prediction , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[26]  S Rossi,et al.  Corticospinal excitability modulation to hand muscles during movement imagery. , 1999, Cerebral cortex.

[27]  Dicky Gilbers,et al.  Language and Cognition 2 , 1992 .

[28]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[29]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[30]  J. Elman,et al.  Effects of event knowledge in processing verbal arguments. , 2010, Journal of memory and language.

[31]  Brian MacWhinney,et al.  Grounding Cognition: The Emergence of Grammar from Perspective , 2005 .

[32]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[33]  Hubert Cuyckens,et al.  Cognitive Approaches to Lexical Semantics , 2003 .

[34]  Christoph Scheepers,et al.  Event-based plausibility immediately influences on-line language comprehension. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[35]  Viviane Deprez,et al.  Grip Force Reveals the Context Sensitivity of Language-Induced Motor Activity during “Action Words” Processing: Evidence from Sentential Negation , 2012, PloS one.

[36]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[37]  B. Bahrami,et al.  Coming of age: A review of embodiment and the neuroscience of semantics , 2012, Cortex.

[38]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[39]  J. Elman,et al.  A basis for generating expectancies for verbs from nouns , 2005, Memory & cognition.

[40]  Raffaella Ida Rumiati,et al.  At the Mercy of Strategies: The Role of Motor Representations in Language Understanding , 2013, Front. Psychology.

[41]  Gregory Hickok,et al.  The role of mirror neurons in speech and language processing , 2010, Brain and Language.

[42]  Katie L. McMahon,et al.  Action word meaning representations in cytoarchitectonically defined primary and premotor cortices , 2008, NeuroImage.

[43]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[44]  Rolf A. Zwaan,et al.  Updating situation models. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[45]  J. Elman,et al.  Generalized event knowledge activation during online sentence comprehension. , 2012, Journal of memory and language.

[46]  Valerie San Juan,et al.  Perception and presupposition in real-time language comprehension: Insights from anticipatory processing , 2008, Cognition.

[47]  John C. Trueswell,et al.  Verb Meanings, Object Affordances, and the Incremental Restrictions of Reference , 2000 .

[48]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[49]  Matthew H. Davis,et al.  Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging , 2008, The European journal of neuroscience.

[50]  Joan L. Bybee,et al.  The Evolution of Grammar: Tense, Aspect, and Modality in the Languages of the World , 1994 .

[51]  L. Tyler,et al.  Modulation of motor and premotor cortices by actions, action words and action sentences , 2009, Neuropsychologia.

[52]  Roser Morante,et al.  Modality and Negation: An Introduction to the Special Issue , 2012, CL.

[53]  Peter Hagoort,et al.  Beyond the sentence given , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  Jie Yang,et al.  Context Effects on Embodied Representation of Language Concepts , 2013 .

[55]  Raffaella Ida Rumiati,et al.  On-line Changing of Thinking about Words: The Effect of Cognitive Context on Neural Responses to Verb Reading , 2012, Journal of Cognitive Neuroscience.

[56]  V. Gallese,et al.  Processing of Hand-Related Verbs Specifically Affects the Planning and Execution of Arm Reaching Movements , 2012, PloS one.

[57]  F. Pulvermüller Semantic embodiment, disembodiment or misembodiment? In search of meaning in modules and neuron circuits , 2013, Brain and Language.

[58]  J. Elman On the Meaning of Words and Dinosaur Bones: Lexical Knowledge Without a Lexicon , 2009, Cogn. Sci..

[59]  Michael R. Perkins,et al.  Modal Expressions in English , 1983 .

[60]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[61]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[62]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[63]  O. Hauk,et al.  The Body of Evidence: What Can Neuroscience Tell Us about Embodied Semantics? , 2013, Front. Psychology.

[64]  J. Elman An alternative view of the mental lexicon , 2004, Trends in Cognitive Sciences.

[65]  L. Barsalou Situated simulation in the human conceptual system , 2003 .

[66]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[67]  Daniel Casasanto,et al.  Pragmatics in Action: Indirect Requests Engage Theory of Mind Areas and the Cortical Motor Network , 2012, Journal of Cognitive Neuroscience.

[68]  Kara D. Federmeier,et al.  Multiple effects of sentential constraint on word processing , 2007, Brain Research.

[69]  L. Barsalou,et al.  The situated nature of concepts. , 2006, The American journal of psychology.

[70]  Vyvyan Evans,et al.  Lexical concepts, cognitive models and meaning-construction , 2006 .

[71]  Marc Jeannerod,et al.  Grip Force Is Part of the Semantic Representation of Manual Action Verbs , 2010, PloS one.

[72]  Stanley B Klein,et al.  What memory is. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[73]  Boris New,et al.  Une base de données lexicales du français contemporain sur internet: LEXIQUE , 2001 .

[74]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[75]  Rolf A. Zwaan,et al.  Sentential Context Modulates the Involvement of the Motor Cortex in Action Language Processing: An fMRI Study , 2013, Front. Hum. Neurosci..

[76]  David Swinney,et al.  Context Effects on Lexical Processing During Auditory Sentence Comprehension , 2002 .

[77]  Harold Bekkering,et al.  Flexibility in embodied lexical‐semantic representations , 2012, Human brain mapping.

[78]  Gabriella Vigliocco,et al.  Sentence Comprehension as Mental Simulation: An Information-Theoretic Perspective , 2011, Inf..

[79]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[80]  Vittorio Gallese,et al.  Task related modulation of the motor system during language processing , 2008, Brain and Language.

[81]  Nira Liberman,et al.  The language of future-thought: An fMRI study of embodiment and tense processing , 2013, NeuroImage.