A moving story: Whole-body motor training selectively improves the appraisal of action meanings in naturalistic narratives

This study examined whether systematic whole-body stimulation and increased attention to visuospatial motion patterns can enhance the appraisal of action meanings evoked by naturalistic texts. Participants listened to action and neutral (non-action) narratives before and after videogame-based bodily training, and responded to questions on information realized by verbs (denoting abstract and action processes) and circumstances (conveying locative or temporal details, for example). Strategically, we worked with dyslexic children, whose potential comprehension deficits could give room to post-training improvements. Results showed a selective boost in understanding of action information, even when controlling for baseline performance. Also, this effect proved uninfluenced by short-term memory skills, and it was absent when training relied on non-action videogames requiring minimal bodily engagement. Of note, the movements described in the texts did not match those performed by participants, suggesting that well-established effector- and direction-specific language embodiment effects may be accompanied by more coarse-grained sensorimotor resonance, driven by activation of motor and visuospatial sensory systems. In sum, the stimulation of movement-related mechanisms seems to selectively boost the appraisal of actions evoked by naturalistic texts. By demonstrating such links between two real-life activities, our study offers an empirical tie between embodied and situated accounts of cognition.

[1]  Michael P. Kaschak,et al.  Temporal Dynamics of the Action–Sentence Compatibility Effect , 2008, Quarterly journal of experimental psychology.

[2]  Ying Choon Wu,et al.  Iconic Gestures Facilitate Discourse Comprehension in Individuals With Superior Immediate Memory for Body Configurations , 2015, Psychological science.

[3]  Jeffrey M. Zacks,et al.  Human Brain Activity Time-Locked to Narrative Event Boundaries , 2007, Psychological science.

[4]  E. Marinus,et al.  Australian comparison data for the Test of Word Reading Efficiency (TOWRE) , 2013 .

[5]  S. Gori,et al.  Action Video Games Make Dyslexic Children Read Better , 2013, Current Biology.

[6]  A. Caramazza,et al.  WHAT ARE THE FACTS OF SEMANTIC CATEGORY-SPECIFIC DEFICITS? A CRITICAL REVIEW OF THE CLINICAL EVIDENCE , 2003, Cognitive neuropsychology.

[7]  Luigi Cattaneo,et al.  Use-induced motor plasticity affects the processing of abstract and concrete language , 2008, Current Biology.

[8]  A. Ibanez,et al.  Motor-language coupling: Direct evidence from early Parkinson’s disease and intracranial cortical recordings , 2013, Cortex.

[9]  Agustín Ibáñez,et al.  Cortical dynamics and subcortical signatures of motor-language coupling in Parkinson’s disease , 2015, Scientific Reports.

[10]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[11]  Sian L. Beilock,et al.  Sports experience changes the neural processing of action language , 2008, Proceedings of the National Academy of Sciences.

[12]  Marta Maieron,et al.  How are the motor system activity and functional connectivity between the cognitive and sensorimotor systems modulated by athletic expertise? , 2013, Brain Research.

[13]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[14]  Ludovica Labruna,et al.  A Functional Role for the Motor System in Language Understanding , 2011, Psychological science.

[15]  Elmar Nöth,et al.  How language flows when movements don’t: An automated analysis of spontaneous discourse in Parkinson’s disease , 2016, Brain and Language.

[16]  Marco Tettamanti,et al.  Training of Manual Actions Improves Language Understanding of Semantically Related Action Sentences , 2012, Front. Psychology.

[17]  A. Ibáñez,et al.  Hands typing what hands do: Action–semantic integration dynamics throughout written verb production , 2016, Cognition.

[18]  Nina F. Dronkers,et al.  What do brain lesions tell us about theories of embodied semantics and the human mirror neuron system? , 2012, Cortex.

[19]  A. Ibáñez,et al.  Syntax, action verbs, action semantics, and object semantics in Parkinson's disease: Dissociability, progression, and executive influences , 2015, Cortex.

[20]  F. Binkofski,et al.  Motor functions of the Broca’s region , 2004, Brain and Language.

[21]  C Witton,et al.  Dynamic sensory sensitivity and children's word decoding skills. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Zhong-Lin Lu,et al.  Motion-Perception Deficits and Reading Impairment , 2006, Psychological science.

[23]  John M. Henderson,et al.  Toward Semantics in the Wild: Activation to Manipulable Nouns in Naturalistic Reading , 2016, The Journal of Neuroscience.

[24]  C. Davis N-Watch: A program for deriving neighborhood size and other psycholinguistic statistics , 2005, Behavior research methods.

[25]  Marc Jeannerod,et al.  Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing , 2006, Journal of Cognitive Neuroscience.

[26]  Simone Gori,et al.  Multiple Causal Links Between Magnocellular-Dorsal Pathway Deficit and Developmental Dyslexia. , 2016, Cerebral cortex.

[27]  Raffaella Ida Rumiati,et al.  The role of volleyball expertise in motor simulation. , 2012, Acta psychologica.

[28]  Christian M. I. M. Matthiessen,et al.  Halliday's Introduction to Functional Grammar , 2014 .

[29]  C. S. Green,et al.  Action video game modifies visual selective attention , 2003, Nature.

[30]  Roel M. Willems,et al.  Body-specific representations of action verbs: Neural evidence from right- and left-handers , 2009, NeuroImage.

[31]  J. Parisi,et al.  Developmental disorders. , 1997, Current opinion in neurology.

[32]  M. Gentilucci,et al.  Action word understanding and overt motor behavior , 2009, Experimental Brain Research.

[33]  D. Kemmerer,et al.  The Two-Level Theory of verb meaning: An approach to integrating the semantics of action with the mirror neuron system , 2010, Brain and Language.

[34]  Roel M. Willems,et al.  Body-specific representations of action verbs: Neural evidence from right- and left-handers , 2009, NeuroImage.

[35]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[36]  S. Scott,et al.  Intact But Less Accessible Phonetic Representations in Adults with Dyslexia , 2013, Science.

[37]  C. Ho,et al.  Weaknesses in semantic, syntactic and oral language expression contribute to reading difficulties in Chinese dyslexic children. , 2014, Dyslexia.

[38]  Pienie Zwitserlood,et al.  The Involvement of the Left Motor Cortex in Learning of a Novel Action Word Lexicon , 2010, Current Biology.

[39]  L. Parsons,et al.  Use of implicit motor imagery for visual shape discrimination as revealed by PET , 1995, Nature.

[40]  S. Baez,et al.  Parkinson's disease compromises the appraisal of action meanings evoked by naturalistic texts , 2017, Cortex.

[41]  C. Hulme,et al.  The interface between spoken and written language: developmental disorders , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  Agustín Ibáñez,et al.  A touch with words: Dynamic synergies between manual actions and language , 2016, Neuroscience & Biobehavioral Reviews.

[43]  Jie Yang,et al.  Influences of motor contexts on the semantic processing of action-related language , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[44]  Riccardo Dalla Volta,et al.  Does listening to action-related sentences modulate the activity of the motor system? Replication of a combined TMS and behavioral study , 2015, Front. Psychol..