Learning with the wave of the hand: Kinematic and TMS evidence of primary motor cortex role in category-specific encoding of word meaning

Language processing recruits a core fronto-temporal cortical network, which is complemented by a distributed network of modality-specific areas (such as the motor cortex) to encode referential aspects of meaning. Since most studies typically focus on already fully-formed adult vocabulary, it remains unclear how and when exactly modality-specific areas become involved in language processing. Here, we addressed this question using a 3D virtual environment game to teach adult participants new action verbs and object nouns. To test the role of primary motor cortex (M1) in selectively encoding aspects of action verb meaning early on in the process of word learning, we delivered theta-burst stimulation to three groups of participants prior to learning: M1 TMS, active control TMS, and sham TMS. Our results show that TMS of M1 (but not active or sham controls) interferes with the learning process, as indexed by measures of movement kinematics and a higher number of errors during training. Thus, TMS disruption of M1 degrades learning outcomes when motor information is an integral part of lexico-semantic encoding. This effect was corroborated in a subsequent lexical decision task, which showed significant group- and word-category RT differences, suggesting category-specific effects of TMS on word learning. Overall, our study demonstrates the M1's causal involvement in the earliest phases of word learning and rapid encoding of semantic motor information.

[1]  André Mouraux,et al.  MEP Latencies Predict the Neuromodulatory Effect of cTBS Delivered to the Ipsilateral and Contralateral Sensorimotor Cortex , 2015, PloS one.

[2]  M. Hallett,et al.  Depression of motor cortex excitability by low‐frequency transcranial magnetic stimulation , 1997, Neurology.

[3]  S. Rossi,et al.  Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research , 2009, Clinical Neurophysiology.

[4]  R. Katz,et al.  Basic principles of transcranial magnetic stimulation (TMS) and repetitive TMS (rTMS). , 2015, Annals of physical and rehabilitation medicine.

[5]  Nikola Vukovic,et al.  Primary motor cortex functionally contributes to language comprehension: An online rTMS study , 2017, Neuropsychologia.

[6]  Ulf Ziemann,et al.  Homeostatic plasticity in human motor cortex demonstrated by two consecutive sessions of paired associative stimulation , 2007, The European journal of neuroscience.

[7]  Beth Levin,et al.  English Verb Classes and Alternations: A Preliminary Investigation , 1993 .

[8]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[9]  R. Henson,et al.  The neural basis of episodic memory: evidence from functional neuroimaging. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[11]  G. Segal,et al.  Knowledge of Meaning: An Introduction to Semantic Theory , 1995 .

[12]  Nikola Vukovic,et al.  Cortical networks for reference-frame processing are shared by language and spatial navigation systems , 2017, NeuroImage.

[13]  Friedemann Pulvermüller,et al.  From sounds to words: A neurocomputational model of adaptation, inhibition and memory processes in auditory change detection , 2011, NeuroImage.

[14]  A. Antal,et al.  Simply longer is not better: reversal of theta burst after-effect with prolonged stimulation , 2010, Experimental Brain Research.

[15]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[16]  W. Senn,et al.  Extending lifetime of plastic changes in the human brain , 2006, The European journal of neuroscience.

[17]  Rolf A. Zwaan Situation models, mental simulations, and abstract concepts in discourse comprehension , 2015, Psychonomic bulletin & review.

[18]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[19]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[20]  F. Fardo,et al.  When words burn – language processing differentially modulates pain perception in typical and chronic pain populations , 2018, Language and Cognition.

[21]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[22]  F. Pulvermüller,et al.  Reading salt activates gustatory brain regions: fMRI evidence for semantic grounding in a novel sensory modality. , 2012, Cerebral cortex.

[23]  Karen Emmorey,et al.  The Action-Sentence Compatibility Effect in ASL: the role of semantics vs. perception* , 2014, Language and Cognition.

[24]  Tianzi Jiang,et al.  Convergent functional architecture of the superior parietal lobule unraveled with multimodal neuroimaging approaches , 2015, Human brain mapping.

[25]  Jeffrey D. Lewis,et al.  Online feedback enhances early consolidation of motor sequence learning and reverses recall deficit from transcranial stimulation of motor cortex , 2015, Cortex.

[26]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[27]  Michael C. Ridding,et al.  A comparison of two different continuous theta burst stimulation paradigms applied to the human primary motor cortex , 2011, Clinical Neurophysiology.

[28]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[29]  Joze Guna,et al.  An Analysis of the Precision and Reliability of the Leap Motion Sensor and Its Suitability for Static and Dynamic Tracking , 2014, Sensors.

[30]  U. Ziemann,et al.  Ten Years of Theta Burst Stimulation in Humans: Established Knowledge, Unknowns and Prospects , 2016, Brain Stimulation.

[31]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[32]  Sharon L. Thompson-Schill,et al.  Fast mapping rapidly integrates information into existing memory networks. , 2014, Journal of experimental psychology. General.

[33]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[34]  J. Rothwell,et al.  Transcranial magnetic stimulation in cognitive neuroscience – virtual lesion, chronometry, and functional connectivity , 2000, Current Opinion in Neurobiology.

[35]  M. Hallett,et al.  Early consolidation in human primary motor cortex , 2002, Nature.

[36]  Petri Toiviainen,et al.  MOCAP TOOLBOX - A MATLAB TOOLBOX FOR COMPUTATIONAL ANALYSIS OF MOVEMENT DATA , 2013 .

[37]  Hananel Hazan,et al.  Decoding the Formation of New Semantics: MVPA Investigation of Rapid Neocortical Plasticity during Associative Encoding through Fast Mapping , 2015, Neural plasticity.

[38]  Sunbin Song,et al.  Modifying somatosensory processing with non-invasive brain stimulation. , 2011, Restorative neurology and neuroscience.

[39]  Nikola Vukovic,et al.  Individual differences in spatial cognition influence mental simulation of language , 2015, Cognition.

[40]  Christopher Kennard,et al.  Response-Dependent Contributions of Human Primary Motor Cortex and Angular Gyrus to Manual and Perceptual Sequence Learning , 2009, The Journal of Neuroscience.

[41]  B. Bahrami,et al.  Coming of age: A review of embodiment and the neuroscience of semantics , 2012, Cortex.

[42]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[43]  Katie L. McMahon,et al.  Action word meaning representations in cytoarchitectonically defined primary and premotor cortices , 2008, NeuroImage.

[44]  K. Coventry,et al.  Dissociation between Semantic Representations for Motion and Action Verbs: Evidence from Patients with Left Hemisphere Lesions , 2017, Front. Hum. Neurosci..

[45]  J. Rothwell,et al.  Theta Burst Stimulation of the Human Motor Cortex , 2005, Neuron.

[46]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[47]  Claudia Gianelli,et al.  Acting in perspective: the role of body and language as social tools , 2013, Psychological research.

[48]  Thomas A. Farmer,et al.  Hand in Motion Reveals Mind in Motion , 2011, Front. Psychology.

[49]  Lori L. Holt,et al.  Reflections on mirror neurons and speech perception , 2009, Trends in Cognitive Sciences.

[50]  M. Kenward,et al.  Small sample inference for fixed effects from restricted maximum likelihood. , 1997, Biometrics.

[51]  S. Filipović,et al.  Differential effects of facilitatory and inhibitory theta burst stimulation of the primary motor cortex on motor learning , 2015, Clinical Neurophysiology.

[52]  Yury Shtyrov,et al.  Fast Mapping of Novel Word Forms Traced Neurophysiologically , 2011, Front. Psychology.

[53]  M. Merzenich,et al.  Use-dependent alterations of movement representations in primary motor cortex of adult squirrel monkeys , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[55]  Sian L. Beilock,et al.  Gesture Changes Thought by Grounding It in Action , 2010, Psychological science.

[56]  Rolf A. Zwaan,et al.  Action in cognition: The case of language , 2009, Language and Cognition.

[57]  Sunbin Song,et al.  Shifts in connectivity during procedural learning after motor cortex stimulation: A combined transcranial magnetic stimulation/functional magnetic resonance imaging study , 2016, Cortex.

[58]  Michael L. Anderson Neural reuse: A fundamental organizational principle of the brain , 2010, Behavioral and Brain Sciences.

[59]  Nikola Vukovic,et al.  Cortical motor systems are involved in second-language comprehension: Evidence from rapid mu-rhythm desynchronisation , 2014, NeuroImage.

[60]  Á. Pascual-Leone,et al.  Safety of Theta Burst Transcranial Magnetic Stimulation: A Systematic Review of the Literature , 2011, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[61]  A. Glenberg,et al.  Action-based language: A theory of language acquisition, comprehension, and production , 2012, Cortex.

[62]  Á. Pascual-Leone,et al.  Modulation of corticospinal excitability by transcranial magnetic stimulation in children and adolescents with autism spectrum disorder , 2014, Front. Hum. Neurosci..

[63]  P. Morasso,et al.  Human Movement Understanding: From Computational Geometry to Artificial Intelligence , 1986 .

[64]  F. Pulvermüller,et al.  The time course of action and action-word comprehension in the human brain as revealed by neurophysiology , 2008, Journal of Physiology-Paris.

[65]  Harold Bekkering,et al.  Context Effects in Embodied Lexical-Semantic Processing , 2010, Front. Psychology.

[66]  Alexander T Sack,et al.  Early stages of motor skill learning and the specific relevance of the cortical motor system--a combined behavioural training and θ burst TMS study. , 2012, Restorative neurology and neuroscience.

[67]  Marc H Schieber,et al.  Principal components of hand kinematics and neurophysiological signals in motor cortex during reach to grasp movements. , 2014, Journal of neurophysiology.

[68]  K. Amunts,et al.  Probabilistic maps, morphometry, and variability of cytoarchitectonic areas in the human superior parietal cortex. , 2008, Cerebral cortex.

[69]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[70]  Michael C. Ridding,et al.  Neuroplastic Modulation of Inhibitory Motor Cortical Networks by Spaced Theta Burst Stimulation Protocols , 2013, Brain Stimulation.

[71]  Automatic perceptual simulation of first language meanings during second language sentence processing in bilinguals. , 2014, Acta psychologica.

[72]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[73]  J. Donoghue,et al.  Strengthening of horizontal cortical connections following skill learning , 1998, Nature Neuroscience.

[74]  A. Berardelli,et al.  Theta‐burst stimulation over primary motor cortex degrades early motor learning , 2010, The European journal of neuroscience.

[75]  Ying-Zu Huang,et al.  Review: Repetitive Transcranial Magnetic Stimulation over the Human Primary Motor Cortex for Modulating Motor Control and Motor Learning , 2010 .

[76]  L. Barsalou,et al.  Embodiment and Grounding in Cognitive Neuroscience , 2018 .

[77]  Nick C. Ellis,et al.  FREQUENCY EFFECTS IN LANGUAGE PROCESSING , 2002, Studies in Second Language Acquisition.

[78]  D Friedman,et al.  Event‐related potential (ERP) studies of memory encoding and retrieval: A selective review , 2000, Microscopy research and technique.

[79]  Gabriella Vigliocco,et al.  Eye Movements Reveal the Dynamic Simulation of Speed in Language , 2014, Cogn. Sci..

[80]  Rolf A. Zwaan,et al.  Rapid Communication: Readers Routinely Represent Implied Object Rotation: The Role of Visual Experience , 2010, Quarterly journal of experimental psychology.

[81]  Marjan Jahanshahi,et al.  Transcranial magnetic stimulation studies of cognition: an emerging field , 2000, Experimental Brain Research.

[82]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[83]  Lorraine K Tyler,et al.  Morphology, language and the brain: the decompositional substrate for language comprehension , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[84]  Paul B. Fitzgerald,et al.  Demonstration of short-term plasticity in the dorsolateral prefrontal cortex with theta burst stimulation: A TMS-EEG study , 2017, Clinical Neurophysiology.

[85]  M. de Vega,et al.  The comprehension of action-related sentences may cause interference rather than facilitation on matching actions , 2013, Psychological research.