Synchronization between instructor and observer when learning a complex bimanual skill

While learning from an instructor by watching a 'how-to' video has become common practice, we know surprisingly little about the relation between brain activities in instructor and observers. In this fMRI study we investigated the temporal synchronization between instructor and observers using intersubject correlation in the naturalistic setting of learning to fold origami. Brain activity of blindfolded instructor during action production was compared to the observers while they viewed the instructor's video-taped actions. We demonstrate for the first time that the BOLD activity in the instructor's and observer's brain are synchronized while observing and learning a manual complex task with the goal of reproducing it. We can rule out that this synchrony originates from visual feedback. Observers exhibiting higher synchrony with the instructor in the ventral premotor cortex, while viewing the video for the first time, were more successful in reproducing the origami afterwards. Furthermore, changes in instructor-observer synchrony across observational learning sessions reside occurs in cerebellar areas, as well as differences in instructor-observer synchrony between learning and the counting folds, our non-learning control. Not only known cerebellar motor production areas show synchrony, shedding new light on the involvement of the cerebellum in action observation and learning.

[1]  Christian Keysers,et al.  Action perception recruits the cerebellum and is impaired in spinocerebellar ataxia patients , 2018, bioRxiv.

[2]  Nancy Kanwisher,et al.  Broad domain generality in focal regions of frontal and parietal cortex , 2013, Proceedings of the National Academy of Sciences.

[3]  G. Rizzolatti,et al.  Motor and cognitive functions of the ventral premotor cortex , 2002, Current Opinion in Neurobiology.

[4]  Janice Chen,et al.  Dynamic reconfiguration of the default mode network during narrative comprehension , 2016, Nature Communications.

[5]  Chaozhe Zhu,et al.  Holistic cognitive and neural processes: a fNIRS-hyperscanning study on interpersonal sensorimotor synchronization , 2018, Social cognitive and affective neuroscience.

[6]  A. Kelly,et al.  Human functional neuroimaging of brain changes associated with practice. , 2005, Cerebral cortex.

[7]  Simon B. Eickhoff,et al.  A quantitative meta-analysis and review of motor learning in the human brain , 2013, NeuroImage.

[8]  Leonardo Fogassi,et al.  Parieto-frontal mechanisms underlying observation of complex hand-object manipulation , 2019, Scientific Reports.

[9]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[10]  Frank E. Pollick,et al.  Differences in fMRI intersubject correlation while viewing unedited and edited videos of dance performance , 2015, Cortex.

[11]  C. Heyes,et al.  Mirror neurons: from origin to function. , 2014, The Behavioral and brain sciences.

[12]  Makoto Kato,et al.  The sensorimotor transformation of cross-modal spatial information in the anterior intraparietal sulcus as revealed by functional MRI. , 2005, Brain research. Cognitive brain research.

[13]  Emily S. Cross,et al.  Sensitivity of the action observation network to physical and observational learning. , 2008, Cerebral cortex.

[14]  Atsushi Iriki Faculty Opinions recommendation of Single-neuron responses in humans during execution and observation of actions. , 2010 .

[15]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[16]  Martin Wolf,et al.  Between-brain connectivity during imitation measured by fNIRS , 2012, NeuroImage.

[17]  Guy Vingerhoets,et al.  Human Left Ventral Premotor Cortex Mediates Matching of Hand Posture to Object Use , 2013, PloS one.

[18]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[19]  Giovanni Buccino,et al.  The role of ventral premotor cortex in action execution and action understanding , 2006, Journal of Physiology-Paris.

[20]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[21]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[22]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  Enrica Fava,et al.  The mirror neuron system and the strange case of Broca's area , 2015, Human brain mapping.

[24]  John E. Schlerf,et al.  Evidence of a novel somatopic map in the human neocerebellum during complex actions. , 2010, Journal of neurophysiology.

[25]  Jukka-Pekka Kauppi,et al.  Inter-Subject Correlation in fMRI: Method Validation against Stimulus-Model Based Analysis , 2012, PloS one.

[26]  M Tettamanti,et al.  How Task Interactivity Shapes Action Observation. , 2019, Cerebral cortex.

[27]  Christopher J. Honey,et al.  Future trends in Neuroimaging: Neural processes as expressed within real-life contexts , 2012, NeuroImage.

[28]  Yi Hu,et al.  Interpersonal synchronization of inferior frontal cortices tracks social interactive learning of a song , 2018, NeuroImage.

[29]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[30]  S. Thompson Social Learning Theory , 2008 .

[31]  Mikko Sams,et al.  Mental Action Simulation Synchronizes Action–Observation Circuits across Individuals , 2014, The Journal of Neuroscience.

[32]  D. Poeppel,et al.  Coupled neural systems underlie the production and comprehension of naturalistic narrative speech , 2014, Proceedings of the National Academy of Sciences.

[33]  Giacomo Koch,et al.  The role of mirror neurons in observational motor learning: an integrative review , 2014 .

[34]  Karl J. Friston,et al.  I See Your Effort: Force-Related BOLD Effects in an Extended Action Execution–Observation Network Involving the Cerebellum , 2019, Cerebral cortex.

[35]  K. Amunts,et al.  Broca's region subserves imagery of motion: A combined cytoarchitectonic and fMRI study , 2000, Human brain mapping.

[36]  Amir Amedi,et al.  Combined activation and deactivation of visual cortex during tactile sensory processing. , 2007, Journal of neurophysiology.

[37]  G. Fesl,et al.  Differential effects of eyes open or closed in darkness on brain activation patterns in blind subjects , 2009, Neuroscience Letters.

[38]  Uri Hasson,et al.  Infant and Adult Brains Are Coupled to the Dynamics of Natural Communication , 2019, Psychological science.

[39]  M. Desmurget,et al.  Mapping motor representations in the human cerebellum. , 2013, Brain : a journal of neurology.

[40]  Jeremy D. Schmahmann,et al.  Functional topography of the cerebellum for motor and cognitive tasks: An fMRI study , 2012, NeuroImage.

[41]  R Nathan Spreng,et al.  Functional Brain Changes Following Cognitive and Motor Skills Training , 2013, Neurorehabilitation and neural repair.

[42]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[43]  S. Swinnen,et al.  Neural correlates of action: Comparing meta-analyses of imagery, observation, and execution , 2018, Neuroscience & Biobehavioral Reviews.

[44]  Emily S. Cross,et al.  Learning to tie the knot: The acquisition of functional object representations by physical and observational experience , 2017, PloS one.

[45]  U. Hasson,et al.  Speaker–listener neural coupling underlies successful communication , 2010, Proceedings of the National Academy of Sciences.

[46]  R. Passingham,et al.  Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation , 2006, Current Biology.

[47]  Yuan Chang Leong,et al.  How We Transmit Memories to Other Brains: Constructing Shared Neural Representations Via Communication , 2016, bioRxiv.

[48]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[49]  Frank Van Overwalle,et al.  Social cognition and the cerebellum: A meta-analysis of over 350 fMRI studies , 2014, NeuroImage.

[50]  Martine Turgeon,et al.  Cognitive Control Structures in the Imitation Learning of Spatial Sequences and Rhythms—An fMRI Study , 2018, Cerebral cortex.

[51]  Richard Ramsey,et al.  Observing Action Sequences Elicits Sequence-Specific Neural Representations in Frontoparietal Brain Regions , 2018, The Journal of Neuroscience.

[52]  Jeffrey Eilbott,et al.  Cortical Activation during Action Observation, Action Execution, and Interpersonal Synchrony in Adults: A functional Near-Infrared Spectroscopy (fNIRS) Study , 2017, Front. Hum. Neurosci..

[53]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[54]  Nadim Joni Shah,et al.  Prefrontal involvement in imitation learning of hand actions: Effects of practice and expertise , 2007, NeuroImage.

[55]  Anne-Laure Boulesteix,et al.  Subsampling versus bootstrapping in resampling‐based model selection for multivariable regression , 2016, Biometrics.

[56]  Uri Hasson,et al.  Infant and Adult Brains Are Coupled to the Dynamics of Natural Communication , 2018, bioRxiv.

[57]  Emily S. Cross,et al.  Additive Routes to Action Learning: Layering Experience Shapes Engagement of the Action Observation Network , 2015, Cerebral cortex.

[58]  Simon B. Eickhoff,et al.  Imitation and observational learning of hand actions: Prefrontal involvement and connectivity , 2012, NeuroImage.

[59]  S. Petersen,et al.  The effects of practice on the functional anatomy of task performance. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[60]  J. Mattingley,et al.  Brain regions with mirror properties: A meta-analysis of 125 human fMRI studies , 2012, Neuroscience & Biobehavioral Reviews.

[61]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[62]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[63]  Jussi Tohka,et al.  Post-print: Effects of spatial smoothing on inter-subject correlation based analysis of FMRI , 2014 .

[64]  Marleen B. Schippers,et al.  Mapping the information flow from one brain to another during gestural communication , 2010, Proceedings of the National Academy of Sciences.

[65]  G. Rizzolatti,et al.  Neural Circuits Underlying Imitation Learning of Hand Actions An Event-Related fMRI Study , 2004, Neuron.

[66]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[67]  Christian Keysers,et al.  Where and how our brain represents the temporal structure of observed action , 2018, NeuroImage.

[68]  D. Politis,et al.  Subsampling p-values , 2010 .

[69]  Evan M. Gordon,et al.  Precision Functional Mapping of Individual Human Brains , 2017, Neuron.

[70]  Rainer Goebel,et al.  Playing Charades in the fMRI: Are Mirror and/or Mentalizing Areas Involved in Gestural Communication? , 2009, PloS one.

[71]  Richard Ramsey,et al.  Physical experience leads to enhanced object perception in parietal cortex: Insights from knot tying , 2012, Neuropsychologia.

[72]  J. Duncan The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[73]  Emily S. Cross,et al.  Using guitar learning to probe the Action Observation Network's response to visuomotor familiarity , 2017, NeuroImage.

[74]  Evan M. Gordon,et al.  Spatial and Temporal Organization of the Individual Human Cerebellum , 2018, Neuron.

[75]  G. Hammond,et al.  Anodal transcranial direct current stimulation over premotor cortex facilitates observational learning of a motor sequence , 2015, The European journal of neuroscience.

[76]  James M. Kilner,et al.  More than one pathway to action understanding , 2011, Trends in Cognitive Sciences.

[77]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[78]  Thomas Stephan,et al.  Expectation of Sensory Stimulation Modulates Brain Activation during Visual Motion Stimulation , 2005, Annals of the New York Academy of Sciences.

[79]  Rafael Malach,et al.  Trained to silence: Progressive signal inhibition during short visuo-motor training , 2016, NeuroImage.

[80]  J. A. Camilleri,et al.  Definition and characterization of an extended multiple-demand network , 2018, NeuroImage.

[81]  Scott T. Grafton Embodied Cognition and the Simulation of Action to Understand Others , 2009, Annals of the New York Academy of Sciences.

[82]  Jörn Diedrichsen,et al.  Skill learning strengthens cortical representations of motor sequences , 2013, eLife.

[83]  P. Matthews,et al.  Changing brain networks for visuomotor control with increased movement automaticity. , 2004, Journal of neurophysiology.

[84]  Uri Hasson,et al.  Mirroring and beyond: coupled dynamics as a generalized framework for modelling social interactions , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[85]  Bradley M. Peterson,et al.  On Uncertainties in Cross‐Correlation Lags and the Reality of Wavelength‐dependent Continuum Lags in Active Galactic Nuclei , 1998, astro-ph/9802103.

[86]  M. Jeannerod,et al.  The motor theory of social cognition: a critique , 2005, Trends in Cognitive Sciences.

[87]  M. Thürling,et al.  Cerebellar fMRI Activation Increases with Increasing Working Memory Demands , 2015, The Cerebellum.

[88]  C. Frith,et al.  Social Cognition in Humans , 2007, Current Biology.

[89]  Damien A. Fair,et al.  The Big Reveal: Precision Mapping Shines a Gigantic Floodlight on the Cerebellum , 2018, Neuron.

[90]  Rainer Goebel,et al.  Continuous motor sequence learning: Cortical efficiency gains accompanied by striatal functional reorganization , 2010, NeuroImage.

[91]  Klaus Lehnertz,et al.  Measuring synchronization in coupled model systems: A comparison of different approaches , 2007 .

[92]  Arne D. Ekstrom,et al.  Single-Neuron Responses in Humans during Execution and Observation of Actions , 2010, Current Biology.

[93]  Georg B. Keller,et al.  Sensorimotor Mismatch Signals in Primary Visual Cortex of the Behaving Mouse , 2012, Neuron.

[94]  Christopher J. Honey,et al.  Selective and Invariant Neural Responses to Spoken and Written Narratives , 2013, The Journal of Neuroscience.