Learning to tie the knot: The acquisition of functional object representations by physical and observational experience

Here we examined neural substrates for physically and observationally learning to construct novel objects, and characterized brain regions associated with each kind of learning using fMRI. Each participant was assigned a training partner, and for five consecutive days practiced tying one group of knots (“tied” condition) or watched their partner tie different knots (“watched” condition) while a third set of knots remained untrained. Functional MRI was obtained prior to and immediately following the week of training while participants performed a visual knot-matching task. After training, a portion of left superior parietal lobule demonstrated a training by scan session interaction. This means this parietal region responded selectively to knots that participants had physically learned to tie in the post-training scan session but not the pre-training scan session. A conjunction analysis on the post-training scan data showed right intraparietal sulcus and right dorsal premotor cortex to respond when viewing images of knots from the tied and watched conditions compared to knots that were untrained during the post-training scan session. This suggests that these brain areas track both physical and observational learning. Together, the data provide preliminary evidence of engagement of brain regions associated with hand-object interactions when viewing objects associated with physical experience, and with observational experience without concurrent physical practice.

[1]  A. Schleicher,et al.  The human parietal operculum. I. Cytoarchitectonic mapping of subdivisions. , 2006, Cerebral cortex.

[2]  Gregory Króliczak,et al.  Specialization of the left supramarginal gyrus for hand-independent praxis representation is not related to hand dominance , 2016, Neuropsychologia.

[3]  V. Penhune,et al.  Specific Increases within Global Decreases: A Functional Magnetic Resonance Imaging Investigation of Five Days of Motor Sequence Learning , 2010, The Journal of Neuroscience.

[4]  A. Woodward,et al.  The joint role of trained, untrained, and observed actions at the origins of goal recognition. , 2014, Infant behavior & development.

[5]  Sarah H. Creem-Regehr,et al.  Neural representations of graspable objects: are tools special? , 2005, Brain research. Cognitive brain research.

[6]  Emily S. Cross,et al.  Testing key predictions of the associative account of mirror neurons in humans using multivariate pattern analysis. , 2014, The Behavioral and brain sciences.

[7]  Amy Needham,et al.  Learning about tools in infancy. , 2007, Developmental psychology.

[8]  William A. Cunningham,et al.  Type I and Type II error concerns in fMRI research: re-balancing the scale. , 2009, Social cognitive and affective neuroscience.

[9]  Blake W. Johnson,et al.  Mu rhythm modulation during observation of an object-directed grasp. , 2004, Brain research. Cognitive brain research.

[10]  Annie Vinter,et al.  Implicit motor learning through observational training in adults and children , 2002, Memory & cognition.

[11]  W. Prinz,et al.  The imitative mind : development, evolution, and brain bases , 2002 .

[12]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[13]  Bradford Z. Mahon,et al.  Action-Related Properties Shape Object Representations in the Ventral Stream , 2007, Neuron.

[14]  Olaf Hauk,et al.  Experience-dependent Plasticity of Conceptual Representations in Human Sensory-Motor Areas , 2007, Journal of Cognitive Neuroscience.

[15]  Leslie G. Ungerleider,et al.  Neural correlates of category-specific knowledge , 1996, Nature.

[16]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[17]  Emily S. Cross,et al.  Additive Routes to Action Learning: Layering Experience Shapes Engagement of the Action Observation Network , 2015, Cerebral cortex.

[18]  G. Rizzolatti,et al.  Resonance behaviors and mirror neurons. , 1999, Archives italiennes de biologie.

[19]  Christian Bellebaum,et al.  Neural representations of novel objects associated with olfactory experience , 2016, Behavioural Brain Research.

[20]  S. Cappa,et al.  Neural representations of unfamiliar objects are modulated by sensorimotor experience , 2013, Cortex.

[21]  Jörn Diedrichsen,et al.  Detecting and adjusting for artifacts in fMRI time series data , 2005, NeuroImage.

[22]  Scott T. Grafton,et al.  A distributed left hemisphere network active during planning of everyday tool use skills. , 2004, Cerebral cortex.

[23]  Alex Martin,et al.  Representation of Manipulable Man-Made Objects in the Dorsal Stream , 2000, NeuroImage.

[24]  Krista Casler,et al.  Young children's rapid learning about artifacts. , 2005, Developmental science.

[25]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[26]  S. Thompson-Schill,et al.  Manual Experience Shapes Object Representations , 2013, Psychological science.

[27]  Emily S. Cross,et al.  Using guitar learning to probe the Action Observation Network's response to visuomotor familiarity , 2017, NeuroImage.

[28]  Jessie Chen,et al.  Neurophysiology of prehension. I. Posterior parietal cortex and object-oriented hand behaviors. , 2007, Journal of neurophysiology.

[29]  Felix D. Schönbrodt,et al.  Should We Stop Looking for a Better Scoring Algorithm for Handling Implicit Association Test Data? Test of the Role of Errors, Extreme Latencies Treatment, Scoring Formula, and Practice Trials on Reliability and Validity , 2015, PloS one.

[30]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[31]  Jedediah M. Singer,et al.  Effects of long-term object familiarity on event-related potentials in the monkey. , 2007, Cerebral cortex.

[32]  Richard Ramsey,et al.  Physical experience leads to enhanced object perception in parietal cortex: Insights from knot tying , 2012, Neuropsychologia.

[33]  E. Renzi,et al.  Modality-specific and supramodal mechanisms of apraxia. , 1982, Brain : a journal of neurology.

[34]  Andrew C. Papanicolaou,et al.  Visuospatial tasks compared via activation of regional cerebral blood flow , 1988, Neuropsychologia.

[35]  Sarah A. Gerson,et al.  Building intentional action knowledge with one’s hands , 2009 .

[36]  Antonia F. de C. Hamilton,et al.  Understanding actors and object-goals in the human brain , 2010, NeuroImage.

[37]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[38]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[39]  Scott H. Johnson-Frey The neural bases of complex tool use in humans , 2004, Trends in Cognitive Sciences.

[40]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[41]  Scott H. Johnson,et al.  Imagining the impossible: intact motor representations in hemiplegics , 2000, Neuroreport.

[42]  Scott T. Grafton,et al.  Beyond grasping: Representation of action in human anterior intraparietal sulcus , 2007, NeuroImage.

[43]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[44]  Andrew A G Mattar,et al.  Motor Learning by Observing , 2005, Neuron.

[45]  L. Cohen,et al.  Neuroplasticity Subserving Motor Skill Learning , 2011, Neuron.

[46]  Kenneth M. Heilman,et al.  Apraxia : The Neuropsychology of Action , 2014 .

[47]  Ivan Toni,et al.  Parieto-Frontal Connectivity during Visually Guided Grasping , 2007, The Journal of Neuroscience.

[48]  S. Frey What Puts the How in Where? Tool Use and the Divided Visual Streams Hypothesis , 2007, Cortex.

[49]  Cristina Massen,et al.  Tool characteristics in imagery of tool actions , 2013, Psychological Research.

[50]  L. Buxbaum Ideomotor Apraxia: a Call to Action , 2001, Neurocase.

[51]  Emily S. Cross,et al.  Sensitivity of the action observation network to physical and observational learning. , 2008, Cerebral cortex.

[52]  R. Passingham Premotor cortex: Sensory cues and movement , 1985, Behavioural Brain Research.

[53]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[54]  H. Sakata,et al.  Toward an understanding of the neural processing for 3D shape perception , 2005, Neuropsychologia.

[55]  Soumya Ghosh,et al.  Neurophysiology of prehension. II. Response diversity in primary somatosensory (S-I) and motor (M-I) cortices. , 2007, Journal of neurophysiology.

[56]  Stacey A. Hancock Modern Statistics for the Social and Behavioral Sciences: A Practical Introduction , 2012 .

[57]  Alex Martin,et al.  A neural system for learning about object function. , 2006, Cerebral cortex.

[58]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[59]  Christine E. Watson,et al.  A distributed network critical for selecting among tool-directed actions , 2015, Cortex.

[60]  D. Proffitt,et al.  Action-specific influences on distance perception: a role for motor simulation. , 2008, Journal of experimental psychology. Human perception and performance.

[61]  A. Williams,et al.  What is modelled during observational learning? , 2007, Journal of sports sciences.

[62]  Simon B. Eickhoff,et al.  Assignment of functional activations to probabilistic cytoarchitectonic areas revisited , 2007, NeuroImage.

[63]  N. N. Rüther,et al.  Observed manipulation of novel tools leads to mu rhythm suppression over sensory-motor cortices , 2014, Behavioural Brain Research.

[64]  Jessie Chen,et al.  Neurophysiology of prehension. III. Representation of object features in posterior parietal cortex of the macaque monkey. , 2007, Journal of neurophysiology.

[65]  Ivan Toni,et al.  Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations , 2006, The Journal of Neuroscience.

[66]  James N. Lee,et al.  The influence of complex action knowledge on representations of novel graspable objects: Evidence from functional magnetic resonance imaging , 2007, Journal of the International Neuropsychological Society.

[67]  Scott T. Grafton,et al.  Premotor Cortex Activation during Observation and Naming of Familiar Tools , 1997, NeuroImage.

[68]  Adam Flanders,et al.  Regional brain activation associated with different performance patterns during learning of a complex motor skill. , 2003, Cerebral cortex.

[69]  Guy Vingerhoets,et al.  Knowing about tools: Neural correlates of tool familiarity and experience , 2008, NeuroImage.

[70]  M. Brett,et al.  Actions Speak Louder Than Functions: The Importance of Manipulability and Action in Tool Representation , 2003, Journal of Cognitive Neuroscience.

[71]  V. Penhune,et al.  Author's Personal Copy Behavioural Brain Research Parallel Contributions of Cerebellar, Striatal and M1 Mechanisms to Motor Sequence Learning , 2022 .

[72]  William A. Cunningham,et al.  Tools of the Trade Type I and Type II error concerns in fMRI research : rebalancing the scale , 2009 .

[73]  A. Meltzoff The 'like me' framework for recognizing and becoming an intentional agent. , 2007, Acta psychologica.

[74]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[75]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[76]  Jörn Diedrichsen,et al.  Skill learning strengthens cortical representations of motor sequences , 2013, eLife.

[77]  M. Kiefer,et al.  Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions , 2012, Cortex.

[78]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[79]  Michael B. Miller,et al.  The principled control of false positives in neuroimaging. , 2009, Social cognitive and affective neuroscience.

[80]  E. Miller,et al.  From rule to response: neuronal processes in the premotor and prefrontal cortex. , 2003, Journal of neurophysiology.

[81]  Luc Proteau,et al.  Learning through observation: a combination of expert and novice models favors learning , 2011, Experimental Brain Research.

[82]  Luc Proteau,et al.  Observation learning of a motor task: who and when? , 2013, Experimental Brain Research.

[83]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[84]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[85]  R. J. Seitz,et al.  A parieto-premotor network for object manipulation: evidence from neuroimaging , 1999, Experimental Brain Research.

[86]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.