Representing delayed force feedback as a combination of current and delayed states.

To adapt to deterministic force perturbations that depend on the current state of the hand, internal representations are formed to capture the relationships between forces experienced and motion. However, information from multiple modalities travels at different rates, resulting in intermodal delays that require compensation for these internal representations to develop. To understand how these delays are represented by the brain, we presented participants with delayed velocity-dependent force fields, i.e., forces that depend on hand velocity either 70 or 100 ms beforehand. We probed the internal representation of these delayed forces by examining the forces the participants applied to cope with the perturbations. The findings showed that for both delayed forces, the best model of internal representation consisted of a delayed velocity and current position and velocity. We show that participants relied initially on the current state, but with adaptation, the contribution of the delayed representation to adaptation increased. After adaptation, when the participants were asked to make movements with a higher velocity for which they had not previously experienced with the delayed force field, they applied forces that were consistent with current position and velocity as well as delayed velocity representations. This suggests that the sensorimotor system represents delayed force feedback using current and delayed state information and that it uses this representation when generalizing to faster movements.NEW & NOTEWORTHY The brain compensates for forces in the body and the environment to control movements, but it is unclear how it does so given the inherent delays in information transmission and processing. We examined how participants cope with delayed forces that depend on their arm velocity 70 or 100 ms beforehand. After adaptation, participants applied opposing forces that revealed a partially correct representation of the perturbation using the current and the delayed information.

[1]  J R Flanagan,et al.  Trajectory adaptation to a nonlinear visuomotor transformation: evidence of motion planning in visually perceived space. , 1995, Journal of neurophysiology.

[2]  M. Butz,et al.  Synchronized brain network associated with essential tremor as revealed by magnetoencephalography , 2009, Movement disorders : official journal of the Movement Disorder Society.

[3]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[4]  Ferdinando A. Mussa-Ivaldi,et al.  Perception of Delayed Stiffness , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[5]  Gabriel Baud-Bovy,et al.  Delayed visual feedback affects both manual tracking and grip force control when transporting a handheld object. , 2010, Journal of neurophysiology.

[6]  F. Mussa-Ivaldi,et al.  Simultaneity in Perception of Knocking , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  A. G. Witney,et al.  Predictive motor learning of temporal delays. , 1999, Journal of neurophysiology.

[8]  Peter K Stys,et al.  Virtual hypoxia and chronic necrosis of demyelinated axons in multiple sclerosis , 2009, The Lancet Neurology.

[9]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[10]  Allison M. Okamura,et al.  Grip Force Control during Virtual Object Interaction: Effect of Force Feedback, Accuracy Demands, and Training , 2014, IEEE Transactions on Haptics.

[11]  J. Tanji,et al.  The role of premotor cortex and the supplementary motor area in the temporal control of movement in man. , 1993, Brain : a journal of neurology.

[12]  J. Krakauer,et al.  Explicit and Implicit Contributions to Learning in a Sensorimotor Adaptation Task , 2014, The Journal of Neuroscience.

[13]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[14]  L. Christensen,et al.  University of Birmingham Disruption of state estimation in the human lateral cerebellum , 2007 .

[15]  Sandra Hirche,et al.  Human Perceived Transparency with Time Delay , 2007, Advances in Telerobotics.

[16]  D. Nozaki,et al.  Adaptation to Visual Feedback Delay Influences Visuomotor Learning , 2012, PloS one.

[17]  Masaya Hirashima,et al.  Habituation to Feedback Delay Restores Degraded Visuomotor Adaptation by Altering Both Sensory Prediction Error and the Sensitivity of Adaptation to the Error , 2012, Front. Psychology.

[18]  Timothy J. Ebner,et al.  Cerebellum Predicts the Future Motor State , 2008, The Cerebellum.

[19]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[20]  Jörn Diedrichsen,et al.  Dissociating Timing and Coordination as Functions of the Cerebellum , 2007, The Journal of Neuroscience.

[21]  M. Rosenblum,et al.  Controlling synchronization in an ensemble of globally coupled oscillators. , 2004, Physical review letters.

[22]  H. Bergman,et al.  Pathological synchronization in Parkinson's disease: networks, models and treatments , 2007, Trends in Neurosciences.

[23]  Christian Hauptmann,et al.  Effective desynchronization by nonlinear delayed feedback. , 2005, Physical review letters.

[24]  Hiroshi Imamizu,et al.  Imposed visual feedback delay of an action changes mass perception based on the sensory prediction error , 2013, Front. Psychol..

[25]  Maurice A. Smith,et al.  Environmental Consistency Determines the Rate of Motor Adaptation , 2014, Current Biology.

[26]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[27]  F. Mussa-Ivaldi,et al.  The motor system does not learn the dynamics of the arm by rote memorization of past experience. , 1997, Journal of neurophysiology.

[28]  Jörn Diedrichsen,et al.  Structural learning in feedforward and feedback control. , 2012, Journal of neurophysiology.

[29]  Hiroaki Gomi,et al.  What you feel is what you see: inverse dynamics estimation underlies the resistive sensation of a delayed cursor , 2015, Proceedings of the Royal Society B: Biological Sciences.

[30]  Reza Shadmehr,et al.  Internal models of limb dynamics and the encoding of limb state , 2005, Journal of neural engineering.

[31]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[32]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[33]  Gary C. Sing,et al.  Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity , 2009, Neuron.

[34]  D. Nowak,et al.  Dexterity in cerebellar agenesis , 2007, Neuropsychologia.

[35]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[36]  Ferdinando A. Mussa-Ivaldi,et al.  Analytical Study of Perceptual and Motor Transparency in Bilateral Teleoperation , 2013, IEEE Transactions on Human-Machine Systems.

[37]  J Houk,et al.  Responses of Golgi tendon organs to forces applied to muscle tendon. , 1967, Journal of neurophysiology.

[38]  Gary C. Sing,et al.  Limb motion dictates how motor learning arises from arbitrary environmental dynamics. , 2013, Journal of neurophysiology.

[39]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  Ferdinando A. Mussa-Ivaldi,et al.  A Regression and Boundary-Crossing-Based Model for the Perception of Delayed Stiffness , 2008, IEEE Transactions on Haptics.

[41]  A. Karniel,et al.  Proximodistal gradient in the perception of delayed stiffness , 2009, 2009 Virtual Rehabilitation International Conference.

[42]  Franck Vidal,et al.  The supplementary motor area in motor and perceptual time processing: fMRI studies , 2006, Cognitive Processing.

[43]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[44]  M. Di Luca,et al.  Effects of visual–haptic asynchronies and loading–unloading movements on compliance perception , 2011, Brain Research Bulletin.

[45]  D. Ginty,et al.  The gentle touch receptors of mammalian skin , 2014, Science.

[46]  Ferdinando A. Mussa-Ivaldi,et al.  Sequence, time, or state representation: how does the motor control system adapt to variable environments? , 2003, Biological Cybernetics.

[47]  Kurt A. Thoroughman,et al.  Trial-by-trial transformation of error into sensorimotor adaptation changes with environmental dynamics. , 2007, Journal of neurophysiology.

[48]  Ferdinando A. Mussa-Ivaldi,et al.  Probing Virtual Boundaries and the Perception of Delayed Stiffness , 2008, Adv. Robotics.

[49]  Stephen M. Rao,et al.  The evolution of brain activation during temporal processing , 2001, Nature Neuroscience.

[50]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[51]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[52]  Ilana Nisky,et al.  The effect of force feedback delay on stiffness perception and grip force modulation during tool-mediated interaction with elastic force fields. , 2015, Journal of neurophysiology.

[53]  Ilana Nisky,et al.  Stimulation of PPC Affects the Mapping between Motion and Force Signals for Stiffness Perception But Not Motion Control , 2016, The Journal of Neuroscience.

[54]  Amir Karniel,et al.  Open questions in computational motor control. , 2011, Journal of integrative neuroscience.

[55]  R. Held,et al.  Adaptation to displaced and delayed visual feedback from the hand. , 1966 .

[56]  H. Scharfman,et al.  The neurobiology of epilepsy , 2007, Current neurology and neuroscience reports.

[57]  Wilsaan M. Joiner,et al.  Long-term retention explained by a model of short-term learning in the adaptive control of reaching. , 2008, Journal of neurophysiology.

[58]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[59]  J. Bizley.  The Neural Bases of Multisensory Processes , 2011 .

[60]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[61]  Gary C. Sing,et al.  Linear hypergeneralization of learned dynamics across movement speeds reveals anisotropic, gain-encoding primitives for motor adaptation. , 2011, Journal of neurophysiology.

[62]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Amir Karniel,et al.  Adaptation to Delayed Force Perturbations in Reaching Movements , 2010, PloS one.

[64]  R. Ivry.  The representation of temporal information in perception and motor control , 1996, Current Opinion in Neurobiology.

[65]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[66]  R. Shadmehr,et al.  Adaptation and generalization in acceleration-dependent force fields , 2006, Experimental Brain Research.

[67]  Ferdinando A. Mussa-Ivaldi,et al.  Perception and Action in Teleoperated Needle Insertion , 2011, IEEE Transactions on Haptics.

[68]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[69]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[70]  R. H. Myers.  Classical and modern regression with applications , 1986 .

[71]  H. Zelaznik,et al.  The Cerebellum and Event Timing , 2002, Annals of the New York Academy of Sciences.

[72]  H. Zelaznik,et al.  Disrupted Timing of Discontinuous But Not Continuous Movements by Cerebellar Lesions , 2003, Science.

[73]  Daniel M Wolpert,et al.  Kinematics and Dynamics Are Not Represented Independently in Motor Working Memory: Evidence from an Interference Study , 2002, The Journal of Neuroscience.

[74]  T. Milner,et al.  Compensation for mechanically unstable loading in voluntary wrist movement , 2004, Experimental Brain Research.

[75]  Jordan A Taylor,et al.  Explicit and Implicit Processes Constitute the Fast and Slow Processes of Sensorimotor Learning , 2015, The Journal of Neuroscience.

[76]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.