Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control

During reaching movements, the brain's internal models map desired limb motion into predicted forces. When the forces in the task change, these models adapt. Adaptation is guided by generalization: errors in one movement influence prediction in other types of movement. If the mapping is accomplished with population coding, combining basis elements that encode different regions of movement space, then generalization can reveal the encoding of the basis elements. We present a theory that relates encoding to generalization using trial-by-trial changes in behavior during adaptation. We consider adaptation during reaching movements in various velocity-dependent force fields and quantify how errors generalize across direction. We find that the measurement of error is critical to the theory. A typical assumption in motor control is that error is the difference between a current trajectory and a desired trajectory (DJ) that does not change during adaptation. Under this assumption, in all force fields that we examined, including one in which force randomly changes from trial to trial, we found a bimodal generalization pattern, perhaps reflecting basis elements that encode direction bimodally. If the DJ was allowed to vary, bimodality was reduced or eliminated, but the generalization function accounted for nearly twice as much variance. We suggest, therefore, that basis elements representing the internal model of dynamics are sensitive to limb velocity with bimodal tuning; however, it is also possible that during adaptation the error metric itself adapts, which affects the implied shape of the basis elements.

[1]  B. Manly Randomization, Bootstrap and Monte Carlo Methods in Biology , 2018 .

[2]  D. Wolpert,et al.  Temporal and amplitude generalization in motor learning. , 1998, Journal of neurophysiology.

[3]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[4]  T. Ebner,et al.  Cerebellar Purkinje Cell Simple Spike Discharge Encodes Movement Velocity in Primates during Visuomotor Arm Tracking , 1999, The Journal of Neuroscience.

[5]  M. Kawato,et al.  Adaptive internal model of intrinsic kinematics involved in learning an aiming task. , 1998, Journal of experimental psychology. Human perception and performance.

[6]  Reza Shadmehr,et al.  Learning Dynamics of Reaching , 2005 .

[7]  T Poggio,et al.  Fast perceptual learning in visual hyperacuity. , 1991, Science.

[8]  Y Uno,et al.  Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. , 1999, Journal of neurophysiology.

[9]  S. Olney,et al.  Multivariate examination of data from gait analysis of persons with stroke. , 1998, Physical therapy.

[10]  D M Wolpert,et al.  The influence of previous experience on predictive motor control , 2001, Neuroreport.

[11]  Eileen Kowler,et al.  The effect of expectations on slow oculomotor control—IV. Anticipatory smooth eye movements depend on prior target motions , 1984, Vision Research.

[12]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Michael I. Jordan,et al.  Are arm trajectories planned in kinematic or dynamic coordinates? An adaptation study , 1995, Experimental Brain Research.

[14]  T D Sanger,et al.  Human Arm Movements Described by a Low-Dimensional Superposition of Principal Components , 2000, The Journal of Neuroscience.

[15]  E. Bizzi,et al.  Processes controlling arm movements in monkeys. , 1978, Science.

[16]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[17]  R L Sainburg,et al.  Intersegmental dynamics are controlled by sequential anticipatory, error correction, and postural mechanisms. , 1999, Journal of neurophysiology.

[18]  S. Dornič,et al.  Attention and performance V , 1976 .

[19]  R Shadmehr,et al.  Spatial Generalization from Learning Dynamics of Reaching Movements , 2000, The Journal of Neuroscience.

[20]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[21]  J. Soechting,et al.  Somatosensory cortical activity in relation to arm posture: nonuniform spatial tuning. , 1996, Journal of neurophysiology.

[22]  Reza Shadmehr,et al.  Learned dynamics of reaching movements generalize from dominant to nondominant arm. , 2003, Journal of neurophysiology.

[23]  E Brenner,et al.  Perception and action are based on the same visual information: distinction between position and velocity. , 1995, Journal of experimental psychology. Human perception and performance.

[24]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[25]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[26]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[27]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[28]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[29]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[30]  R. Shadmehr,et al.  Long-term adaptation to dynamics of reaching movements: a PET study , 2001, Experimental Brain Research.

[31]  Reza Shadmehr,et al.  Linking Motor Learning to Function Approximation: Learning in an Unlearnable Force Field , 2001, NIPS.

[32]  T J Ebner,et al.  Encoding of target direction and speed during visual instruction and arm tracking in dorsal premotor and primary motor cortical neurons , 1999, The European journal of neuroscience.

[33]  E. Bizzi,et al.  Linear combinations of primitives in vertebrate motor control. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[34]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[35]  R. Poppele,et al.  Representation of passive hindlimb postures in cat spinocerebellar activity. , 1996, Journal of neurophysiology.

[36]  Christof Koch,et al.  Attentional capacity is undifferentiated: Concurrent discrimination of form, color, and motion , 1999, Perception & psychophysics.

[37]  T. Brashers-Krug,et al.  Functional Stages in the Formation of Human Long-Term Motor Memory , 1997, The Journal of Neuroscience.

[38]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[39]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  Robert M. Sanner,et al.  A mathematical model of the adaptive control of human arm motions , 1999, Biological Cybernetics.

[41]  Ferdinando A. Mussa-Ivaldi,et al.  Vector field approximation: a computational paradigm for motor control and learning , 1992, Biological Cybernetics.

[42]  E. Bizzi,et al.  Muscle synergies encoded within the spinal cord: evidence from focal intraspinal NMDA iontophoresis in the frog. , 2001, Journal of neurophysiology.

[43]  F. Mussa-Ivaldi,et al.  The motor system does not learn the dynamics of the arm by rote memorization of past experience. , 1997, Journal of neurophysiology.

[44]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[45]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[46]  Martha Flanders,et al.  Flexibility and Repeatability of Finger Movements During Typing: Analysis of Multiple Degrees of Freedom , 1997, Journal of Computational Neuroscience.

[47]  F. A. Mussa-lvaldi,et al.  Convergent force fields organized in the frog's spinal cord , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  S. Hochstein,et al.  Task difficulty and the specificity of perceptual learning , 1997, Nature.