Internal models of limb dynamics and the encoding of limb state

Studies of reaching suggest that humans adapt to novel arm dynamics by building internal models that transform planned sensory states of the limb, e.g., desired limb position and its derivatives, into motor commands, e.g., joint torques. Earlier work modeled this computation via a population of basis elements and used system identification techniques to estimate the tuning properties of the bases from the patterns of generalization. Here we hypothesized that the neural representation of planned sensory states in the internal model might resemble the signals from the peripheral sensors. These sensors normally encode the limb's actual sensory state in which movement errors occurred. We developed a set of equations based on properties of muscle spindles that estimated spindle discharge as a function of the limb's state during reaching and drawing of circles. We then implemented a simulation of a two-link arm that learned to move in various force fields using these spindle-like bases. The system produced a pattern of adaptation and generalization that accounted for a wide range of previously reported behavioral results. In particular, the bases showed gain-field interactions between encoding of limb position and velocity, very similar to the gain fields inferred from behavioral studies. The poor sensitivity of the bases to limb acceleration predicted behavioral results that were confirmed by experiment. We suggest that the internal model of limb dynamics is computed by the brain with neurons that encode the state of the limb in a manner similar to that expected of muscle spindle afferents.

[1]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[2]  S P Wise,et al.  Neuronal responses in sensorimotor cortex to ramp displacements and maintained positions imposed on hindlimb of the unanesthetized monkey. , 1981, Journal of neurophysiology.

[3]  P. Morasso Spatial control of arm movements , 2004, Experimental Brain Research.

[4]  R Shadmehr,et al.  Spatial Generalization from Learning Dynamics of Reaching Movements , 2000, The Journal of Neuroscience.

[5]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[7]  J Houk,et al.  Responses of Golgi tendon organs to forces applied to muscle tendon. , 1967, Journal of neurophysiology.

[8]  A Prochazka,et al.  Ensemble firing of muscle afferents recorded during normal locomotion in cats , 1998, The Journal of physiology.

[9]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  S. Delp,et al.  Variation of muscle moment arms with elbow and forearm position. , 1995, Journal of biomechanics.

[11]  E Otten,et al.  A muscle spindle model for primary afferent firing based on a simulation of intrafusal mechanical events. , 1991, Journal of neurophysiology.

[12]  C. Atkeson,et al.  Learning arm kinematics and dynamics. , 1989, Annual review of neuroscience.

[13]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[14]  Gerald L. Gottlieb,et al.  The generation of the efferent command and the importance of joint compliance in fast elbow movements , 2004, Experimental Brain Research.

[15]  M. Gorassini,et al.  Models of ensemble firing of muscle spindle afferents recorded during normal locomotion in cats , 1998, The Journal of physiology.

[16]  J. Houk,et al.  Dependence of dynamic response of spindle receptors on muscle length and velocity. , 1981, Journal of neurophysiology.

[17]  Mitsuo Kawato,et al.  Adaptation and learning in control of voluntary movement by the central nervous system , 1988, Adv. Robotics.

[18]  James R. Lackner,et al.  Adaptation to a novel multi-force environment , 2005, Experimental Brain Research.

[19]  A B Vallbo,et al.  Directional tuning of human forearm muscle afferents during voluntary wrist movements , 2001, The Journal of physiology.

[20]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[21]  R. Shadmehr,et al.  A Gain-Field Encoding of Limb Position and Velocity in the Internal Model of Arm Dynamics , 2003, PLoS biology.

[22]  C. Marsden,et al.  Servo action in the human thumb. , 1976, The Journal of physiology.

[23]  David J Ostry,et al.  Transfer of Motor Learning across Arm Configurations , 2002, The Journal of Neuroscience.

[24]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[25]  U. Proske,et al.  Effect of eccentric muscle contractions on Golgi tendon organ responses to passive and active tension in the cat , 2002, The Journal of physiology.

[26]  Z. Hasan A model of spindle afferent response to muscle stretch. , 1983, Journal of neurophysiology.

[27]  L. Paninski,et al.  Superlinear Population Encoding of Dynamic Hand Trajectory in Primary Motor Cortex , 2004, The Journal of Neuroscience.

[28]  Reza Shadmehr,et al.  Learned dynamics of reaching movements generalize from dominant to nondominant arm. , 2003, Journal of neurophysiology.

[29]  R. Poppele,et al.  Quantitative description of linear behavior of mammalian muscle spindles. , 1970, Journal of neurophysiology.

[30]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[31]  J. Lackner,et al.  Task-dependent motor learning , 2003, Experimental Brain Research.

[32]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. , 1997, Journal of neurophysiology.

[33]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[34]  F. Mussa-Ivaldi,et al.  The motor system does not learn the dynamics of the arm by rote memorization of past experience. , 1997, Journal of neurophysiology.

[35]  Chou-Ching K. Lin,et al.  Structural Model of the Muscle Spindle , 2004, Annals of Biomedical Engineering.

[36]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.