Different mechanisms involved in adaptation to stable and unstable dynamics.

Recently, we demonstrated that humans can learn to make accurate movements in an unstable environment by controlling magnitude, shape, and orientation of the endpoint impedance. Although previous studies of human motor learning suggest that the brain acquires an inverse dynamics model of the novel environment, it is not known whether this control mechanism is operative in unstable environments. We compared learning of multijoint arm movements in a "velocity-dependent force field" (VF), which interacted with the arm in a stable manner, and learning in a "divergent force field" (DF), where the interaction was unstable. The characteristics of error evolution were markedly different in the 2 fields. The direction of trajectory error in the DF alternated to the left and right during the early stage of learning; that is, signed error was inconsistent from movement to movement and could not have guided learning of an inverse dynamics model. This contrasted sharply with trajectory error in the VF, which was initially biased and decayed in a manner that was consistent with rapid feedback error learning. EMG recorded before and after learning in the DF and VF are also consistent with different learning and control mechanisms for adapting to stable and unstable dynamics, that is, inverse dynamics model formation and impedance control. We also investigated adaptation to a rotated DF to examine the interplay between inverse dynamics model formation and impedance control. Our results suggest that an inverse dynamics model can function in parallel with an impedance controller to compensate for consistent perturbing force in unstable environments.

[1]  D. Humphrey,et al.  Separate cortical systems for control of joint movement and joint stiffness: reciprocal activation and coactivation of antagonist muscles. , 1983, Advances in neurology.

[2]  RP Dum,et al.  Topographic organization of corticospinal projections from the frontal lobe: motor areas on the medial surface of the hemisphere , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  T. Milner,et al.  Wrist muscle activation patterns and stiffness associated with stable and unstable mechanical loads , 2004, Experimental Brain Research.

[5]  David J. Ostry,et al.  Compensation for loads during arm movements using equilibrium-point control , 2000, Experimental Brain Research.

[6]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[7]  E. Bizzi,et al.  Neuronal activity in the supplementary motor area of monkeys adapting to a new dynamic environment. , 2004, Journal of neurophysiology.

[8]  A. G. Feldman Once more on the equilibrium-point hypothesis (lambda model) for motor control. , 1986, Journal of motor behavior.

[9]  M. Inase,et al.  Two movement-related foci in the primate cingulate cortex observed in signal-triggered and self-paced forelimb movements. , 1991, Journal of neurophysiology.

[10]  F. Pollick,et al.  The Three-Dimensional Curvature of Straight-Ahead Movements. , 1996, Journal of motor behavior.

[11]  J. Tanji,et al.  Neurons in the rostral cingulate motor area monitor multiple phases of visuomotor behavior with modest parametric selectivity. , 2005, Journal of neurophysiology.

[12]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[13]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[14]  Alan C. Evans,et al.  Functional Anatomy of Visuomotor Skill Learning in Human Subjects Examined with Positron Emission Tomography , 1996, The European journal of neuroscience.

[15]  M. Kawato,et al.  Internal representations of the motor apparatus: implications from generalization in visuomotor learning. , 1995, Journal of experimental psychology. Human perception and performance.

[16]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[17]  E. Bizzi,et al.  Neuronal correlates of movement dynamics in the dorsal and ventral premotor area in the monkey , 2005, Experimental Brain Research.

[18]  A. G. Feldman Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[19]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[20]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[21]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[22]  E. Bizzi,et al.  Neuronal Correlates of Kinematics-to-Dynamics Transformation in the Supplementary Motor Area , 2002, Neuron.

[23]  Jean-Jacques E. Slotine,et al.  Performance in Adaptive Manipulator Control , 1991, Int. J. Robotics Res..

[24]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[25]  H. Dr,et al.  Separate cortical systems for control of joint movement and joint stiffness: reciprocal activation and coactivation of antagonist muscles. , 1983 .

[26]  Richard S. J. Frackowiak,et al.  Multiple nonprimary motor areas in the human cortex. , 1997, Journal of neurophysiology.

[27]  M. Kawato,et al.  Hierarchical neural network model for voluntary movement with application to robotics , 1988, IEEE Control Systems Magazine.

[28]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[29]  M. Kawato,et al.  Temporal firing patterns of Purkinje cells in the cerebellar ventral paraflocculus during ocular following responses in monkeys I. Simple spikes. , 1998, Journal of neurophysiology.

[30]  M. Kawato,et al.  Functional significance of stiffness in adaptation of multijoint arm movements to stable and unstable dynamics , 2003, Experimental Brain Research.

[31]  R A Scheidt,et al.  Impedance control and internal model formation when reaching in a randomly varying dynamical environment. , 2001, Journal of neurophysiology.

[32]  R L Sainburg,et al.  Intersegmental dynamics are controlled by sequential anticipatory, error correction, and postural mechanisms. , 1999, Journal of neurophysiology.

[33]  G. Rizzolatti,et al.  Multiple representations of body movements in mesial area 6 and the adjacent cingulate cortex: An intracortical microstimulation study in the macaque monkey , 1991, The Journal of comparative neurology.

[34]  R Shadmehr,et al.  Spatial Generalization from Learning Dynamics of Reaching Movements , 2000, The Journal of Neuroscience.

[35]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[36]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[37]  G. S. Russo,et al.  Neural activity in monkey dorsal and ventral cingulate motor areas: comparison with the supplementary motor area. , 2002, Journal of neurophysiology.

[38]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  E Burdet,et al.  A method for measuring endpoint stiffness during multi-joint arm movements. , 2000, Journal of biomechanics.

[40]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  M. Kawato,et al.  Computational studies on acquisition and adaptation of ocular following responses based on cerebellar synaptic plasticity. , 2002, Journal of neurophysiology.

[42]  G. S. Russo,et al.  Neural activity correlated with the preparation and execution of visually guided arm movements in the cingulate motor area of the monkey , 2001, Experimental Brain Research.

[43]  J. Kalaska,et al.  Cerebral cortical mechanisms of reaching movements. , 1992, Science.

[44]  J. Kalaska,et al.  Cerebellar nuclear cell activity during antagonist cocontraction and reciprocal inhibition of forearm muscles. , 1985, Journal of neurophysiology.

[45]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[46]  P. Strick,et al.  Motor areas in the frontal lobe of the primate , 2002, Physiology & Behavior.

[47]  M. Hallett,et al.  Frontal and parietal networks for conditional motor learning: a positron emission tomography study. , 1997, Journal of neurophysiology.

[48]  P. Strick,et al.  Motor areas of the medial wall: a review of their location and functional activation. , 1996, Cerebral cortex.

[49]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[50]  R. Eckmiller Advanced neural computers , 1990 .

[51]  Etienne Burdet,et al.  Experimental evaluation of nonlinear adaptive controllers , 1998 .

[52]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[53]  M. Kawato,et al.  Change in neuronal firing patterns in the process of motor command generation for the ocular following response. , 2001, Journal of neurophysiology.

[54]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[55]  Neville Hogan,et al.  The mechanics of multi-joint posture and movement control , 1985, Biological Cybernetics.

[56]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[57]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[58]  Anatol G. Feldman,et al.  Reciprocal and coactivation commands for fast wrist movements , 2004, Experimental Brain Research.

[59]  D. Wolpert,et al.  Temporal and amplitude generalization in motor learning. , 1998, Journal of neurophysiology.

[60]  G. S. Russo,et al.  Target-, limb-, and context-dependent neural activity in the cingulate and supplementary motor areas of the monkey , 2004, Experimental Brain Research.

[61]  Scott T. Grafton,et al.  Abstract and Effector-Specific Representations of Motor Sequences Identified with PET , 1998, The Journal of Neuroscience.

[62]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[63]  K. A. Hadland,et al.  The anterior cingulate and reward-guided selection of actions. , 2003, Journal of neurophysiology.

[64]  B. R. Moore,et al.  A modification of the Rayleigh test for vector data , 1980 .

[65]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. , 1997, Journal of neurophysiology.

[66]  A. M. Smith,et al.  Input-output properties of hand-related cells in the ventral cingulate cortex in the monkey. , 1995, Journal of neurophysiology.

[67]  Reza Shadmehr,et al.  Learning the dynamics of reaching movements results in the modification of arm impedance and long-latency perturbation responses , 2001, Biological Cybernetics.

[68]  Hans Forssberg,et al.  Human brain activity in the control of fine static precision grip forces: an fMRI study , 2001, The European journal of neuroscience.

[69]  A. McIntosh,et al.  Time course of changes in brain activity and functional connectivity associated with long-term adaptation to a rotational transformation. , 2005, Journal of neurophysiology.

[70]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[71]  A. M. Smith,et al.  Comparison of the neuronal activity in the SMA and the ventral cingulate cortex during prehension in the monkey. , 1997, Journal of neurophysiology.

[72]  D Akkal,et al.  Comparison of neuronal activity in the rostral supplementary and cingulate motor areas during a task with cognitive and motor demands , 2002, The European journal of neuroscience.

[73]  S. Scott,et al.  Neural activity in primary motor cortex related to mechanical loads applied to the shoulder and elbow during a postural task. , 2001, Journal of neurophysiology.

[74]  E. Bizzi,et al.  Cortical correlates of learning in monkeys adapting to a new dynamical environment. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[75]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[76]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[77]  Rieko Osu,et al.  Short- and long-term changes in joint co-contraction associated with motor learning as revealed from surface EMG. , 2002, Journal of neurophysiology.

[78]  Allan M. Smith Does the cerebellum learn strategies for the optimal time-varying control of joint stiffness ? , 1996 .

[79]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[80]  Nicholas I. Fisher,et al.  Statistical Analysis of Circular Data , 1993 .

[81]  R. Passingham,et al.  Relation between cerebral activity and force in the motor areas of the human brain. , 1995, Journal of neurophysiology.

[82]  W. Wheeler,et al.  Dissociation between hand motion and population vectors from neural activity in motor cortex , .

[83]  Takashi Mitsuda,et al.  Three-dimensional tuning profile of motor cortical activity during arm movements , 2002, Neuroreport.