Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control

Everyday movements pursue diverse and often conflicting mixtures of task goals, requiring sensorimotor strategies customized for the task at hand. Such customization is mostly ignored by traditional theories emphasizing movement geometry and servo control. In contrast, the relationship between the task and the strategy most suitable for accomplishing it lies at the core of our optimal feedback control theory of coordination. Here, we show that the predicted sensitivity to task goals affords natural explanations to a number of novel psychophysical findings. Our point of departure is the little-known fact that corrections for target perturbations introduced late in a reaching movement are incomplete. We show that this is not simply attributable to lack of time, in contradiction with alternative models and, somewhat paradoxically, in agreement with our model. Analysis of optimal feedback gains reveals that the effect is partly attributable to a previously unknown trade-off between stability and accuracy. This yields a testable prediction: if stability requirements are decreased, then accuracy should increase. We confirm the prediction experimentally in three-dimensional obstacle avoidance and interception tasks in which subjects hit a robotic target with programmable impedance. In additional agreement with the theory, we find that subjects do not rely on rigid control strategies but instead exploit every opportunity for increased performance. The modeling methodology needed to capture this extra flexibility is more general than the linear-quadratic methods we used previously. The results suggest that the remarkable flexibility of motor behavior arises from sensorimotor control laws optimized for composite cost functions.

[1]  G. Sutton,et al.  The variation of hand tremor with force in healthy subjects , 1967, The Journal of physiology.

[2]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[3]  J. Houk,et al.  Improvement in linearity and regulation of stiffness that results from actions of stretch reflex. , 1976, Journal of neurophysiology.

[4]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[5]  Geoffrey E. Hinton,et al.  Parallel computations for controlling an arm. , 1984, Journal of motor behavior.

[6]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  K. J. Cole,et al.  Kinematic and electromyographic responses to perturbation of a rapid grasp. , 1987, Journal of neurophysiology.

[8]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[9]  M. Jeannerod The neural and behavioural organization of goal-directed movements , 1990, Psychological Medicine.

[10]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[11]  G E Loeb,et al.  Understanding sensorimotor feedback through optimal control. , 1990, Cold Spring Harbor symposia on quantitative biology.

[12]  T. Flash,et al.  Arm Trajectory Modifications During Reaching Towards Visual Targets , 1991, Journal of Cognitive Neuroscience.

[13]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[14]  Michael A. Arbib,et al.  A computational description of the organization of human reaching and prehension , 1992 .

[15]  C. Prablanc,et al.  Automatic control during hand reaching at undetected two-dimensional target displacements. , 1992, Journal of neurophysiology.

[16]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[17]  E. Komilis,et al.  Error processing in pointing at randomly feedback-induced double-step stimuli. , 1993, Journal of motor behavior.

[18]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[19]  A.D. Kuo,et al.  An optimal control model for analyzing human postural balance , 1995, IEEE Transactions on Biomedical Engineering.

[20]  A. G. Feldman,et al.  The origin and use of positional frames of reference in motor control , 1995, Behavioral and Brain Sciences.

[21]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[22]  C. Harris,et al.  Does saccadic undershoot minimize saccadic flight-time? A Monte-Carlo study , 1995, Vision Research.

[23]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[24]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[25]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[26]  D. Hoffman,et al.  Step-tracking movements of the wrist. IV. Muscle activity associated with movements in different directions. , 1999, Journal of neurophysiology.

[27]  D. Rosenbaum,et al.  Coordination of reaching and grasping by capitalizing on obstacle avoidance and other constraints , 1999, Experimental Brain Research.

[28]  W. Rymer,et al.  End points of planar reaching movements are disrupted by small force pulses: an evaluation of the hypothesis of equifinality. , 2000, Journal of neurophysiology.

[29]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[30]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[31]  M G Pandy,et al.  Computer modeling and simulation of human movement. , 2001, Annual review of biomedical engineering.

[32]  D. Domkin,et al.  Structure of joint variability in bimanual pointing tasks , 2002, Experimental Brain Research.

[33]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[34]  M. Pandy,et al.  Dynamic optimization of human walking. , 2001, Journal of biomechanical engineering.

[35]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[36]  D. Wolpert,et al.  Controlling the statistics of action: obstacle avoidance. , 2002, Journal of neurophysiology.

[37]  Michael I. Jordan,et al.  A Minimal Intervention Principle for Coordinated Movement , 2002, NIPS.

[38]  David Zipser,et al.  Reaching to grasp with a multi-jointed arm. I. Computational model. , 2002, Journal of neurophysiology.

[39]  Emanuel Todorov,et al.  Cosine Tuning Minimizes Motor Errors , 2002, Neural Computation.

[40]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[41]  F. Horak,et al.  Postural feedback responses scale with biomechanical constraints in human standing , 2004, Experimental Brain Research.

[42]  Paul L Gribble,et al.  Role of cocontraction in arm movement accuracy. , 2003, Journal of neurophysiology.

[43]  M. Hinder,et al.  The Case for an Internal Dynamics Model versus Equilibrium Point Control in Human Movement , 2003, The Journal of physiology.

[44]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[45]  Kelvin E. Jones,et al.  The scaling of motor noise with muscle strength and motor unit number in humans , 2004, Experimental Brain Research.

[46]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[47]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[48]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[49]  M. Goodale,et al.  Visual control of reaching movements without vision of the limb , 1986, Experimental Brain Research.

[50]  M. Goodale,et al.  Visual control of reaching movements without vision of the limb , 2004, Experimental Brain Research.

[51]  A. Bahill,et al.  Determining ideal baseball bat weights using muscle force-velocity relationships , 1989, Biological Cybernetics.

[52]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005 .

[53]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[54]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[55]  Daniel M Wolpert,et al.  Optimal control of redundant muscles in step-tracking wrist movements. , 2005, Journal of neurophysiology.

[56]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[57]  Philip N. Sabes,et al.  Modeling Sensorimotor Learning with Linear Dynamical Systems , 2006, Neural Computation.

[58]  Emanuel Todorov,et al.  Iterative linearization methods for approximately optimal control and estimation of non-linear stochastic system , 2007, Int. J. Control.