Optimality principles in sensorimotor control

The sensorimotor system is a product of evolution, development, learning and adaptation—which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.

[1]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[2]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[3]  R. E. Kalman,et al.  When Is a Linear Control System Optimal , 1964 .

[4]  G. Sutton,et al.  The variation of hand tremor with force in healthy subjects , 1967, The Journal of physiology.

[5]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[6]  G. J. Thomas The Co-ordination and Regulation of Movements , 1967 .

[7]  D. J. Hanson,et al.  Book Reviews : Harold Fallding, The Sociological Task : A Concise Introduction to the Main Issues in Sociological Theory and Method. Englewood Cliffs, New Jersey: Prentice-Hall, Inc., 1958 , 1970 .

[8]  Donald E. Kirk,et al.  Optimal control theory : an introduction , 1970 .

[9]  D. Jacobson,et al.  Studies of human locomotion via optimal programming , 1971 .

[10]  J. Meditch,et al.  Applied optimal control , 1972, IEEE Transactions on Automatic Control.

[11]  B. Anderson,et al.  Nonlinear regulator theory and an inverse optimal control problem , 1973 .

[12]  J. Houk,et al.  Improvement in linearity and regulation of stiffness that results from actions of stretch reflex. , 1976, Journal of neurophysiology.

[13]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[14]  P. Viviani,et al.  The law relating the kinematic and figural aspects of drawing movements. , 1983, Acta psychologica.

[15]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Geoffrey E. Hinton,et al.  Parallel computations for controlling an arm. , 1984, Journal of motor behavior.

[18]  A. Pellionisz,et al.  Coordination: a vector-matrix description of transformations of overcomplete CNS coordinates and a tensorial solution using the Moore-Penrose generalized inverse. , 1984, Journal of theoretical biology.

[19]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  J. Abbs,et al.  Dynamic control of the perioral system during speech: kinematic analyses of autogenic and nonautogenic sensorimotor processes. , 1985, Journal of neurophysiology.

[21]  R. Hartley Stochastic Modelling and Control , 1985 .

[22]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[23]  K. J. Cole,et al.  Kinematic and electromyographic responses to perturbation of a rapid grasp. , 1987, Journal of neurophysiology.

[24]  M L Audu,et al.  A dynamic optimization technique for predicting muscle forces in the swing phase of gait. , 1987, Journal of biomechanics.

[25]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[26]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[27]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[28]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[29]  G E Loeb,et al.  Understanding sensorimotor feedback through optimal control. , 1990, Cold Spring Harbor symposia on quantitative biology.

[30]  W S Levine,et al.  An optimal control model for maximum-height human jumping. , 1990, Journal of biomechanics.

[31]  T. Milner,et al.  The effect of accuracy constraints on three-dimensional movement kinematics , 1990, Neuroscience.

[32]  T. Flash,et al.  Arm Trajectory Modifications During Reaching Towards Visual Targets , 1991, Journal of Cognitive Neuroscience.

[33]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[34]  Michael A. Arbib,et al.  A computational description of the organization of human reaching and prehension , 1992 .

[35]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[36]  E. Komilis,et al.  Error processing in pointing at randomly feedback-induced double-step stimuli. , 1993, Journal of motor behavior.

[37]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[38]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  A.D. Kuo,et al.  An optimal control model for analyzing human postural balance , 1995, IEEE Transactions on Biomedical Engineering.

[40]  J J Collins,et al.  The redundant nature of locomotor optimization laws. , 1995, Journal of biomechanics.

[41]  A. G. Feldman,et al.  The origin and use of positional frames of reference in motor control , 1995, Behavioral and Brain Sciences.

[42]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[43]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[44]  M G Pandy,et al.  Optimal control of non-ballistic muscular movements: a constraint-based performance criterion for rising from a chair. , 1995, Journal of biomechanical engineering.

[45]  Peter Dayan,et al.  Bee foraging in uncertain environments using predictive hebbian learning , 1995, Nature.

[46]  N. A. Bernstein Dexterity and Its Development , 1996 .

[47]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[48]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[49]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[50]  Guoming G. Zhu,et al.  A Convergent Algorithm for the Output Covariance Constraint Control Problem , 1997 .

[51]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[52]  J R Flanagan,et al.  The Role of Internal Models in Motion Planning and Control: Evidence from Grip Force Adjustments during Movements of Hand-Held Loads , 1997, The Journal of Neuroscience.

[53]  R. C. Miall,et al.  Multi-joint limbs permit a flexible response to unpredictable events , 1997, Experimental Brain Research.

[54]  Michael I. Jordan,et al.  The Role of Inertial Sensitivity in Motor Planning , 1998, The Journal of Neuroscience.

[55]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[56]  S. Grossberg,et al.  A Cortico-Spinal Model of Reaching and Proprioception under Multiple Task Constraints , 1998, Journal of Cognitive Neuroscience.

[57]  F. Zajac,et al.  Large index-fingertip forces are produced by subject-independent patterns of muscle excitation. , 1998, Journal of biomechanics.

[58]  G. Bock,et al.  Sensory guidance of movement , 1998 .

[59]  M. Latash,et al.  Force sharing among fingers as a model of the redundancy problem , 1998, Experimental Brain Research.

[60]  Michael I. Jordan,et al.  Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. , 1998, Journal of neurophysiology.

[61]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[62]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[63]  J. Kalaska,et al.  Comparison of variability of initial kinematics and endpoints of reaching movements , 1999, Experimental Brain Research.

[64]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[65]  E. Brenner,et al.  A new view on grasping. , 1999, Motor control.

[66]  C. Harris,et al.  The Spectral Main Sequence of Human Saccades , 1999, The Journal of Neuroscience.

[67]  G. E. Loeb,et al.  A hierarchical foundation for models of sensorimotor control , 1999, Experimental Brain Research.

[68]  Y Uno,et al.  Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. , 1999, Journal of neurophysiology.

[69]  D. Hoffman,et al.  Step-tracking movements of the wrist. IV. Muscle activity associated with movements in different directions. , 1999, Journal of neurophysiology.

[70]  R B Stein,et al.  Optimal control of walking with functional electrical stimulation: a computer simulation study. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[71]  D J Ostry,et al.  Compensation for interaction torques during single- and multijoint limb movement. , 1999, Journal of neurophysiology.

[72]  Yury P. Shimansky Spinal motor control system incorporates an internal model of limb dynamics , 2000, Biological Cybernetics.

[73]  Gregor Schöner,et al.  Identifying the control structure of multijoint coordination during pistol shooting , 2000, Experimental Brain Research.

[74]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[75]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[76]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[77]  E. Todorov Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[78]  G E Loeb,et al.  BION system for distributed neural prosthetic interfaces. , 2001, Medical engineering & physics.

[79]  John P. Scholz,et al.  Motor Control Today and Tomorrow , 2001 .

[80]  M. Damsgaard,et al.  Muscle recruitment by the min/max criterion -- a comparative numerical study. , 2001, Journal of biomechanics.

[81]  Chee-Meng Chew,et al.  Virtual Model Control: An Intuitive Approach for Bipedal Locomotion , 2001, Int. J. Robotics Res..

[82]  J. Flanagan,et al.  The Inertial Anisotropy of the Arm Is Accurately Predicted during Movement Planning , 2001, The Journal of Neuroscience.

[83]  Reza Shadmehr,et al.  Learning the dynamics of reaching movements results in the modification of arm impedance and long-latency perturbation responses , 2001, Biological Cybernetics.

[84]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[85]  M. Pandy,et al.  Dynamic optimization of human walking. , 2001, Journal of biomechanical engineering.

[86]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[87]  Auke Jan Ijspeert,et al.  A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander , 2001, Biological Cybernetics.

[88]  Michael S. Lewicki,et al.  Efficient coding of natural sounds , 2002, Nature Neuroscience.

[89]  Ashvin Shah,et al.  A computational model of muscle recruitment for wrist movements. , 2002, Journal of neurophysiology.

[90]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[91]  D. Wolpert,et al.  Controlling the statistics of action: obstacle avoidance. , 2002, Journal of neurophysiology.

[92]  David Zipser,et al.  Reaching to grasp with a multi-jointed arm. I. Computational model. , 2002, Journal of neurophysiology.

[93]  Stephen H. Scott,et al.  Overlap of internal models in motor cortex for mechanical loads during reaching , 2002, Nature.

[94]  Emanuel Todorov,et al.  Cosine Tuning Minimizes Motor Errors , 2002, Neural Computation.

[95]  Korenberg At Computational and psychophysical studies of motor learning. , 2002 .

[96]  Jiping He,et al.  A novel model of motor learning capable of developing an optimal movement control law online from scratch , 2004, Biological Cybernetics.

[97]  F. Lacquaniti,et al.  Temporal components of the motor patterns expressed by the human spinal cord reflect foot kinematics. , 2003, Journal of neurophysiology.

[98]  Marko Bacic,et al.  Model predictive control , 2003 .

[99]  Zoubin Ghahramani,et al.  Unsupervised learning of sensory-motor primitives , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[100]  David J. Ostry,et al.  A critical evaluation of the force control hypothesis in motor control , 2003, Experimental Brain Research.

[101]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[102]  R. Johansson,et al.  Prediction Precedes Control in Motor Learning , 2003, Current Biology.

[103]  Robert A. Jacobs,et al.  A Developmental Approach Aids Motor Learning , 2003, Neural Computation.

[104]  Emanuel Todorov,et al.  Optimal control methods suitable for biomechanical systems , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[105]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[106]  H. Hatze,et al.  Energy-optimal controls in the mammalian neuromuscular system , 1977, Biological Cybernetics.

[107]  James Gordon,et al.  Accuracy of planar reaching movements , 1994, Experimental Brain Research.

[108]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[109]  Emanuel Todorov,et al.  Iterative Linear Quadratic Regulator Design for Nonlinear Biological Movement Systems , 2004, ICINCO.

[110]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[111]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[112]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[113]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[114]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[115]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[116]  Weiwei Li,et al.  Hierarchical optimal control of redundant biomechanical systems , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[117]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.