Looking for synergies between the equilibrium point hypothesis and internal models.

The nervous system needs to control movement of a complex body in a complex world subject to uncertainty due to sensory and motor noise. In this issue, Mark Latash argues in favor of a framework that addresses these problems – the Hierarchical Equilibrium Point Hypothesis (as we call it here, HEPH). According to this hypothesis, movement is created by having a central controller specify a shift in the reference body configuration. This time-varying reference body configuration is passed on to lower level (e.g., limb) controllers, and finally to the lowest level controllers which set the thresholds of the tonic stretch reflex of individual muscles as assumed in the lambda model. In the context of this paper we find it useful to discuss other approaches, in particular approaches that focus on estimation (e.g. Internal models, IMs) and approaches that focus on control given estimations (e.g. Optimal control, OC)1. Specific proposals have been put forward of how the nervous system may implement estimation (neural IM) and proposals of how the nervous system may implement control (neural Control, nC). The EPH is a version of nC which suggests that the motor system simplifies the control problem by centrally adjusting parameters of the spinal proprioceptive feedback. The idea of distributed hierarchical control seems to have emerged in many communities to solve the problem of control complexity. We will briefly review the differences across approaches and highlight possible synergies.

[1]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[2]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[3]  Thomas G. Dietterich Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition , 1999, J. Artif. Intell. Res..

[4]  Iwona Stepniewska,et al.  Microstimulation reveals specialized subregions for different complex movements in posterior parietal cortex of prosimian galagos. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[6]  M. L. Tsetlin,et al.  SOME METHODS OF CONTROL FOR COMPLEX SYSTEMS , 1962 .

[7]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[8]  Geoffrey E. Hinton,et al.  Feudal Reinforcement Learning , 1992, NIPS.

[9]  Richard A Andersen,et al.  Forward estimation of movement state in posterior parietal cortex , 2008, Proceedings of the National Academy of Sciences.

[10]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[11]  W. T. Thach,et al.  Cerebellar ataxia: abnormal control of interaction torques across multiple joints. , 1996, Journal of neurophysiology.

[12]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[13]  A. G. Feldman,et al.  The influence of different descending systems on the tonic stretch reflex in the cat. , 1972, Experimental neurology.

[14]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[15]  D. Wolpert,et al.  Maintaining internal representations: the role of the human superior parietal lobe , 1998, Nature Neuroscience.

[16]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Christian Ethier,et al.  Linear Summation of Cat Motor Cortex Outputs , 2006, The Journal of Neuroscience.

[18]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[19]  M. Graziano,et al.  Complex Movements Evoked by Microstimulation of Precentral Cortex , 2002, Neuron.

[20]  P. Matthews A study of certain factors influencing the stretch reflex of the decerebrate cat , 1959, The Journal of physiology.