Models and architectures for motor control: Simple or complex?

For the purpose of motor coordination, the nervous system faces a complex control problem, involving redundant degrees of freedom, nonlinear dynamics of limbs and actuators, noise, and perturbations. Models and architectures have been proposed to describe motor coordination in terms of computational processes, and identify possible simplifying strategies that would alleviate the workload of the nervous system. Here, we review several strategies ranging from biomechanical to function levels. We conclude that none of the proposed strategies actually tackle the overall problem of motor coordination. Then we present a principled approach that provides an overarching account to motor control.

[1]  Mitsuo Kawato,et al.  Bi-directional theory approach to integration , 1996 .

[2]  J. Krakauer,et al.  Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation , 2007, The Journal of Neuroscience.

[3]  Sascha E Engelbrecht,et al.  The Undershoot Bias , 2003, Psychological science.

[4]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[5]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[6]  Maarten F Bobbert,et al.  Is equilibrium point control feasible for fast goal-directed single-joint movements? , 2006, Journal of neurophysiology.

[7]  Etienne Burdet,et al.  Dissociating Variability and Effort as Determinants of Coordination , 2009, PLoS Comput. Biol..

[8]  N. Hogan,et al.  On rhythmic and discrete movements: reflections, definitions and implications for motor control , 2007, Experimental Brain Research.

[9]  Anatol G. Feldman,et al.  Guiding Movements without Redundancy Problems , 2004 .

[10]  S. Bouisset,et al.  Chronometric analysis of the posturo-kinetic programming of voluntary movement. , 1986, Journal of motor behavior.

[11]  D J Ostry,et al.  Compensation for interaction torques during single- and multijoint limb movement. , 1999, Journal of neurophysiology.

[12]  J. Slotine,et al.  Intrinsic Musculoskeletal Properties Stabilize Wiping Movements in the Spinalized Frog , 2005, The Journal of Neuroscience.

[13]  Gerrit Jan VAN INGEN SCHENAU,et al.  From rotation to translation: Constraints on multi-joint movements and the unique action of bi-articular muscles , 1989 .

[14]  William J Kargo,et al.  Individual Premotor Drive Pulses, Not Time-Varying Synergies, Are the Units of Adjustment for Limb Trajectories Constructed in Spinal Cord , 2008, The Journal of Neuroscience.

[15]  J C Rothwell,et al.  Manual motor performance in a deafferented man. , 1982, Brain : a journal of neurology.

[16]  M. Latash,et al.  Muscle synergies during shifts of the center of pressure by standing persons , 2003, Experimental Brain Research.

[17]  Stefan Schaal,et al.  Dynamics systems vs. optimal control--a unifying view. , 2007, Progress in brain research.

[18]  G. Gottlieb,et al.  Strategies for the control of voluntary movements with one mechanical degree of freedom , 1989, Behavioral and Brain Sciences.

[19]  T. Flash,et al.  The control of hand equilibrium trajectories in multi-joint arm movements , 1987, Biological Cybernetics.

[20]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[21]  G. Schöner Timing, Clocks, and Dynamical Systems , 2002, Brain and Cognition.

[22]  K. Newell Motor skill acquisition. , 1991, Annual review of psychology.

[23]  M. T. Turvey,et al.  Issues in the theory of action : Degree of freedom, coordinative structures and coalitions , 1978 .

[24]  P. Soueres,et al.  A principled approach to biological motor control for generating humanoid robot reaching movements , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[25]  P. Morasso,et al.  Can muscle stiffness alone stabilize upright standing? , 1999, Journal of neurophysiology.

[26]  J. Massion Movement, posture and equilibrium: Interaction and coordination , 1992, Progress in Neurobiology.

[27]  K. J. Cole,et al.  Control of multimovement coordination: sensorimotor mechanisms in speech motor programming. , 1984, Journal of motor behavior.

[28]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[29]  James C. Houk,et al.  Neural Control of Muscle Length and Tension , 2011 .

[30]  J. Macpherson,et al.  Automatic postural responses in the cat: Responses to headward and tailward translation , 2004, Experimental Brain Research.

[31]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[32]  Leonard A. Rozendaal,et al.  The inverted pendulum model of bipedal standing cannot be stabilized through direct feedback of force and contractile element length and velocity at realistic series elastic element stiffness , 2008, Biological Cybernetics.

[33]  A. V. van Soest,et al.  Equilibrium point control cannot be refuted by experimental reconstruction of equilibrium point trajectories. , 2007, Journal of neurophysiology.

[34]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[35]  Ferdinando A. Mussa-Ivaldi,et al.  Stability constraints for the distributed control of motor behavior , 1993, Neural Networks.

[36]  S. A. Wallace,et al.  An impulse-timing theory for reciprocal control of muscular activity in rapid, discrete movements. , 1981, Journal of motor behavior.

[37]  D J Ostry,et al.  Are complex control signals required for human arm movement? , 1998, Journal of neurophysiology.

[38]  Douglas Tweed,et al.  Sensorimotor optimization in higher dimensions. , 2007, Progress in brain research.

[39]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[40]  M. Latash,et al.  The relation between posture and movement: A study of a simple synergy in a two-joint task , 1995 .

[41]  Armin Biess,et al.  A Computational Model for Redundant Human Three-Dimensional Pointing Movements: Integration of Independent Spatial and Temporal Motor Plans Simplifies Movement Dynamics , 2007, The Journal of Neuroscience.

[42]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[43]  Chandana Paul,et al.  The Tendon Network of the Fingers Performs Anatomical Computation at a Macroscopic Scale , 2007, IEEE Transactions on Biomedical Engineering.

[44]  H. Inooka,et al.  Experimental studies of manual optimization in control tasks , 1990, IEEE Control Systems Magazine.

[45]  V. Hatzitaki,et al.  Effect of single-limb inertial loading on bilateral reaching: Interlimb interactions , 2001, Experimental Brain Research.

[46]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[47]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[48]  M. Tresch,et al.  The case for and against muscle synergies , 2022 .

[49]  Shuuji Kajita,et al.  Legged Robots , 2008, Springer Handbook of Robotics.

[50]  Weiwei Li Optimal control for biological movement systems , 2006 .

[51]  R. McN. Alexander,et al.  A minimum energy cost hypothesis for human arm trajectories , 1997, Biological Cybernetics.

[52]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[53]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[54]  Emmanuel Guigon,et al.  Optimality, stochasticity, and variability in motor behavior , 2008, Journal of Computational Neuroscience.

[55]  J. Kalaska,et al.  Sequential activation of muscle synergies during locomotion in the intact cat as revealed by cluster analysis and direct decomposition. , 2006, Journal of neurophysiology.

[56]  Robert A Jacobs,et al.  Near-Optimal Human Adaptive Control across Different Noise Environments , 2006, The Journal of Neuroscience.

[57]  M. Desmurget,et al.  Computational motor control: feedback and accuracy , 2008, The European journal of neuroscience.

[58]  M. Flanders,et al.  Timing of muscle activation in a hand movement sequence. , 2006, Cerebral cortex.

[59]  S. Schaal,et al.  Rhythmic arm movement is not discrete , 2004, Nature Neuroscience.

[60]  Emmanuel Guigon,et al.  Computational Motor Control : Redundancy and Invariance , 2007 .

[61]  Richard A Satterlie,et al.  Neuromechanics: an integrative approach for understanding motor control. , 2007, Integrative and comparative biology.

[62]  Jean-Paul Laumond,et al.  An Optimality Principle Governing Human Walking , 2008, IEEE Transactions on Robotics.

[63]  M. Flanders,et al.  Force path curvature and conserved features of muscle activation , 1996, Experimental Brain Research.

[64]  E. J. Vrijenhoek,et al.  Arm position constraints during pointing and reaching in 3-D space. , 1997, Journal of neurophysiology.

[65]  Mark L. Latash,et al.  Velocity-dependent activation of postural muscles in a simple two-joint synergy , 1995 .

[66]  S. Sahrmann,et al.  Postural synergies associated with a stepping task. , 1999, Physical therapy.

[67]  F. Lacquaniti,et al.  Temporal components of the motor patterns expressed by the human spinal cord reflect foot kinematics. , 2003, Journal of neurophysiology.

[68]  R. Full,et al.  The role of the mechanical system in control: a hypothesis of self-stabilization in hexapedal runners , 1999 .

[69]  L. Optican,et al.  Commutative saccadic generator is sufficient to control a 3-D ocular plant with pulleys. , 1998, Journal of neurophysiology.

[70]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[71]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[72]  R. J. van Beers,et al.  The role of execution noise in movement variability. , 2004, Journal of neurophysiology.

[73]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[74]  Lena H Ting,et al.  A limited set of muscle synergies for force control during a postural task. , 2005, Journal of neurophysiology.

[75]  Agnes M F Wong,et al.  Listing's law: clinical significance and implications for neural control. , 2004, Survey of ophthalmology.

[76]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[77]  H. Freund,et al.  The relationship between speed and amplitude of the fastest voluntary contractions of human arm muscles , 1978, Experimental Brain Research.

[78]  Ian E. Brown,et al.  A Reductionist Approach to Creating and Using Neuromusculoskeletal Models , 2000 .

[79]  Emmanuel Guigon,et al.  Coding of movement‐ and force‐related information in primate primary motor cortex: a computational approach , 2007, The European journal of neuroscience.

[80]  L. Nashner,et al.  The organization of human postural movements: A formal basis and experimental synthesis , 1985, Behavioral and Brain Sciences.

[81]  P. Morasso,et al.  Direct measurement of ankle stiffness during quiet standing: implications for control modelling and clinical application. , 2005, Gait & posture.

[82]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[83]  George M. Siouris,et al.  Applied Optimal Control: Optimization, Estimation, and Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[84]  P. Morasso,et al.  Body sway during quiet standing: is it the residual chattering of an intermittent stabilization process? , 2005, Human movement science.

[85]  Christopher A. Buneo,et al.  On the form of the internal model for reaching , 2004, Experimental Brain Research.

[86]  David J. Ostry,et al.  Compensation for loads during arm movements using equilibrium-point control , 2000, Experimental Brain Research.

[87]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[88]  Emanuel V. Todrov Studies of goal directed movements , 1998 .

[89]  Ferdinando A. Mussa-Ivaldi,et al.  Nonlinear force fields: a distributed system of control primitives for representing and learning movements , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[90]  L. Ting,et al.  Muscle synergies characterizing human postural responses. , 2007, Journal of neurophysiology.

[91]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[92]  Alexander Rm,et al.  A minimum energy cost hypothesis for human arm trajectories. , 1997 .

[93]  C Ghez,et al.  Roles of proprioceptive input in the programming of arm trajectories. , 1990, Cold Spring Harbor symposia on quantitative biology.

[94]  R. Stengel Stochastic Optimal Control: Theory and Application , 1986 .

[95]  E. Bizzi,et al.  New perspectives on spinal motor systems , 2000, Nature Reviews Neuroscience.

[96]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[97]  Tim Kiemel,et al.  Multisensory fusion and the stochastic structure of postural sway , 2002, Biological Cybernetics.

[98]  Simon A. Overduin,et al.  Modulation of Muscle Synergy Recruitment in Primate Grasping , 2008, The Journal of Neuroscience.

[99]  M. Hepp-Reymond,et al.  EMG activation patterns during force production in precision grip , 2004, Experimental Brain Research.

[100]  Juan Pablo Fernández,et al.  Invariant characteristics of horizontal-plane minimum-torque-change movements with one mechanical degree of freedom , 1997, Biological Cybernetics.

[101]  Raffaello D'Andrea,et al.  Visuomotor Optimality and its Utility in Parametrization of Response , 2008, IEEE Transactions on Biomedical Engineering.

[102]  A. G. Feldman,et al.  The origin and use of positional frames of reference in motor control , 1995, Behavioral and Brain Sciences.

[103]  Joseph L Demer,et al.  Current concepts of mechanical and neural factors in ocular motility , 2006, Current opinion in neurology.

[104]  F. Lacquaniti,et al.  An assessment of the existence of muscle synergies during load perturbations and intentional movements of the human arm , 2004, Experimental Brain Research.

[105]  Ian David Loram,et al.  Direct measurement of human ankle stiffness during quiet standing: the intrinsic mechanical stiffness is insufficient for stability , 2002, The Journal of physiology.

[106]  Reza Shadmehr,et al.  Motor Adaptation as a Process of Reoptimization , 2008, The Journal of Neuroscience.

[107]  L. Nashner,et al.  Human automatic postural responses: responses to horizontal perturbations of stance in multiple directions , 2004, Experimental Brain Research.

[108]  Lena H Ting,et al.  Muscle synergy organization is robust across a variety of postural perturbations. , 2006, Journal of neurophysiology.

[109]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[110]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[111]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[112]  M. Lemay,et al.  Modularity of motor output evoked by intraspinal microstimulation in cats. , 2004, Journal of neurophysiology.

[113]  Viktor K. Jirsa,et al.  Distinct Timing Mechanisms Produce Discrete and Continuous Movements , 2008, PLoS Comput. Biol..

[114]  David J. Ostry,et al.  A critical evaluation of the force control hypothesis in motor control , 2003, Experimental Brain Research.

[115]  P. Morasso,et al.  Ankle muscle stiffness alone cannot stabilize balance during quiet standing. , 2002, Journal of neurophysiology.

[116]  A. G. Feldman,et al.  Control processes underlying elbow flexion movements may be independent of kinematic and electromyographic patterns: experimental study and modelling , 1997, Neuroscience.

[117]  David Zipser,et al.  Reaching to grasp with a multi-jointed arm. I. Computational model. , 2002, Journal of neurophysiology.

[118]  J. Flanagan,et al.  The Inertial Anisotropy of the Arm Is Accurately Predicted during Movement Planning , 2001, The Journal of Neuroscience.

[119]  J. Frank,et al.  Coordination of posture and movement. , 1990, Physical therapy.

[120]  J A Kelso,et al.  Dynamic pattern generation in behavioral and neural systems. , 1988, Science.

[121]  Gregor Schöner,et al.  Toward a new theory of motor synergies. , 2007, Motor control.

[122]  Emanuel Todorov,et al.  Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control , 2007, The Journal of Neuroscience.

[123]  Trevor Drew,et al.  Strategies for the integration of posture and movement during reaching in the cat. , 2003, Journal of neurophysiology.

[124]  O. Bock Load compensation in human goal-directed arm movements , 1990, Behavioural Brain Research.

[125]  Y. Lamarre,et al.  Rapid elbow flexion in the absence of proprioceptive and cutaneous feedback. , 1987, Human neurobiology.

[126]  D. Winter,et al.  Stiffness control of balance in quiet standing. , 1998, Journal of neurophysiology.

[127]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[128]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[129]  B. Vereijken,et al.  Free(z)ing Degrees of Freedom in Skill Acquisition , 1992 .

[130]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[131]  Wynne A. Lee,et al.  Neuromotor synergies as a basis for coordinated intentional action. , 1984, Journal of motor behavior.

[132]  J M Macpherson,et al.  Strategies that simplify the control of quadrupedal stance. II. Electromyographic activity. , 1988, Journal of neurophysiology.

[133]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[134]  M. Graziano,et al.  Complex Movements Evoked by Microstimulation of Precentral Cortex , 2002, Neuron.

[135]  Randall D. Beer,et al.  Biological Neural Networks in Invertebrate Neuroethology and Robotics. Editors: Randall D. Beer, Roy E. Ritzmann, Thomas McKenna (Academic Press, Inc., Harcourt Brace Jovanovich, 1993) , 1996, SGAR.

[136]  J. Frank,et al.  Influence of event anticipation on postural actions accompanying voluntary movement , 2004, Experimental Brain Research.

[137]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[138]  Michael A. Arbib,et al.  A mathematical analysis of the force-stiffness characteristics of muscles in control of a single joint system , 1992, Biological Cybernetics.

[139]  R. Full,et al.  Dynamic stabilization of rapid hexapedal locomotion. , 2002, The Journal of experimental biology.

[140]  Dora E Angelaki,et al.  Control of eye orientation: where does the brain's role end and the muscle's begin? , 2004, The European journal of neuroscience.

[141]  G. Schöner Recent Developments and Problems in Human Movement Science and Their Conceptual Implications , 1995 .

[142]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[143]  J. Flanagan,et al.  Control of Trajectory Modifications in Target-Directed Reaching. , 1993, Journal of motor behavior.

[144]  M. Hallett,et al.  EMG analysis of stereotyped voluntary movements in man. , 1975, Journal of neurology, neurosurgery, and psychiatry.

[145]  G. Schöner,et al.  A dynamic theory of coordination of discrete movement , 1990, Biological Cybernetics.

[146]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[147]  T. Flash,et al.  Arm Trajectory Modifications During Reaching Towards Visual Targets , 1991, Journal of Cognitive Neuroscience.