A recurrent neural network model for generation of humanlike reaching movements

ABSTRACT We constructed a recurrent neural network model that can generate human reaching motion. Given a target position, the neural network model is capable of producing muscular activation signals that move the hand to the target endpoint, while solving the problem of musculoskeletal redundancy by dynamic relaxation of the energy functions embedded in the network. The proposed neural network model was integrated with a two-dimensional three-link eight muscle musculoskeletal model of the human arm to simulate arm reaching movements in the horizontal and sagittal planes. Our results demonstrate that the model is capable of generating natural arm movements that have spatiotemporal features, such as a slightly curved hand path and the characteristic bell-shaped velocity profile, that are similar to those of actual human movements. Some aspects of the proposed computational framework might be utilized in the central nervous system for generation of reaching movements. GRAPHICAL ABSTRACT

[1]  R. Suzuki,et al.  Minimum Muscle-Tension Change Trajectories Predicted by Using a 17-Muscle Model of the Monkey's Arm. , 1996, Journal of motor behavior.

[2]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[3]  M L Audu,et al.  A dynamic optimization technique for predicting muscle forces in the swing phase of gait. , 1987, Journal of biomechanics.

[4]  R. Ivry,et al.  The coordination of movement: optimal feedback control and beyond , 2010, Trends in Cognitive Sciences.

[5]  S C Jacobsen,et al.  Quantitation of human shoulder anatomy for prosthetic arm control--I. Surface modelling. , 1989, Journal of biomechanics.

[6]  Makoto Sato,et al.  Learning and generation of goal-directed arm reaching from scratch , 2009, Neural Networks.

[7]  Michael R. Pierrynowski,et al.  A physiological model for the evaluation of muscular forces in human locomotion: theoretical aspects , 1985 .

[8]  P. Morasso.  Spatial control of arm movements , 2004, Experimental Brain Research.

[9]  Zhiwei Luo,et al.  Sensory-motor control mechanism for reaching movements of a redundant musculo-skeletal arm , 2005, J. Field Robotics.

[10]  T. Pozzo,et al.  Trajectories of arm pointing movements on the sagittal plane vary with both direction and speed , 2003, Experimental Brain Research.

[11]  Tadashi Kashima,et al.  Analysis of a muscular control system in human movements , 2000, Biological Cybernetics.

[12]  M. Kawato,et al.  Trajectory formation of arm movement by cascade neural network model based on minimum torque-change criterion , 1990, Biological Cybernetics.

[13]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[14]  Etienne Burdet,et al.  Dissociating Variability and Effort as Determinants of Coordination , 2009, PLoS Comput. Biol..

[15]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[16]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[17]  J. Izawa,et al.  The cerebro-cerebellum: Could it be loci of forward models? , 2016, Neuroscience Research.

[18]  Eizo Miyashita,et al.  Optimal Feedback Control for Predicting Dynamic Stiffness During Arm Movement , 2014, IEEE Transactions on Industrial Electronics.

[19]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  J. A. Pruszynski,et al.  Primate upper limb muscles exhibit activity patterns that differ from their anatomical action during a postural task. , 2006, Journal of neurophysiology.

[21]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[22]  Nobutoshi Yamazaki,et al.  Generation of human bipedal locomotion by a bio-mimetic neuro-musculo-skeletal model , 2001, Biological Cybernetics.

[23]  Yoshiaki Taniai,et al.  Evaluation of Trajectory Planning Models for Arm-Reaching Movements Based on Energy Cost , 2009, Neural Computation.

[24]  I. Toni,et al.  Reference frames for reach planning in human parietofrontal cortex. , 2010, Journal of neurophysiology.

[25]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[26]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[27]  S. Scott,et al.  Characterization of torque-related activity in primary motor cortex during a multijoint postural task. , 2007, Journal of neurophysiology.

[28]  R Happee,et al.  The use of internal representation in fast gold-directed movements: a modeling approach. , 1994, Biological cybernetics.

[29]  Sungho Jo,et al.  A computational neuromusculoskeletal model of human arm movements , 2011 .

[30]  Masaya Hirashima,et al.  How does the brain solve muscle redundancy? Filling the gap between optimization and muscle synergy hypotheses , 2016, Neuroscience Research.

[31]  Toshiyuki Kondo,et al.  Biological arm motion through reinforcement learning , 2004, Biological Cybernetics.

[32]  Emmanuel Guigon,et al.  Computational Motor Control : Redundancy and Invariance , 2007 .

[33]  Reza Shadmehr,et al.  Motor Adaptation as a Process of Reoptimization , 2008, The Journal of Neuroscience.

[34]  Naomichi Ogihara,et al.  Generation of Spontaneous Reaching Movement Based on Human Anatomical Constraints , 2001 .

[35]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[36]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[37]  T. Lillicrap,et al.  Preference Distributions of Primary Motor Cortex Neurons Reflect Control Solutions Optimized for Limb Biomechanics , 2013, Neuron.

[38]  Yoshiaki Taniai,et al.  Optimality of Upper-Arm Reaching Trajectories Based on the Expected Value of the Metabolic Energy Cost , 2015, Neural Computation.

[39]  C. Chandler,et al.  Computers, brains and the control of movement , 1982, Trends in Neurosciences.

[40]  Torsten Bumgarner,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[41]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[42]  S C Jacobsen,et al.  Quantitation of human shoulder anatomy for prosthetic arm control--II. Anatomy matrices. , 1989, Journal of biomechanics.

[43]  R. Andersen,et al.  Dorsal Premotor Neurons Encode the Relative Position of the Hand, Eye, and Goal during Reach Planning , 2006, Neuron.

[44]  V. G. J. Gerdes,et al.  The use of an internal representation in fast goal-directed movements: a modelling approach , 1994, Biological Cybernetics.

[45]  Robert F. Kirsch,et al.  Combined feedforward and feedback control of a redundant, nonlinear, dynamic musculoskeletal system , 2009, Medical & Biological Engineering & Computing.

[46]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  Tetsuo Fukunaga,et al.  Calculation of muscle strength per unit cross-sectional area of human muscle by means of ultrasonic measurement , 1968, Internationale Zeitschrift für angewandte Physiologie einschließlich Arbeitsphysiologie.

[48]  Dominique P. Pioletti,et al.  Computer Methods in Biomechanics and Biomedical Engineering , 2007 .

[49]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[50]  Mitsuo Kawato,et al.  A computational model of four regions of the cerebellum based on feedback-error learning , 2004, Biological Cybernetics.

[51]  J. Fridén,et al.  Human wrist motors: biomechanical design and application to tendon transfers. , 1996, Journal of biomechanics.