Characterizing and Predicting Submovements during Human Three-Dimensional Arm Reaches

We have demonstrated that 3D target-oriented human arm reaches can be represented as linear combinations of discrete submovements, where the submovements are a set of minimum-jerk basis functions for the reaches. We have also demonstrated the ability of deterministic feed-forward Artificial Neural Networks (ANNs) to predict the parameters of the submovements. ANNs were trained using kinematic data obtained experimentally from five human participants making target-directed movements that were decomposed offline into minimum-jerk submovements using an optimization algorithm. Under cross-validation, the ANNs were able to accurately predict the parameters (initiation-time, amplitude, and duration) of the individual submovements. We also demonstrated that the ANNs can together form a closed-loop model of human reaching capable of predicting 3D trajectories with VAF >95.9% and RMSE ≤4.32 cm relative to the actual recorded trajectories. This closed-loop model is a step towards a practical arm trajectory generator based on submovements, and should be useful for the development of future arm prosthetic devices that are controlled by brain computer interfaces or other user interfaces.

[1]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[2]  Deric Wisleder,et al.  Influence of biomechanical factors on substructure of pointing movements , 2005, Experimental Brain Research.

[3]  Robert F. Kirsch,et al.  Predicting the initiation of minimum-jerk submovements in three-dimensional target-oriented human arm trajectories , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Sigal Berman,et al.  Application of motor algebra to the analysis of human arm movements , 2008, Robotica.

[5]  D. Elliott,et al.  Visual regulation of manual aiming , 1993 .

[6]  Kikuro Fukushima,et al.  Submovement Composition of Head Movement , 2012, PloS one.

[7]  Shigeyuki Hosoe,et al.  Analysis of Variability of Human Reaching Movements Based on the Similarity Preservation of Arm Trajectories , 2007, ICONIP.

[8]  J. Friedman,et al.  The Flexibility of Nonconsciously Deployed Cognitive Processes: Evidence from Masked Congruence Priming , 2011, PloS one.

[9]  Jason Friedman,et al.  Temporal dynamics of masked congruence priming: evidence from reaching trajectories , 2010, Proceedings of the 9th Conference of the Australasian Society for Cognitive Science.

[10]  James L. Lyons,et al.  Goal-directed aiming: two components but multiple processes. , 2010, Psychological bulletin.

[11]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[12]  R. McN. Alexander,et al.  A minimum energy cost hypothesis for human arm trajectories , 1997, Biological Cybernetics.

[13]  David E. Meyer,et al.  Speed—Accuracy Tradeoffs in Aimed Movements: Toward a Theory of Rapid Voluntary Action , 2018, Attention and Performance XIII.

[14]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[15]  E. R. Crossman,et al.  Feedback Control of Hand-Movement and Fitts' Law , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[16]  C J Worringham,et al.  Variability effects on the internal structure of rapid aiming movements. , 1991, Journal of motor behavior.

[17]  N. Hogan,et al.  Submovement changes characterize generalization of motor recovery after stroke , 2009, Cortex.

[18]  Deric Wisleder,et al.  The role of different submovement types during pointing to a target , 2006, Experimental Brain Research.

[19]  T. Milner,et al.  The effect of accuracy constraints on three-dimensional movement kinematics , 1990, Neuroscience.

[20]  K. E. Novak,et al.  The use of overlapping submovements in the control of rapid hand movements , 2002, Experimental Brain Research.

[21]  Yury P. Shimansky,et al.  Two-phase strategy of neural control for planar reaching movements: II—relation to spatiotemporal characteristics of movement trajectory , 2013, Experimental Brain Research.

[22]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[23]  James C. Houk,et al.  Basal ganglia contribution to the initiation of corrective submovements , 2009, NeuroImage.

[24]  Neville Hogan,et al.  Avoiding Spurious Submovement Decompositions II: A Scattershot Algorithm , 2006, Biological Cybernetics.

[25]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[26]  Y. Amit,et al.  Synthesizing complex movement fragment representations from motor cortical ensembles , 2012, Journal of Physiology-Paris.

[27]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[28]  T. Milner,et al.  A model for the generation of movements requiring endpoint precision , 1992, Neuroscience.

[29]  Etienne Burdet,et al.  Quantization of human motions and learning of accurate movements , 1998, Biological Cybernetics.

[30]  Alexander Rm,et al.  A minimum energy cost hypothesis for human arm trajectories. , 1997 .

[31]  G. Fullerton Psychology and physiology. , 1896 .

[32]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Romeo Chua,et al.  Discrete vs. continuous visual control of manual aiming , 1991 .

[34]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[35]  Gregory A Apker,et al.  Contribution of execution noise to arm movement variability in three-dimensional space. , 2012, Journal of neurophysiology.

[36]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[37]  T. Flash,et al.  Arm Trajectory Modifications During Reaching Towards Visual Targets , 1991, Journal of Cognitive Neuroscience.

[38]  Hermano Igo Krebs,et al.  Spatiotemporal Dynamics of Online Motor Correction Processing Revealed by High-density Electroencephalography , 2014, Journal of Cognitive Neuroscience.

[39]  J C Houk,et al.  Action selection and refinement in subcortical loops through basal ganglia and cerebellum , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[40]  R. J. van Beers,et al.  The role of execution noise in movement variability. , 2004, Journal of neurophysiology.

[41]  Gregory A Apker,et al.  Interacting noise sources shape patterns of arm movement variability in three-dimensional space. , 2010, Journal of neurophysiology.

[42]  David E. Irwin,et al.  Finding a "Kneedle" in a Haystack: Detecting Knee Points in System Behavior , 2011, 2011 31st International Conference on Distributed Computing Systems Workshops.

[43]  N. Hogan,et al.  Submovements grow larger, fewer, and more blended during stroke recovery. , 2003, Motor control.

[44]  Daeyeol Lee,et al.  Manual interception of moving targets II. On-line control of overlapping submovements , 1997, Experimental Brain Research.

[45]  Natalia Dounskaia,et al.  Origins of submovements during pointing movements. , 2008, Acta psychologica.

[46]  R. Kirsch,et al.  Standard task set for evaluating rehabilitation interventions for individuals with arm paralysis. , 2012, Journal of rehabilitation research and development.

[47]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[48]  Steve Hansen,et al.  Optimizing rapid aiming behaviour: movement kinematics depend on the cost of corrective modifications , 2006, Experimental Brain Research.

[49]  J. Houk,et al.  Deciding when and how to correct a movement: discrete submovements as a decision making process , 2007, Experimental Brain Research.

[50]  N. Berthier Learning to reach: A mathematical model. , 1996 .

[51]  Yury P. Shimansky,et al.  Two-phase strategy of neural control for planar reaching movements: I. XY coordination variability and its relation to end-point variability , 2012, Experimental Brain Research.

[52]  Scott T. Grafton,et al.  Human Basal Ganglia and the Dynamic Control of Force during On-Line Corrections , 2011, The Journal of Neuroscience.

[53]  Réjean Plamondon,et al.  Modelling velocity profiles of rapid movements: a comparative study , 1993, Biological Cybernetics.

[54]  P. Morasso,et al.  Trajectory formation and handwriting: A computational model , 1982, Biological Cybernetics.

[55]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[56]  Spectrum of Contraction Times of Different Fibre Bundles in the Brachial Biceps and Triceps Muscles of Man , 1969, Nature.