Learning, Generalization, and Scalability of Abstract Myoelectric Control

Motor learning-based methods offer an alternative paradigm to machine learning-based methods for controlling upper-limb prosthetics. Within this paradigm, the patterns of muscular activity used for control can differ from those which control biological limbs. Practice expedites the learning of these new, functional patterns of muscular activity. We envisage that these methods can result in enhanced control without increasing device complexity. However, key questions about training protocols, generalisation and scalability of motor learning-based methods have remained. In this work, we pursue three objectives: 1) to validate the motor learning-based abstract myoelectric control approach with people with upper-limb difference for the first time; 2) to test whether, after training, participants can generalize their learning to tasks of increased difficulty; and 3) to show that abstract myoelectric control scales with additional input signals, offering a larger control range. In three experiments, 25 limb-intact participants and 8 people with a limb difference (congenital and acquired) experienced a motor learning-based myoelectric controlled interface. We show that participants with upper-limb difference can learn to control the interface and that performance increases with experience. Across experiments, participant performance on easier lower target density tasks generalized to more difficult higher target density tasks. A proof-of-concept study demonstrates that learning-based control scales with additional myoelectric channels. Our results show that human motor learning-based approaches can enhance the number of distinct outputs from the musculature, thereby increasing the functionality of prosthetic hands and providing a viable alternative to machine learning.

[1]  Ashok Muzumdar Powered upper limb prostheses : control, implementation and clinical application , 2004 .

[2]  Kianoush Nazarpour,et al.  Real-time estimation and biofeedback of single-neuron firing rates using local field potentials , 2014, Nature Communications.

[3]  Robert D. Lipschutz,et al.  The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee , 2004, Prosthetics and orthotics international.

[4]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[5]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Max Ortiz-Catalan,et al.  Real-Time and Simultaneous Control of Artificial Limbs Based on Pattern Recognition Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[8]  Kianoush Nazarpour,et al.  Data Driven Spatial Filtering Can Enhance Abstract Myoelectric Control in Amputees , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Maura Casadio,et al.  Sensory motor remapping of space in human-machine interfaces. , 2011, Progress in brain research.

[10]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[11]  Lucas C. Parra,et al.  Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Xiaolin Liu,et al.  Contributions of online visual feedback to the learning and generalization of novel finger coordination patterns. , 2008, Journal of neurophysiology.

[13]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[14]  Kianoush Nazarpour,et al.  Myoelectric control with abstract decoders , 2018, Journal of neural engineering.

[15]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[16]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[17]  S. Meagher Instant neural control of a movement signal , 2002 .

[18]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[19]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[20]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[21]  Alessio Murgia,et al.  The Effect of Feedback During Training Sessions on Learning Pattern-Recognition-Based Prosthesis Control , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Andrew Jackson,et al.  Learning a Novel Myoelectric-Controlled Interface Task , 2008, Journal of neurophysiology.

[23]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[24]  Dario Farina,et al.  Simultaneous control of multiple functions of bionic hand prostheses: Performance and robustness in end users , 2018, Science Robotics.

[25]  J. Carmena Advances in Neuroprosthetic Learning and Control , 2013, PLoS biology.

[26]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[27]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Jacob L. Segil,et al.  A Myoelectric Postural Control Algorithm for Persons With Transradial Amputations: A Consideration of Clinical Readiness , 2020, IEEE Robotics & Automation Magazine.

[29]  A. Jackson,et al.  Flexible Cortical Control of Task-Specific Muscle Synergies , 2012, The Journal of Neuroscience.

[30]  Hanneke Bouwsema,et al.  Changes in performance over time while learning to use a myoelectric prosthesis , 2012, Journal of NeuroEngineering and Rehabilitation.

[31]  Christian Cipriani,et al.  Real-time myoelectric control of a multi-fingered hand prosthesis using principal components analysis , 2012, Journal of NeuroEngineering and Rehabilitation.

[32]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[33]  Maura Casadio,et al.  Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. , 2011, Journal of neurophysiology.

[34]  J. M. Walker,et al.  Prosthetics , 1894, The American journal of dental science.

[35]  Pierre-Yves Oudeyer,et al.  Model and experiments to optimize co-adaptation in a simplified myoelectric control system , 2018, Journal of neural engineering.

[36]  G. Hefftner,et al.  The electromyogram (EMG) as a control signal for functional neuromuscular stimulation. II. Practical demonstration of the EMG signature discrimination system , 1988, IEEE Transactions on Biomedical Engineering.

[37]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[39]  Dragan F. Dimitrov,et al.  Reversible large-scale modification of cortical networks during neuroprosthetic control , 2011, Nature Neuroscience.

[40]  T. Kuiken,et al.  Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical Trial , 2017, Scientific Reports.

[41]  Steven M Chase,et al.  Distinct types of neural reorganization during long-term learning. , 2019, Journal of neurophysiology.

[42]  Panagiotis Artemiadis,et al.  Embedded Human Control of Robots Using Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Jacob L Segil,et al.  Novel postural control algorithm for control of multifunctional myoelectric prosthetic hands. , 2015, Journal of rehabilitation research and development.

[44]  Egbert Otten,et al.  Performance among different types of myocontrolled tasks is not related. , 2020, Human movement science.

[45]  Panagiotis K. Artemiadis,et al.  Proportional Myoelectric Control of Robots: Muscle Synergy Development Drives Performance Enhancement, Retainment, and Generalization , 2015, IEEE Transactions on Robotics.

[46]  H. V. D. Van der Loos,et al.  Video Games and Rehabilitation: Using Design Principles to Enhance Engagement in Physical Therapy , 2013, Journal of neurologic physical therapy : JNPT.

[47]  Peter J. Kyberd,et al.  MARCUS: a two degree of freedom hand prosthesis with hierarchical grip control , 1995 .

[48]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[49]  Ferdinando A Mussa-Ivaldi,et al.  Remapping hand movements in a novel geometrical environment. , 2005, Journal of neurophysiology.