Effect of User Practice on Prosthetic Finger Control With an Intuitive Myoelectric Decoder

Machine learning-based myoelectric control is regarded as an intuitive paradigm, because of the mapping it creates between muscle co-activation patterns and prosthesis movements that aims to simulate the physiological pathways found in the human arm. Despite that, there has been evidence that closed-loop interaction with a classification-based interface results in user adaptation, which leads to performance improvement with experience. Recently, there has been a focus shift toward continuous prosthesis control, yet little is known about whether and how user adaptation affects myoelectric control performance in dexterous, intuitive tasks. We investigate the effect of short-term adaptation with independent finger position control by conducting real-time experiments with 10 able-bodied and two transradial amputee subjects. We demonstrate that despite using an intuitive decoder, experience leads to significant improvements in performance. We argue that this is due to the lack of an utterly natural control scheme, which is mainly caused by differences in the anatomy of human and artificial hands, movement intent decoding inaccuracies, and lack of proprioception. Finally, we extend previous work in classification-based and wrist continuous control by verifying that offline analyses cannot reliably predict real-time performance, thereby reiterating the importance of validating myoelectric control algorithms with real-time experiments.

[1]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Mohammad Hassan Moradi,et al.  Evaluation of the forearm EMG signal features for the control of a prosthetic hand. , 2003, Physiological measurement.

[3]  Sethu Vijayakumar,et al.  Evaluation of regression methods for the continuous decoding of finger movement from surface EMG and accelerometry , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[4]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[5]  Kianoush Nazarpour,et al.  Myoelectric control with abstract decoders , 2018, Journal of neural engineering.

[6]  C. Winstein,et al.  Learning–performance distinction and memory processes for motor skills: A focused review and perspective , 2012, Behavioural Brain Research.

[7]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[8]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[9]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Constantinos Gavriel,et al.  Gaussian Process Autoregression for Simultaneous Proportional Multi-Modal Prosthetic Control With Natural Hand Kinematics , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  T. Kuiken,et al.  Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical Trial , 2017, Scientific Reports.

[13]  Dario Farina,et al.  Translating Research on Myoelectric Control into Clinics—Are the Performance Assessment Methods Adequate? , 2017, Front. Neurorobot..

[14]  Sethu Vijayakumar,et al.  Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements , 2017, Journal of NeuroEngineering and Rehabilitation.

[15]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[18]  Todd A Kuiken,et al.  Real-time simultaneous and proportional myoelectric control using intramuscular EMG , 2014, Journal of neural engineering.

[19]  Marco Santello,et al.  Proof of Concept of an Online EMG-Based Decoding of Hand Postures and Individual Digit Forces for Prosthetic Hand Control , 2017, Front. Neurol..

[20]  Barbara Caputo,et al.  Stable myoelectric control of a hand prosthesis using non-linear incremental learning , 2014, Front. Neurorobot..

[21]  Nitish V. Thakor,et al.  Continuous decoding of finger position from surface EMG signals for the control of powered prostheses , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Giulio Sandini,et al.  Fine detection of grasp force and posture by amputees via surface electromyography , 2009, Journal of Physiology-Paris.

[23]  Dario Farina,et al.  High-Density Electromyography and Motor Skill Learning for Robust Long-Term Control of a 7-DoF Robot Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[25]  Robert F. Kirsch,et al.  Multiple-input, multiple-output system identification for characterization of limb stiffness dynamics , 1999, Biological Cybernetics.

[26]  Sethu Vijayakumar,et al.  Towards low-dimensionsal proportional myoelectric control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Andrew Jackson,et al.  Learning a Novel Myoelectric-Controlled Interface Task , 2008, Journal of neurophysiology.

[28]  Pedram Afshar,et al.  Neural-based control of a robotic hand: evidence for distinct muscle strategies , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[29]  P. Herberts,et al.  Hand prosthesis control via myoelectric patterns. , 1973, Acta orthopaedica Scandinavica.

[30]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[32]  Claudio Castellini,et al.  Exploiting Knowledge Composition to Improve Real-Life Hand Prosthetic Control , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Raphael Vallat,et al.  Pingouin: statistics in Python , 2018, J. Open Source Softw..

[34]  Panagiotis K. Artemiadis,et al.  Proportional Myoelectric Control of Robots: Muscle Synergy Development Drives Performance Enhancement, Retainment, and Generalization , 2015, IEEE Transactions on Robotics.

[35]  A. Jackson,et al.  Flexible Cortical Control of Task-Specific Muscle Synergies , 2012, The Journal of Neuroscience.

[36]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[37]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[39]  Todd A. Kuiken,et al.  Extrinsic Finger and Thumb Muscles Command a Virtual Hand to Allow Individual Finger and Grasp Control , 2015, IEEE Transactions on Biomedical Engineering.

[40]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Nitish V. Thakor,et al.  Real-time myoelectric decoding of individual finger movements for a virtual target task , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Kianoush Nazarpour,et al.  Abstract myoelectric control with EMG drive estimated using linear, kurtosis and Bayesian filtering , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[43]  Nathan E. Bunderson,et al.  Quantification of Feature Space Changes With Experience During Electromyogram Pattern Recognition Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[45]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[46]  T. Kuiken,et al.  Activation of individual extrinsic thumb muscles and compartments of extrinsic finger muscles. , 2013, Journal of neurophysiology.

[47]  Panagiotis Artemiadis,et al.  Embedded Human Control of Robots Using Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  Ryan Clingman,et al.  A Novel Myoelectric Training Device for Upper Limb Prostheses , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Paweł Bartuzi,et al.  Assessment of muscle load and fatigue with the usage of frequency and time-frequency analysis of the EMG signal. , 2014, Acta of bioengineering and biomechanics.

[50]  C. K. van der Sluis,et al.  Learning to control opening and closing a myoelectric hand. , 2010, Archives of physical medicine and rehabilitation.

[51]  Nitish V. Thakor,et al.  User Training for Pattern Recognition-Based Myoelectric Prostheses: Improving Phantom Limb Movement Consistency and Distinguishability , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Max Ortiz-Catalan,et al.  Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[53]  Alwin Luttmann,et al.  Electromyographical indication of muscular fatigue in occupational field studies , 2000 .

[54]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[56]  Laxmidhar Behera,et al.  Control of an optimal finger exoskeleton based on continuous joint angle estimation from EMG signals , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).