Effect of user adaptation on prosthetic finger control with an intuitive myoelectric decoder

Machine learning-based myoelectric control is regarded as an intuitive paradigm, because of the mapping it creates between muscle co-activation patterns and prosthesis movements that aims to simulate the physiological pathways found in the human arm. Despite that, there has been evidence that closed-loop interaction with a classification-based interface results in user adaptation, which leads to performance improvement with experience. Recently, there has been a focus shift towards continuous prosthesis control, yet little is known about whether and how user adaptation affects myoelectric control performance in dexterous, intuitive tasks. We investigate the effect of short-term adaptation with independent finger position control by conducting real-time experiments with 10 able-bodied and two transradial amputee subjects. We demonstrate that despite using an intuitive decoder, experience leads to significant improvements in performance. We argue that this is due to the lack of an utterly natural control scheme, which is mainly caused by differences in the anatomy of human and artificial hands, movement intent decoding inaccuracies, and lack of proprioception. Finally, we extend previous work in classification-based and wrist continuous control by verifying that offline analyses cannot reliably predict real-time performance, thereby reiterating the importance of validating myoelectric control algorithms with real-time experiments.

[1]  E. Glaser The randomized clinical trial. , 1972, The New England journal of medicine.

[2]  P. Herberts,et al.  Hand prosthesis control via myoelectric patterns. , 1973, Acta orthopaedica Scandinavica.

[3]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[4]  Robert F. Kirsch,et al.  Multiple-input, multiple-output system identification for characterization of limb stiffness dynamics , 1999, Biological Cybernetics.

[5]  Alwin Luttmann,et al.  Electromyographical indication of muscular fatigue in occupational field studies , 2000 .

[6]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[7]  Mohammad Hassan Moradi,et al.  Evaluation of the forearm EMG signal features for the control of a prosthetic hand. , 2003, Physiological measurement.

[8]  Pedram Afshar,et al.  Neural-based control of a robotic hand: evidence for distinct muscle strategies , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  Nitish V. Thakor,et al.  Continuous decoding of finger position from surface EMG signals for the control of powered prostheses , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Andrew Jackson,et al.  Learning a Novel Myoelectric-Controlled Interface Task , 2008, Journal of neurophysiology.

[11]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[12]  Nitish V. Thakor,et al.  Real-time myoelectric decoding of individual finger movements for a virtual target task , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Giulio Sandini,et al.  Fine detection of grasp force and posture by amputees via surface electromyography , 2009, Journal of Physiology-Paris.

[14]  C. K. van der Sluis,et al.  Learning to control opening and closing a myoelectric hand. , 2010, Archives of physical medicine and rehabilitation.

[15]  Tjerk P. Straatsma,et al.  NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations , 2010, Comput. Phys. Commun..

[16]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[17]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[18]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  A. Jackson,et al.  Flexible Cortical Control of Task-Specific Muscle Synergies , 2012, The Journal of Neuroscience.

[21]  Nathan E. Bunderson,et al.  Quantification of Feature Space Changes With Experience During Electromyogram Pattern Recognition Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  C. Winstein,et al.  Learning–performance distinction and memory processes for motor skills: A focused review and perspective , 2012, Behavioural Brain Research.

[24]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[25]  B. Rovner,et al.  Randomized clinical trial: a pilot study investigating the safety and effectiveness of an escalating dose of peginterferon &agr;-2a monotherapy for 48 weeks compared with standard clinical care in patients with hepatitis C cirrhosis , 2012, European journal of gastroenterology & hepatology.

[26]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[27]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[28]  Laxmidhar Behera,et al.  Control of an optimal finger exoskeleton based on continuous joint angle estimation from EMG signals , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  T. Kuiken,et al.  Activation of individual extrinsic thumb muscles and compartments of extrinsic finger muscles. , 2013, Journal of neurophysiology.

[30]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Nitish V. Thakor,et al.  User Training for Pattern Recognition-Based Myoelectric Prostheses: Improving Phantom Limb Movement Consistency and Distinguishability , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Panagiotis Artemiadis,et al.  Embedded Human Control of Robots Using Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Ryan Clingman,et al.  A Novel Myoelectric Training Device for Upper Limb Prostheses , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Todd A Kuiken,et al.  Real-time simultaneous and proportional myoelectric control using intramuscular EMG , 2014, Journal of neural engineering.

[37]  Paweł Bartuzi,et al.  Assessment of muscle load and fatigue with the usage of frequency and time-frequency analysis of the EMG signal. , 2014, Acta of bioengineering and biomechanics.

[38]  Barbara Caputo,et al.  Stable myoelectric control of a hand prosthesis using non-linear incremental learning , 2014, Front. Neurorobot..

[39]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[42]  Panagiotis K. Artemiadis,et al.  Proportional Myoelectric Control of Robots: Muscle Synergy Development Drives Performance Enhancement, Retainment, and Generalization , 2015, IEEE Transactions on Robotics.

[43]  Max Ortiz-Catalan,et al.  Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[44]  Todd A. Kuiken,et al.  Extrinsic Finger and Thumb Muscles Command a Virtual Hand to Allow Individual Finger and Grasp Control , 2015, IEEE Transactions on Biomedical Engineering.

[45]  Sethu Vijayakumar,et al.  Towards low-dimensionsal proportional myoelectric control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[46]  Sethu Vijayakumar,et al.  Evaluation of regression methods for the continuous decoding of finger movement from surface EMG and accelerometry , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[47]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  Dario Farina,et al.  High-Density Electromyography and Motor Skill Learning for Robust Long-Term Control of a 7-DoF Robot Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Constantinos Gavriel,et al.  Gaussian Process Autoregression for Simultaneous Proportional Multi-Modal Prosthetic Control With Natural Hand Kinematics , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  Dario Farina,et al.  Translating Research on Myoelectric Control into Clinics—Are the Performance Assessment Methods Adequate? , 2017, Front. Neurorobot..

[51]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[52]  Kianoush Nazarpour,et al.  Abstract myoelectric control with EMG drive estimated using linear, kurtosis and Bayesian filtering , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[53]  T. Kuiken,et al.  Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical Trial , 2017, Scientific Reports.

[54]  Sethu Vijayakumar,et al.  Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements , 2017, Journal of NeuroEngineering and Rehabilitation.

[55]  Marco Santello,et al.  Proof of Concept of an Online EMG-Based Decoding of Hand Postures and Individual Digit Forces for Prosthetic Hand Control , 2017, Front. Neurol..

[56]  Claudio Castellini,et al.  Exploiting Knowledge Composition to Improve Real-Life Hand Prosthetic Control , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  Christopher. Simons,et al.  Machine learning with Python , 2017 .

[58]  Kianoush Nazarpour,et al.  Myoelectric control with abstract decoders , 2018, Journal of neural engineering.

[59]  Raphael Vallat,et al.  Pingouin: statistics in Python , 2018, J. Open Source Softw..