Real-Time EMG Based Pattern Recognition Control for Hand Prostheses: A Review on Existing Methods, Challenges and Future Implementation

Upper limb amputation is a condition that significantly restricts the amputees from performing their daily activities. The myoelectric prosthesis, using signals from residual stump muscles, is aimed at restoring the function of such lost limbs seamlessly. Unfortunately, the acquisition and use of such myosignals are cumbersome and complicated. Furthermore, once acquired, it usually requires heavy computational power to turn it into a user control signal. Its transition to a practical prosthesis solution is still being challenged by various factors particularly those related to the fact that each amputee has different mobility, muscle contraction forces, limb positional variations and electrode placements. Thus, a solution that can adapt or otherwise tailor itself to each individual is required for maximum utility across amputees. Modified machine learning schemes for pattern recognition have the potential to significantly reduce the factors (movement of users and contraction of the muscle) affecting the traditional electromyography (EMG)-pattern recognition methods. Although recent developments of intelligent pattern recognition techniques could discriminate multiple degrees of freedom with high-level accuracy, their efficiency level was less accessible and revealed in real-world (amputee) applications. This review paper examined the suitability of upper limb prosthesis (ULP) inventions in the healthcare sector from their technical control perspective. More focus was given to the review of real-world applications and the use of pattern recognition control on amputees. We first reviewed the overall structure of pattern recognition schemes for myo-control prosthetic systems and then discussed their real-time use on amputee upper limbs. Finally, we concluded the paper with a discussion of the existing challenges and future research recommendations.

[1]  P. Bifulco,et al.  A stretchable, conductive rubber sensor to detect muscle contraction for prosthetic hand control , 2017, 2017 E-Health and Bioengineering Conference (EHB).

[2]  Jun Ishikawa,et al.  Experimental Study of Real-Time Classification of 17 Voluntary Movements for Multi-Degree Myoelectric Prosthetic Hand , 2017 .

[3]  M. J. Highsmith,et al.  Differences in myoelectric and body-powered upper-limb prostheses: Systematic literature review. , 2015, Journal of rehabilitation research and development.

[4]  Robert M. Haralick,et al.  Prosthesis Control Using a Nearest Neighbor Electromyographic Pattern Classifier , 1983, IEEE Transactions on Biomedical Engineering.

[5]  Changmok Choi,et al.  A Real-time EMG-based Assistive Computer Interface for the Upper Limb Disabled , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[6]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[7]  Taylor Dr,et al.  Pattern-recognition arm prosthesis: a historical perspective-a final report. , 1978 .

[8]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[9]  K. Bergman,et al.  Functional benefit of an adaptive myoelectric prosthetic hand compared to a conventional myoelectric hand , 1992, Prosthetics and orthotics international.

[10]  Erin Strait,et al.  Prosthetics in Developing Countries , 2006 .

[11]  Enzo Mastinu,et al.  An Alternative Myoelectric Pattern Recognition Approach for the Control of Hand Prostheses: A Case Study of Use in Daily Life by a Dysmelia Subject , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[12]  Gazzoni Marco,et al.  Surface EMG and muscle fatigue: multi-channel approaches to the study of myoelectric manifestations of muscle fatigue , 2017, Physiological measurement.

[13]  Guido Bugmann,et al.  Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[15]  Ganesh R. Naik,et al.  Nonnegative Matrix Factorization for the Identification of EMG Finger Movements: Evaluation Using Matrix Analysis , 2015, IEEE Journal of Biomedical and Health Informatics.

[16]  Erik Scheme,et al.  High-density force myography: A possible alternative for upper-limb prosthetic control. , 2016, Journal of rehabilitation research and development.

[17]  Frantzy Acluche,et al.  User experience of controlling the DEKA Arm with EMG pattern recognition , 2018, PloS one.

[18]  D. Farina,et al.  Prosthetic Myoelectric Control Strategies: A Clinical Perspective , 2014, Current Surgery Reports.

[19]  Yupeng Ren,et al.  EMG-Based Real-Time Linear-Nonlinear Cascade Regression Decoding of Shoulder, Elbow, and Wrist Movements in Able-Bodied Persons and Stroke Survivors , 2020, IEEE Transactions on Biomedical Engineering.

[20]  S Christopher,et al.  A Comprehensive Study on EMG Feature Extraction and Classifiers , 2018 .

[21]  Paul F. Pasquina,et al.  Special Considerations for Multiple Limb Amputation , 2014, Current Physical Medicine and Rehabilitation Reports.

[22]  Sadiq J. Abou-Loukh,et al.  Teleoperated robotic arm movement using electromyography signal with wearable Myo armband , 2020 .

[23]  Xinjun Sheng,et al.  A comparison of open-loop and closed-loop adaptive calibration for pattern recognition based myoelectric control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Maria Romano,et al.  Problems in Assessment of Novel Biopotential Front-End with Dry Electrode: A Brief Review , 2014 .

[25]  L J Hargrove,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Linda Resnik,et al.  Using virtual reality environment to facilitate training with advanced upper-limb prosthesis. , 2011, Journal of rehabilitation research and development.

[27]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Olivier Gibaru,et al.  A Review on Electromyography Decoding and Pattern Recognition for Human-Machine Interaction , 2019, IEEE Access.

[29]  D. Farina,et al.  Spatial Correlation of High Density EMG Signals Provides Features Robust to Electrode Number and Shift in Pattern Recognition for Myocontrol , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Dinesh Kant Kumar,et al.  Improved sEMG signal classification using the Twin SVM , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[31]  P.R. Troyk,et al.  IMES: An Implantable Myoelectric Sensor , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[33]  Klaas Postema,et al.  A systematic literature review of the effect of different prosthetic components on human functioning with a lower-limb prosthesis. , 2004, Journal of rehabilitation research and development.

[34]  Paul F Pasquina,et al.  Recent advances in bioelectric prostheses. , 2015, Neurology. Clinical practice.

[35]  Guido Bugmann,et al.  Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography , 2013, IEEE Journal of Biomedical and Health Informatics.

[36]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[37]  Erik J. Scheme,et al.  Selective Classification for Improved Robustness of Myoelectric Control Under Nonideal Conditions , 2011, IEEE Transactions on Biomedical Engineering.

[38]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Todd A. Kuiken,et al.  A Decision-Based Velocity Ramp for Minimizing the Effect of Misclassifications During Real-Time Pattern Recognition Control , 2011, IEEE Transactions on Biomedical Engineering.

[40]  Rajesh P. N. Rao,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Online Electromyographic Control of a Robotic , 2022 .

[41]  Haruhisa Kawasaki,et al.  Learning system for myoelectric prosthetic hand control by forearm amputees , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[42]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[43]  Guangjun Liu,et al.  A novel HCI based on EMG and IMU , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[44]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[45]  Claudio Castellini,et al.  A realistic implementation of ultrasound imaging as a human-machine interface for upper-limb amputees , 2013, Front. Neurorobot..

[46]  Victor Hugo C. de Albuquerque,et al.  Analysis of Man-Machine Interfaces in Upper-Limb Prosthesis: A Review , 2019, Robotics.

[47]  Dario Farina,et al.  Enhanced EMG signal processing for simultaneous and proportional myoelectric control , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Amit M. Joshi,et al.  Time Derivative Moments Based Feature Extraction Approach for Recognition of Upper Limb Motions Using EMG , 2019, IEEE Sensors Letters.

[49]  Xinjun Sheng,et al.  A prosthetic arm based on EMG pattern recognition , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[50]  Rachel Martina Edith,et al.  Gesture recognition using real time EMG , 2015, 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS).

[51]  Wen-Yaw Chung,et al.  Analog integrated circuit design for the wireless bio-signal transmission system , 1999, AP-ASIC'99. First IEEE Asia Pacific Conference on ASICs (Cat. No.99EX360).

[52]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[53]  Craig Sherstan,et al.  Application of real-time machine learning to myoelectric prosthesis control: A case series in adaptive switching , 2016, Prosthetics and orthotics international.

[54]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  Xinjun Sheng,et al.  Continuous estimation of finger joint angles under different static wrist motions from surface EMG signals , 2014, Biomed. Signal Process. Control..

[56]  José Antonio Barraza-Madrigal,et al.  A virtual upper limb prosthesis as a training system , 2010, 2010 7th International Conference on Electrical Engineering Computing Science and Automatic Control.

[57]  Marlı́s González-Fernández Development of upper limb prostheses: current progress and areas for growth. , 2014, Archives of physical medicine and rehabilitation.

[58]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[59]  Qing Yang,et al.  Real-time implementation of a self-recovery EMG pattern recognition interface for artificial arms , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[60]  Dario Farina,et al.  Improving the Robustness of Myoelectric Pattern Recognition for Upper Limb Prostheses by Covariate Shift Adaptation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  F. Bitar,et al.  A Portable MIDI Controller Using EMG-Based Individual Finger Motion Classification , 2007, 2007 IEEE Biomedical Circuits and Systems Conference.

[62]  Sethu Vijayakumar,et al.  Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements , 2017, Journal of NeuroEngineering and Rehabilitation.

[63]  Hiroshi Yokoi,et al.  An evolvable hardware chip for prosthetic hand controller , 1999, Proceedings of the Seventh International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems.

[64]  F. Finley,et al.  Pattern-recognition arm prosthesis: a historical perspective-a final report. , 1978, Bulletin of prosthetics research.

[65]  Oluwarotimi Williams Samuel,et al.  Improving the Robustness of Electromyogram-Pattern Recognition for Prosthetic Control by a Postprocessing Strategy , 2017, Front. Neurorobot..

[66]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[67]  Nurhazimah Nazmi,et al.  A Review of Classification Techniques of EMG Signals during Isotonic and Isometric Contractions , 2016, Sensors.

[68]  Mahmoud Tavakoli,et al.  Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach , 2017, Expert Syst. Appl..

[69]  Lucia Rita Quitadamo,et al.  Optimization of EMG-based hand gesture recognition: Supervised vs. unsupervised data preprocessing on healthy subjects and transradial amputees , 2014, Biomed. Signal Process. Control..

[70]  Hong Liu,et al.  Classification of Multiple Finger Motions During Dynamic Upper Limb Movements , 2017, IEEE Journal of Biomedical and Health Informatics.

[71]  S H Park,et al.  EMG pattern recognition based on artificial intelligence techniques. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[72]  Todd A Kuiken,et al.  Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[73]  Nitish V. Thakor,et al.  Limb Position Tolerant Pattern Recognition for Myoelectric Prosthesis Control with Adaptive Sparse Representations From Extreme Learning , 2018, IEEE Transactions on Biomedical Engineering.

[74]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[75]  Jie Liu,et al.  Adaptive myoelectric pattern recognition toward improved multifunctional prosthesis control. , 2015, Medical engineering & physics.

[76]  S. Acharya,et al.  Toward Electrocorticographic Control of a Dexterous Upper Limb Prosthesis: Building Brain-Machine Interfaces , 2012, IEEE Pulse.

[77]  Han-Pang Huang,et al.  Towards a high-stability EMG recognition system for prosthesis control: A one-class classification based non-target EMG pattern filtering scheme , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[78]  G. Naik,et al.  Transradial Amputee Gesture Classification Using an Optimal Number of sEMG Sensors: An Approach Using ICA Clustering , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[79]  Levi J Hargrove,et al.  Adapting myoelectric control in real-time using a virtual environment , 2019, Journal of NeuroEngineering and Rehabilitation.

[80]  Ping Zhou,et al.  A Novel Myoelectric Pattern Recognition Strategy for Hand Function Restoration After Incomplete Cervical Spinal Cord Injury , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[81]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[82]  Amit M. Joshi,et al.  Electromyography-Based Hand Gesture Recognition System for Upper Limb Amputees , 2019, IEEE Sensors Letters.

[83]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[84]  Paolo Bifulco,et al.  Investigating the role of combined acoustic-visual feedback in one-dimensional synchronous brain computer interfaces, a preliminary study , 2012, Medical devices.

[85]  Christian Cipriani,et al.  Classification of Transient Myoelectric Signals for the Control of Multi-Grasp Hand Prostheses , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[86]  T. Kuiken,et al.  Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical Trial , 2017, Scientific Reports.

[87]  Levi J. Hargrove,et al.  Real-Time and Offline Performance of Pattern Recognition Myoelectric Control Using a Generic Electrode Grid With Targeted Muscle Reinnervation Patients , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  Oluwarotimi Williams Samuel,et al.  Intelligent EMG Pattern Recognition Control Method for Upper-Limb Multifunctional Prostheses: Advances, Current Challenges, and Future Prospects , 2019, IEEE Access.

[89]  Hayes Converse,et al.  An EMG biofeedback device for video game use in forearm physiotherapy , 2013, 2013 IEEE SENSORS.

[90]  D. S. V. Bandara,et al.  Recent Trends in EMG-Based Control Methods for Assistive Robots , 2013 .

[91]  Pyeong-Gook Jung,et al.  A Wearable Gesture Recognition Device for Detecting Muscular Activities Based on Air-Pressure Sensors , 2015, IEEE Transactions on Industrial Informatics.

[92]  Erik Scheme,et al.  Motion Normalized Proportional Control for Improved Pattern Recognition-Based Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[93]  Dario Farina,et al.  Self-Correcting Pattern Recognition System of Surface EMG Signals for Upper Limb Prosthesis Control , 2014, IEEE Transactions on Biomedical Engineering.

[94]  Kazuo Kiguchi,et al.  Towards Control of a Transhumeral Prosthesis with EEG Signals , 2018, Bioengineering.

[95]  B. Hudgins,et al.  The effect of electrode displacements on pattern recognition based myoelectric control , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[96]  T S Kuo,et al.  Real-time implementation of electromyogram pattern recognition as a control command of man-machine interface. , 1996, Medical engineering & physics.

[97]  Adel Al-Jumaily,et al.  A Framework of Temporal-Spatial Descriptors-Based Feature Extraction for Improved Myoelectric Pattern Recognition , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[98]  Oluwarotimi Williams Samuel,et al.  Improving the Robustness of Real-Time Myoelectric Pattern Recognition against Arm Position Changes in Transradial Amputees , 2017, BioMed research international.

[99]  Cuntai Guan,et al.  A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration , 2019, Biomed. Signal Process. Control..

[100]  Siti Anom Ahmad,et al.  Review of Electromyography Control Systems Based on Pattern Recognition for Prosthesis Control Application , 2011 .

[101]  Ke Liao,et al.  Decoding Individual Finger Movements from One Hand Using Human EEG Signals , 2014, PloS one.

[102]  S. Krishnan,et al.  Real-Time Classification of Forearm Electromyographic Signals Corresponding to User-Selected Intentional Movements for Multifunction Prosthesis Control , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[103]  M. Osman Tokhi,et al.  A fuzzy clustering neural network architecture for multifunction upper-limb prosthesis , 2003, IEEE Transactions on Biomedical Engineering.

[104]  Oluwarotimi Williams Samuel,et al.  Resolving the adverse impact of mobility on myoelectric pattern recognition in upper-limb multifunctional prostheses , 2017, Comput. Biol. Medicine.

[105]  G. Pfurtscheller,et al.  Rapid prototyping of an EEG-based brain-computer interface (BCI) , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.