Myoelectric Pattern Recognition for Controlling a Robotic Hand: A Feasibility Study in Stroke

Objective: Myoelectric pattern recognition has been successfully applied as a human-machine interface to control robotic devices such as prostheses and exoskeletons, significantly improving the dexterity of myoelectric control. This study investigates the feasibility of applying myoelectric pattern recognition for controlling a robotic hand in stroke patients. Methods: Myoelectric pattern recognition of six hand motion patterns was performed using forearm electromyogram signals in paretic side of eight stroke subjects. Both the random cross validation (RCV) and the chronological handout validation (CHV) were applied to assess the offline myoelectric pattern recognition performance. Experiments on real-time myoelectric pattern recognition control of an exoskeleton robotic hand were also performed. Results: An average classification accuracy of 84.1% (the mean value from two different classifiers) and individual subject differences were observed in the offline myoelectric pattern recognition analysis using the RCV, while the accuracy decreased to 65.7% when the CHV was used. The stroke subjects achieved an average accuracy of 61.3 ± 20.9% for controlling the robotic hand. However, our study did not reveal a clear correlation between the real-time control accuracy and the offline myoelectric pattern recognition performance, or any specific characteristics of the stroke subjects. Conclusion: The findings suggest that it is feasible to apply myoelectric pattern recognition to control the robotic hand in some but not all of the stroke patients. Each stroke subject should be individually online tested for the feasibility of applying myoelectric pattern recognition control for robot-assisted rehabilitation.

[1]  Levi J. Hargrove,et al.  Classification of Simultaneous Movements Using Surface EMG Pattern Recognition , 2013, IEEE Transactions on Biomedical Engineering.

[2]  Ping Zhou,et al.  Advanced Myoelectric Control for Robotic Hand-Assisted Training: Outcome from a Stroke Patient , 2017, Front. Neurol..

[3]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[4]  Douglas D Gunzler,et al.  Upper-Limb Recovery After Stroke , 2016, Neurorehabilitation and neural repair.

[5]  Max Ortiz-Catalan,et al.  Real-Time and Simultaneous Control of Artificial Limbs Based on Pattern Recognition Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Ping Zhou,et al.  High-Density Myoelectric Pattern Recognition Toward Improved Stroke Rehabilitation , 2012, IEEE Transactions on Biomedical Engineering.

[7]  Ping Zhou,et al.  Hands-Free Human-Computer Interface Based on Facial Myoelectric Pattern Recognition , 2019, Front. Neurol..

[8]  A. U. Pehlivan,et al.  Current Trends in Robot-Assisted Upper-Limb Stroke Rehabilitation: Promoting Patient Engagement in Therapy , 2014, Current Physical Medicine and Rehabilitation Reports.

[9]  M. Swiontkowski.  Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[10]  Luca Benini,et al.  A sub-10mW real-time implementation for EMG hand gesture recognition based on a multi-core biomedical SoC , 2017, 2017 7th IEEE International Workshop on Advances in Sensors and Interfaces (IWASI).

[11]  Raymond K. Y. Tong,et al.  Fine finger motor skill training with exoskeleton robotic hand in chronic stroke: Stroke rehabilitation , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[12]  L. Cohen,et al.  Decoding upper limb residual muscle activity in severe chronic stroke , 2014, Annals of clinical and translational neurology.

[13]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Xu Zhang,et al.  Multiple Hand Gesture Recognition Based on Surface EMG Signal , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[15]  Guanglin Li,et al.  Pattern recognition based forearm motion classification for patients with chronic hemiparesis , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  W. Rymer,et al.  The effect of involuntary motor activity on myoelectric pattern recognition: a case study with chronic stroke patients , 2013, Journal of neural engineering.

[17]  Carlo Menon,et al.  Surface EMG pattern recognition for real-time control of a wrist exoskeleton , 2010, Biomedical engineering online.

[18]  Antonio Frisoli,et al.  A Linear Optimization Procedure for an EMG-driven NeuroMusculoSkeletal Model Parameters Adjusting: Validation Through a Myoelectric Exoskeleton Control , 2016, EuroHaptics.

[19]  N. Shoylev,et al.  Neural Networks for Online Classification of Hand and Finger Movements Using Surface EMG signals , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[20]  Ping Zhou,et al.  Decoding a new neural machine interface for control of artificial limbs. , 2007, Journal of neurophysiology.

[21]  Sang Wook Lee,et al.  Subject-Specific Myoelectric Pattern Classification of Functional Hand Movements for Stroke Survivors , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Elsa Andrea Kirchner,et al.  Exoskeleton Technology in Rehabilitation: Towards an EMG-Based Orthosis System for Upper Limb Neuromotor Rehabilitation , 2013, J. Robotics.

[23]  Ping Zhou,et al.  Robotic Hand–Assisted Training for Spinal Cord Injury Driven by Myoelectric Pattern Recognition: A Case Report , 2017, American journal of physical medicine & rehabilitation.

[24]  Siti Anom Ahmad,et al.  Simple and Computationally Efficient Movement Classification Approach for EMG-controlled Prosthetic Hand: ANFIS vs. Artificial Neural Network , 2015, Intell. Autom. Soft Comput..

[25]  E. A. Susanto,et al.  The effects of post-stroke upper-limb training with an electromyography (EMG)-driven hand robot. , 2013, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[26]  Fuchun Sun,et al.  sEMG-Based Joint Force Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2014, IEEE Journal of Biomedical and Health Informatics.

[27]  R. Hughes,et al.  Electromyography-Controlled Exoskeletal Upper-Limb–Powered Orthosis for Exercise Training After Stroke , 2007, American journal of physical medicine & rehabilitation.

[28]  Xiang Chen,et al.  A prototype of gesture-based interface , 2011, Mobile HCI.

[29]  Bo Sheng,et al.  Bilateral robots for upper-limb stroke rehabilitation: State of the art and future prospects. , 2016, Medical engineering & physics.

[30]  Akio Kimura,et al.  Efficacy of brain-computer interface-driven neuromuscular electrical stimulation for chronic paresis after stroke. , 2014, Journal of rehabilitation medicine.

[31]  Erik J. Scheme,et al.  Selective Classification for Improved Robustness of Myoelectric Control Under Nonideal Conditions , 2011, IEEE Transactions on Biomedical Engineering.

[32]  Ying Wu,et al.  Modeling the constraints of human hand motion , 2000, Proceedings Workshop on Human Motion.

[33]  Nicola Vitiello,et al.  Intention-Based EMG Control for Powered Exoskeletons , 2012, IEEE Transactions on Biomedical Engineering.

[34]  Wei Zhou,et al.  Myoelectrically controlled wrist robot for stroke rehabilitation , 2013, Journal of NeuroEngineering and Rehabilitation.

[35]  Max Ortiz-Catalan,et al.  BioPatRec: A modular research platform for the control of artificial limbs based on pattern recognition algorithms , 2013, Source Code for Biology and Medicine.

[36]  Maarten J. IJzerman,et al.  Electrical stimulation of the upper extremity in stroke: cyclic versus EMG-triggered stimulation , 2008, Clinical rehabilitation.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Todd A. Kuiken,et al.  The Effect of ECG Interference on Pattern-Recognition-Based Myoelectric Control for Targeted Muscle Reinnervated Patients , 2009, IEEE Transactions on Biomedical Engineering.

[39]  Guido Bugmann,et al.  Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography , 2013, IEEE Journal of Biomedical and Health Informatics.

[40]  K. Tong,et al.  Effects of electromyography-driven robot-aided hand training with neuromuscular electrical stimulation on hand control performance after chronic stroke , 2015, Disability and rehabilitation. Assistive technology.

[41]  Asha,et al.  A Hand Gesture Recognition Framework and Wearable Gesture Based Interaction Prototype for Mobile Devices , 2015 .

[42]  Mamun Bin Ibne Reaz,et al.  Surface Electromyography Signal Processing and Classification Techniques , 2013, Sensors.

[43]  Gamini Dissanayake,et al.  Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals , 2012, Expert Syst. Appl..

[44]  S. Micera,et al.  EMG-based pattern recognition approach in post stroke robot-aided rehabilitation: a feasibility study , 2013, Journal of NeuroEngineering and Rehabilitation.

[45]  Christian Antfolk,et al.  Using EMG for Real-time Prediction of Joint Angles to Control a Prosthetic Hand Equipped with a Sensory Feedback System , 2010 .

[46]  E. Bizzi,et al.  Muscle synergy patterns as physiological markers of motor cortical damage , 2012, Proceedings of the National Academy of Sciences.

[47]  Ping Zhou,et al.  Real-Time Control of an Exoskeleton Hand Robot with Myoelectric Pattern Recognition , 2017, Int. J. Neural Syst..

[48]  F. Hummel,et al.  The influence of functional electrical stimulation on hand motor recovery in stroke patients: a review , 2014, Experimental & Translational Stroke Medicine.

[49]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..