LSTM Classification of sEMG Signals For Individual Finger Movements Using Low Cost Wearable Sensor

The electrical activity of the muscles that control finger movements can be extracted during the performance of these movements and using machine learning techniques, the myoelectric signals can be decoded and classified according to the movement that generated the specific signal. The focus of this paper is to classify sEMG signal using easily accessible cheap hardware to capture the signal. Furthermore, to employ neural networks to classify the signal using established methodology i.e. feature extraction, with the highest possible accuracy. To classify these sEMG signals, an LSTM network has been developed and was able to classify 12 individual finger movements with accuracies reaching 90%.

[1]  Ernest Nlandu Kamavuako,et al.  Evaluation of the Myo armband for the classification of hand motions , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[2]  Erik Scheme,et al.  A feature extraction issue for myoelectric control based on wearable EMG sensors , 2018, 2018 IEEE Sensors Applications Symposium (SAS).

[3]  Luca Benini,et al.  A Versatile Embedded Platform for EMG Acquisition and Gesture Recognition , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[4]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[5]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .

[6]  Tanu Sharma,et al.  A novel feature extraction for robust EMG pattern recognition , 2016, Journal of medical engineering & technology.

[7]  Nitish V. Thakor,et al.  Decoding of Individuated Finger Movements Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[8]  Pornchai Phukpattaranont,et al.  A Novel Feature Extraction for Robust EMG Pattern Recognition , 2009, ArXiv.

[9]  Marco E. Benalcázar,et al.  Hand gesture recognition using machine learning and the Myo armband , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[10]  Manfredo Atzori,et al.  Electromyography data for non-invasive naturally-controlled robotic hand prostheses , 2014, Scientific Data.

[11]  N.V. Thakor,et al.  Towards the Control of Individual Fingers of a Prosthetic Hand Using Surface EMG Signals , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  A. Phinyomark,et al.  Evaluation of EMG feature extraction for hand movement recognition based on Euclidean distance and standard deviation , 2010, ECTI-CON2010: The 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[13]  Ye Wang,et al.  Translating sEMG signals to continuous hand poses using recurrent neural networks , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[14]  Mehran Jahed,et al.  A Neuro–Fuzzy Inference System for sEMG-Based Identification of Hand Motion Commands , 2011, IEEE Transactions on Industrial Electronics.

[15]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[16]  Alexander Refsum Jensenius,et al.  Mumyo - evaluating and exploring the myo armband for musical interaction , 2015, NIME.

[17]  Ilja Kuzborskij,et al.  Characterization of a Benchmark Database for Myoelectric Movement Classification , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Yannick Aoustin,et al.  A testing system for a real-time gesture classification using surface EMG , 2017 .

[19]  Ayan Banerjee,et al.  A Comparison of Techniques for Sign Language Alphabet Recognition Using Armband Wearables , 2019, ACM Trans. Interact. Intell. Syst..

[20]  N. V. Subba Reddy,et al.  Effects of padding on LSTMs and CNNs , 2019, ArXiv.

[21]  Manfredo Atzori,et al.  Movement Error Rate for Evaluation of Machine Learning Methods for sEMG-Based Hand Movement Classification , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Micael S. Couceiro,et al.  Stepping-stones to Transhumanism: An EMG-controlled Low-cost Prosthetic Hand for Academia , 2018, 2018 International Conference on Intelligent Systems (IS).

[23]  Guido Bugmann,et al.  Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography , 2013, IEEE Journal of Biomedical and Health Informatics.

[24]  Manfredo Atzori,et al.  Comparison of six electromyography acquisition setups on hand movement classification tasks , 2017, PloS one.

[25]  Adel Al-Jumaily,et al.  Orthogonal Fuzzy Neighborhood Discriminant Analysis for Multifunction Myoelectric Hand Control , 2010, IEEE Transactions on Biomedical Engineering.

[26]  Rifai Chai,et al.  Isometric Finger Pose Recognition with Sparse Channel SpatioTemporal EMG Imaging , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Aaron C. Courville,et al.  Recurrent Batch Normalization , 2016, ICLR.

[28]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[29]  Sumantri R Kurniawan,et al.  MYO Armband sensors and Neural Network Algorithm for Controlling Hand Robot , 2018, 2018 International Conference on Applied Engineering (ICAE).

[30]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[31]  Jin-Hee Lee,et al.  Korean sign language recognition using EMG and IMU sensors based on group-dependent NN models , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[32]  Yuheng Wu,et al.  Dynamic Gesture Recognition Based on LSTM-CNN , 2018, 2018 Chinese Automation Congress (CAC).

[33]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[34]  Patricio Zambrano,et al.  Real-time hand gesture recognition using the Myo armband and muscle activity detection , 2017, 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM).