A sEMG-Based Hand Gesture Recognition Using Mulit-channel CNN and MLP

In this paper, three different classification methods, including the support vector machine (SVM), the deep learning method based on multi-layer perceptron (MLP) and multichannel convolutional neural network (multi-channel CNN), were used to classify 13 hand gestures. The surface electromyography (sEMG) were extracted from six muscles of hand and forearm. For the SVM and MLP, six features in the time domain, frequency domain and time-frequency domain were extracted. For the multi-channel CNN, a sliding window segment of the original sEMG image was used as the input. Hand gesture recognition based on deep learning had similar performance to traditional machine learning in off-line classification. Considering the high robustness and generalization ability, deep learning is likely a more robust alternative to traditional machine learning in the field of sEMG hand gesture recognition.

[1]  Xincheng Tian,et al.  A sEMG-Controlled Robotic Hand Exoskeleton for Rehabilitation in Post-Stroke Individuals , 2018, 2018 IEEE International Conference on Cyborg and Bionic Systems (CBS).

[2]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Ke Li,et al.  Optimization of sEMG Classification Model Based on Correlation Analysis and Feature Selection , 2020, 2020 5th International Conference on Advanced Robotics and Mechatronics (ICARM).

[4]  Qinghua Gao,et al.  A novel, co-located EMG-FMG-sensing wearable armband for hand gesture recognition , 2020 .

[5]  Tsukasa Ogasawara,et al.  Machine-learning-based hand motion recognition system by measuring forearm deformation with a distance sensor array , 2019, International Journal of Intelligent Robotics and Applications.

[6]  Saeed Mian Qaisar,et al.  Surface EMG signal classification using TQWT, Bagging and Boosting for hand movement recognition , 2020, J. Ambient Intell. Humaniz. Comput..

[7]  Ke Li,et al.  Hand Gesture Recognition Based on Electromyographic and Kinematic Analyses , 2019, 2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[8]  Ning Jiang,et al.  Efficient correction of armband rotation for myoelectric-based gesture control interface , 2020, Journal of neural engineering.

[9]  Erik Scheme,et al.  A Deep Transfer Learning Approach to Reducing the Effect of Electrode Shift in EMG Pattern Recognition-Based Control , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Do Chang Oh,et al.  Study on the EMG-based Grasp Gesture Classification Using Deep Learning and Application to Active Prosthetics , 2019 .

[11]  Qiang Huang,et al.  SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy , 2019, Sensors.

[12]  Xincheng Tian,et al.  Classification of hand motions using linear discriminant analysis and support vector machine , 2017, 2017 Chinese Automation Congress (CAC).

[13]  Syed Omer Gilani,et al.  Performance Evaluation of Convolutional Neural Network for Hand Gesture Recognition Using EMG , 2020, Sensors.

[14]  H. Jin Kim,et al.  Study on the EMG-based Grasp Gesture Classification Using Deep Learning and Application to Active Prosthetics , 2019 .

[15]  Piotr Kaczmarek,et al.  putEMG—A Surface Electromyography Hand Gesture Recognition Dataset , 2019, Sensors.

[16]  Karush Suri,et al.  Transfer Learning for sEMG-based Hand Gesture Classification using Deep Learning in a Master- Slave Architecture , 2018, 2018 3rd International Conference on Contemporary Computing and Informatics (IC3I).