Recognition of Subtle Gestures by 2-Channel sEMG Using Parameter Estimation Classifiers Based on Probability Density

The abundant movement information carried by the surface electromyography (sEMG) signal can comprehensively reflect the muscle movement patterns on the surface of the human body, and the characteristics of physiological signals involving movement information have promoted the vigorous development in the field of human-computer interaction in machine learning. This paper takes subtle gestures as the research objects, and proposes a subtle gestures recognition system that uses two-channel sEMG signal and utilizes Quadratic Discriminant Analysis (QDA) and Linear Discriminant Analysis (LDA) which are parameter estimation classifiers based on probability density. First, combining the raw sEMG signal and the envelope sEMG signal, the number of channels for sensors and corresponding position of the muscle groups are preferably selected. Then, we propose to use the Pearson correlation coefficient to optimize the four types of features extracted in the time domain, frequency domain, time-frequency domain and AR model parameters, which effectively ensures the uniqueness of each gesture and eliminates individual differences. Finally, this paper compares four classifiers of QDA, LDA, Support Vector Machine (SVM), and K-Nearest Neighbor (KNN), and explores the pattern recognition classifier suitable for subtle actions. The experiment collects 9 kinds of subtle gestures from 8 subjects. The results show that the system can use only two channels of sEMG signal to recognize 9 kinds of subtle gestures which include multi-finger clicking or pinching or holding objects, and the most suitable classifiers QDA and LDA have the average recognition rates of 95.79% and 95.01%, respectively.

[1]  Sheng Bi,et al.  High-Density Surface EMG-Based Gesture Recognition Using a 3D Convolutional Neural Network , 2020, Sensors.

[2]  Arto Visala,et al.  urrent state of digital signal processing in myoelectric interfaces and elated applications , 2015 .

[3]  Xiaoou Li,et al.  sEMG Signal Processing Methods: A Review , 2019, Journal of Physics: Conference Series.

[4]  Manfredo Atzori,et al.  Building the Ninapro database: A resource for the biorobotics community , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[5]  Honghai Liu,et al.  Hand gesture recognition based on convolution neural network , 2017, Cluster Computing.

[6]  C. D. De Luca Physiology and Mathematics of Myoelectric Signals , 1979, IEEE Transactions on Biomedical Engineering.

[7]  Xueli Fan,et al.  A novel hand gesture recognition method based on 2-channel sEMG , 2018, Technology and health care : official journal of the European Society for Engineering and Medicine.

[8]  Ling Zhang,et al.  Identification of Gesture Based on Combination of Raw sEMG and sEMG Envelope Using Supervised Learning and Univariate Feature Selection , 2019 .

[9]  Roozbeh Jafari,et al.  A Wearable System for Recognizing American Sign Language in Real-Time Using IMU and Surface EMG Sensors , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Alexandre Balbinot,et al.  Open Database for Accurate Upper-Limb Intent Detection Using Electromyography and Reliable Extreme Learning Machines , 2019, Sensors.

[11]  Piotr Kaczmarek,et al.  putEMG—A Surface Electromyography Hand Gesture Recognition Dataset , 2019, Sensors.

[12]  Hong Liu,et al.  Accurate EMG onset detection in pathological, weak and noisy myoelectric signals , 2017, Biomed. Signal Process. Control..

[13]  Jing Li,et al.  An Integrative Framework of Human Hand Gesture Segmentation for Human–Robot Interaction , 2017, IEEE Systems Journal.

[14]  Abdul Rahim Abdullah,et al.  Deep Convolutional Neural Network for Featureless Electromyogram Pattern Recognition Using Time-Frequency Distribution , 2018 .

[15]  Jongin Kim,et al.  A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface , 2015, Sensors.

[16]  Feng Tian,et al.  A Wavelet-Based Method to Predict Muscle Forces From Surface Electromyography Signals in Weightlifting , 2012 .

[17]  Tania Hanekom,et al.  Effect of spatial filtering on crosstalk reduction in surface EMG recordings. , 2009, Medical engineering & physics.

[18]  Honghai Liu,et al.  Jointly network: a network based on CNN and RBM for gesture recognition , 2018, Neural Computing and Applications.

[19]  Bo Tao,et al.  Intelligent Human-Computer Interaction Based on Surface EMG Gesture Recognition , 2019, IEEE Access.

[20]  Ling Zhang,et al.  Gesture recognition method based on a single-channel sEMG envelope signal , 2018, EURASIP J. Wirel. Commun. Netw..

[21]  Wenjin Tao,et al.  Worker Activity Recognition in Smart Manufacturing Using IMU and sEMG Signals with Convolutional Neural Networks , 2018, EasyChair Preprints.

[22]  Manfredo Atzori,et al.  Electromyography data for non-invasive naturally-controlled robotic hand prostheses , 2014, Scientific Data.

[23]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[24]  Jinwu Qian,et al.  Real-Time Surface EMG Pattern Recognition for Hand Gestures Based on an Artificial Neural Network , 2019, Sensors.

[25]  S. Chatterji,et al.  sEMG signal classification with novel feature extraction using different machine learning approaches , 2018, J. Intell. Fuzzy Syst..

[26]  Shaidah Jusoh,et al.  A systematic review on hand gesture recognition techniques, challenges and applications , 2019, PeerJ Comput. Sci..

[27]  Jing Li,et al.  A Novel Hand Gesture Recognition Based on High-Level Features , 2017, Int. J. Humanoid Robotics.

[28]  Dario Farina,et al.  Optimal automatic detection of muscle activation intervals. , 2019, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[29]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[30]  Lin Chen,et al.  Hand Gesture Recognition Using Compact CNN via Surface Electromyography Signals , 2020, Sensors.

[31]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[32]  Levi J. Hargrove,et al.  A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control , 2008, Biomed. Signal Process. Control..

[33]  Ling Zhang,et al.  Research on Recognition of Nine Kinds of Fine Gestures Based on Adaptive AdaBoost Algorithm and Multi-Feature Combination , 2019, IEEE Access.