Subject-independent hand gesture recognition using normalization and machine learning algorithms

Abstract Hand gestures can be recognized using the upper limb’s electromyography (EMG) that measures the electrical activity of the skeletal muscles. However, generalization of muscle activities for a particular hand gesture is challenging due to between-subject variations in EMG signals. To improve the gesture recognition accuracy without training the machine learning algorithm subject specifically, the time-domain EMG features are normalized to the area under the averaged root mean square curve (AUC-RMS). Results are compared with both original EMG features and EMG features extracted from the signals that are normalized to the maximum peak value. Ten male adult subjects age ranging 20–37 years performed three hand gestures including fist, wave in, and wave out for ten to twelve times. The four basic time domain features including mean absolute value, zero crossing, waveform length, and slope sign change were extracted from the active EMG signals of each channel. Five machine learning algorithms, namely, k-Nearest Neighbor (kNN), Discriminant Analysis (DA), Naive Bayes (NB), Random Forest (RF), and Support Vector Machine (SVM) were used to classify the three different hand gestures. The results showed that the performance metrics such as accuracy, F1-score, Matthew correlation coefficient, and Kappa score were improved when using the both normalization methods compared to the original EMG features. However, normalization to the AUC-RMS value resulted in substantially more accurate gesture recognition compared to features extracted from signal normalized to maximum peak value using kNN, NB, and RF (p

[1]  Yu Hu,et al.  Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation , 2017, Sensors.

[2]  Mamun Bin Ibne Reaz,et al.  Surface Electromyography Signal Processing and Classification Techniques , 2013, Sensors.

[3]  Reza Langari,et al.  Myoelectric pattern recognition using dynamic motions with limb position changes , 2016, 2016 American Control Conference (ACC).

[4]  Tanja Schultz,et al.  Recognizing Hand and Finger Gestures with IMU based Motion and EMG based Muscle Activity Sensing , 2015, BIOSIGNALS.

[5]  P. Geethanjali,et al.  Identification of motion from multi-channel EMG signals for control of prosthetic hand , 2011, Australasian Physical & Engineering Sciences in Medicine.

[6]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[7]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[8]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[9]  Antonio Krüger,et al.  User-independent real-time hand gesture recognition based on surface electromyography , 2017, MobileHCI.

[10]  Panagiotis Artemiadis,et al.  Beyond User-Specificity for EMG Decoding Using Multiresolution Muscle Synergy Analysis , 2013 .

[11]  S M McGill,et al.  The importance of normalization in the interpretation of surface electromyography: a proof of principle. , 1999, Journal of manipulative and physiological therapeutics.

[12]  Jun Morimoto,et al.  Bilinear Modeling of EMG Signals to Extract User-Independent Features for Multiuser Myoelectric Interface , 2013, IEEE Transactions on Biomedical Engineering.

[13]  João Diogo Faria Lopes Gesture spotting from IMU and EMG data for human-robot interaction , 2016 .

[14]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[15]  Reza Langari,et al.  Robustness of using dynamic motions and template matching to the limb position effect in myoelectric classification , 2016 .

[16]  M. Vaiman Standardization of surface electromyography utilized to evaluate patients with dysphagia , 2007, Head & face medicine.

[17]  Stephen R. Marsland,et al.  Machine Learning - An Algorithmic Perspective , 2009, Chapman and Hall / CRC machine learning and pattern recognition series.

[18]  Marco E. Benalcázar,et al.  Hand gesture recognition using machine learning and the Myo armband , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[19]  Dana Kulic,et al.  Hand gesture recognition based on surface electromyography , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Reza Langari,et al.  A Performance Comparison of EMG Classification Methods for Hand and Finger Motion , 2014 .

[21]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[22]  Mark Halaki,et al.  Normalization of EMG Signals: To Normalize or Not to Normalize and What to Normalize to? , 2012 .

[23]  Hao Jiang,et al.  MyoHMI: A low-cost and flexible platform for developing real-time human machine interface for myoelectric controlled applications , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Hamid R. Marateb,et al.  A Novel Spatial Feature for the Identification of Motor Tasks Using High-Density Electromyography , 2017, Sensors.

[25]  Todd A. Kuiken,et al.  An Analysis of Intrinsic and Extrinsic Hand Muscle EMG for Improved Pattern Recognition Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Ruifeng Li,et al.  SVM based simultaneous hand movements classification using sEMG signals , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).