Real-time hand gesture recognition with EMG using machine learning

In this paper, we propose the development of a model for real-time hand gesture recognition. We use surface electromyography (EMG) and Machine Learning techniques. The recognition of gestures using EMG is not a trivial task because there are several physiological processes in the skeletal muscles underlying their generation. In the scientific literature, there are several hand gesture recognition models, but they have limitations both in the number of gestures to be recognized (i.e., classes) and in the processing time. Therefore, the primary goal of this research is to obtain a real-time hand gesture recognition model for various applications in the field of medicine and engineering with a higher recognition accuracy than the real-time models proposed in the scientific literature and a higher number of gestures to recognize (i.e. in the order of the dozens). The proposed model has five stages: acquisition of the EMG signals, preprocessing (e.g., rectification and filtering), feature extraction (e.g., time, frequency and time-frequency), classification (e.g., parametric and nonparametric) and post-processing. Generally, the main difficulties of the hand gesture recognition models with EMG using Machine Learning are: the noisy behavior of EMG signal, and the small number of gestures per person relative to the number of generated data by each gesture (e.i., curse of dimensionality). Solving these two issues could also lead to solutions for other problems such as face recognition and audio recognition, for which these two issues are a major concern.

[1]  Nelson Sotomayor,et al.  Gesture Recognition and Machine Learning Applied to Sign Language Translation , 2017 .

[2]  Pavan Chakraborty,et al.  EMG signal based finger movement recognition for prosthetic hand control , 2015, 2015 Communication, Control and Intelligent Systems (CCIS).

[3]  Kongqiao Wang,et al.  Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors , 2009, IUI.

[4]  J H Blok,et al.  Surface EMG models: properties and applications. , 2000, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[5]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[6]  Luca Benini,et al.  Hybrid EMG classifier based on HMM and SVM for hand gesture recognition in prosthetics , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[7]  Tao Li,et al.  EMG pattern recognition using decomposition techniques for constructing multiclass classifiers , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[8]  Javier Rodriguez-Falces,et al.  EMG Modeling , 2012 .

[9]  Paolo Dario,et al.  Recognition of Daily Gestures with Wearable Inertial Rings and Bracelets , 2016, Sensors.

[10]  M. Knaflitz,et al.  A statistical method for the measurement of muscle activation intervals from surface myoelectric signal during gait , 1998, IEEE Transactions on Biomedical Engineering.

[11]  Yantao Tian,et al.  Multi-pattern recognition of sEMG based on improved BP neural network algorithm , 2010, Proceedings of the 29th Chinese Control Conference.

[12]  Takayuki Koizumi,et al.  Forearm motion discrimination technique using real-time EMG signals , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  J. Weiss,et al.  Easy EMG: A Guide to Performing Nerve Conduction Studies and Electromyography , 2004 .

[14]  Elisabeth André,et al.  EMG-based hand gesture recognition for realtime biosignal interfacing , 2008, IUI '08.

[15]  Martin Saerbeck,et al.  Recent methods and databases in vision-based hand gesture recognition: A review , 2015, Comput. Vis. Image Underst..

[16]  Nicolas Stifani,et al.  Motor neurons and the generation of spinal motor neuron diversity , 2014, Front. Cell. Neurosci..

[17]  Angel Rubio,et al.  Reducing the Number of Channels and Signal-features for an Accurate Classification in an EMG Pattern Recognition Task , 2012, BIOSIGNALS.

[18]  Oliver Röhrle,et al.  Mathematically modelling surface EMG signals , 2014 .

[19]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Ferat Sahin,et al.  Real-Time American Sign Language Recognition System Using Surface EMG Signal , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[21]  Rami J. Oweis,et al.  ANN-based EMG classification for myoelectric control , 2014, Int. J. Medical Eng. Informatics.

[22]  F. Mohd-Yasin,et al.  Techniques of EMG signal analysis: detection, processing, classification and applications , 2006, Biological Procedures Online.

[23]  Guan-Chun Luh,et al.  Muscle-gesture robot hand control based on sEMG signals with wavelet transform features and neural network classifier , 2016, 2016 International Conference on Machine Learning and Cybernetics (ICMLC).

[24]  Huang Ling,et al.  Clustering analysis and recognition of the EMGs , 2011, 2011 2nd International Conference on Intelligent Control and Information Processing.

[25]  A. Adler,et al.  An improved method for muscle activation detection during gait , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).