Real-Time Surface EMG Pattern Recognition for Hand Gestures Based on an Artificial Neural Network

In recent years, surface electromyography (sEMG) signals have been increasingly used in pattern recognition and rehabilitation. In this paper, a real-time hand gesture recognition model using sEMG is proposed. We use an armband to acquire sEMG signals and apply a sliding window approach to segment the data in extracting features. A feedforward artificial neural network (ANN) is founded and trained by the training dataset. A test method is used in which the gesture will be recognized when recognized label times reach the threshold of activation times by the ANN classifier. In the experiment, we collected real sEMG data from twelve subjects and used a set of five gestures from each subject to evaluate our model, with an average recognition rate of 98.7% and an average response time of 227.76 ms, which is only one-third of the gesture time. Therefore, the pattern recognition system might be able to recognize a gesture before the gesture is completed.

[1]  Andrew W. Fitzgibbon,et al.  Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences , 2016, ACM Trans. Graph..

[2]  Nasser Kehtarnavaz,et al.  Real-time robust vision-based hand gesture recognition using stereo images , 2013, Journal of Real-Time Image Processing.

[3]  Christian Cipriani,et al.  Distance and mutual information methods for EMG feature and channel subset selection for classification of hand movements , 2016, Biomed. Signal Process. Control..

[4]  Oishee Mazumder,et al.  Hand Gesture Recognition Based Omnidirectional Wheelchair Control Using IMU and EMG Sensors , 2018, J. Intell. Robotic Syst..

[5]  Clément Gosselin,et al.  A convolutional neural network for robotic arm guidance using sEMG based frequency-features , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Marco E. Benalcázar,et al.  Hand gesture recognition using machine learning and the Myo armband , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[7]  Miguel Cazorla,et al.  Inferring Static Hand Poses from a Low-Cost Non-Intrusive sEMG Sensor , 2019, Sensors.

[8]  Patricio Zambrano,et al.  Real-Time Hand Gesture Recognition Based on Artificial Feed-Forward Neural Networks and EMG , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[9]  Xiang Cao,et al.  Chinese Sign Language Recognition Based on an Optimized Tree-Structure Framework , 2017, IEEE Journal of Biomedical and Health Informatics.

[10]  Hang Guo,et al.  Fabric-based self-powered noncontact smart gloves for gesture recognition , 2018 .

[11]  Takayuki Koizumi,et al.  Forearm motion discrimination technique using real-time EMG signals , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Yiding Wang,et al.  3D hand gesture recognition based on Polar Rotation Feature and Linear Discriminant Analysis , 2013, 2013 Fourth International Conference on Intelligent Control and Information Processing (ICICIP).

[14]  Margrit Betke,et al.  Comparing random forest approaches to segmenting and classifying gestures , 2017, Image Vis. Comput..

[15]  Clément Gosselin,et al.  Real-Time Hand Motion Recognition Using sEMG Patterns Classification , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  A. Phinyomark,et al.  Application of Wavelet Analysis in EMG Feature Extraction for Pattern Classification , 2011 .

[17]  Hanqing Lu,et al.  EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition , 2018, IEEE Transactions on Multimedia.

[18]  Bin He,et al.  Underactuated robotics: A review , 2019, International Journal of Advanced Robotic Systems.

[19]  Ricardo Carelli,et al.  Human-machine interfaces based on EMG and EEG applied to robotic systems , 2008, Journal of NeuroEngineering and Rehabilitation.

[20]  Maury A. Nussbaum,et al.  Online Classification and Sensor Selection Optimization With Applications to Human Material Handling Tasks Using Wearable Sensing Technologies , 2016, IEEE Transactions on Human-Machine Systems.

[21]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[22]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[23]  Marco E. Benalcázar,et al.  Real-Time Hand Gesture Recognition Based on Electromyographic Signals and Artificial Neural Networks , 2018, ICANN.

[24]  Anibal T. de Almeida,et al.  Robust hand gesture recognition with a double channel surface EMG wearable armband and SVM classifier , 2018, Biomed. Signal Process. Control..

[25]  Abdul Rahim Abdullah,et al.  Deep Convolutional Neural Network for Featureless Electromyogram Pattern Recognition Using Time-Frequency Distribution , 2018 .

[26]  Frédo Durand,et al.  Capturing the human figure through a wall , 2015, ACM Trans. Graph..

[27]  Ping Zhou,et al.  Real-Time Control of an Exoskeleton Hand Robot with Myoelectric Pattern Recognition , 2017, Int. J. Neural Syst..

[28]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[29]  Reza Langari,et al.  Subject-independent hand gesture recognition using normalization and machine learning algorithms , 2018, J. Comput. Sci..

[30]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[32]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Luca Benini,et al.  A Prosthetic Hand Body Area Controller Based on Efficient Pattern Recognition Control Strategies , 2017, Sensors.

[34]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[35]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[36]  Minho Lee,et al.  Real Time Hand Gesture Recognition Using Random Forest and Linear Discriminant Analysis , 2015, HAI.

[37]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[38]  Wen Gao,et al.  A Chinese sign language recognition system based on SOFM/SRN/HMM , 2004, Pattern Recognit..

[39]  Patricio Zambrano,et al.  Real-time hand gesture recognition using the Myo armband and muscle activity detection , 2017, 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM).