Semg-Based Hand Gesture Recognition Via Dilated Convolutional Neural Networks

The recent evolution of Artificial Intelligence (AI) and deep learning models coupled with advancements of assistive robotic systems have shown great potential in significantly improving myoelectric control of prosthetic devices. In this regard, the paper proposes a novel deep-learning-based architecture for processing surface Electromyography (sEMG) signals to classify and recognize upper-limb hand gestures via incorporation of dilated causal convolutions. The proposed approach has the potential to significantly improve the overall recognition accuracy due to the specific design of the convolutional layers. By using dilated causal convolutions which gradually increases the receptive field of the network, and by applying Conv1D, the proposed architecture eliminates the need for readjustment of the input sequences and inherently takes into account the hidden temporal correlations existing among the available set of sEMG sequences. Contrary to recent hybrid (RNN-CNN) solutions, the proposed architecture neither uses recurrent units nor 2-dimensional convolutions. The publically-accessible NinaPro DB2 dataset is utilized for training and evaluation of the proposed network. Through an extensive set of experiments, it is observed that the proposed architecture significantly outperforms its state-of-the-art counterparts and provides an average 8.71% performance improvement.

[1]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[2]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[3]  Tim Salimans,et al.  Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks , 2016, NIPS.

[4]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[5]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[6]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[7]  Dario Farina,et al.  Stacked Sparse Autoencoders for EMG-Based Classification of Hand Motions: A Comparative Multi Day Analyses between Surface and Intramuscular EMG , 2018, Applied Sciences.

[8]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[9]  Yuheng Wu,et al.  Dynamic Gesture Recognition Based on LSTM-CNN , 2018, 2018 Chinese Automation Congress (CAC).

[10]  Feng Jiang,et al.  sEMG-Based Gesture Recognition with Convolution Neural Networks , 2018, Sustainability.

[11]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[12]  Xiang Li,et al.  Hand Gesture Recognition Based on Deep Learning Method , 2018, 2018 IEEE Third International Conference on Data Science in Cyberspace (DSC).

[13]  Manfredo Atzori,et al.  Electromyography data for non-invasive naturally-controlled robotic hand prostheses , 2014, Scientific Data.

[14]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[15]  Roberto Merletti,et al.  The extraction of neural strategies from the surface EMG. , 2004, Journal of applied physiology.

[16]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[17]  Yongkang Wong,et al.  A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition , 2018, PloS one.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.