A Survey on Deep Learning in Electromyographic Signal Analysis

In the recent past Deep Learning (DL) has been used to develop intelligent systems that perform surprisingly well in a large variety of tasks, e.g. image recognition, machine translation, and self-driving cars. The huge improvement of the elaboration hardware and the growing need of big data processing have boosted the DL research in several fields. Recently, physiological signal processing has taking advantage of deep learning as well. In particular, the number of studies concerning the analysis of electromyographic (EMG) signals with DL methods is exponentially raising. This phenomenon is mainly explained by both the existing limitation of the myoelectric controlled prostheses and the recent publication of big datasets of EMG recordings, e.g. Ninapro. Such increasing trend motivated us to search and review recent papers that focus on the processing of EMG signals with DL methods. A comprehensive literature search of papers published between January 2014 and March 2019 was performed referring to the Scopus database. After a full text analysis, 65 papers were selected for the review. The bibliometric research shows four distinct clusters focused on different applications: Hand Gesture Classification; Speech and Emotion Classification; Sleep Stage Classification; Other Applications. As expected, the review process revealed that most of the papers related to DL and EMG signal processing concerns the hand gesture classification, and the convolutional neural network is the most used technique.

[1]  Baihua Li,et al.  Movement and Gesture Recognition Using Deep Learning and Wearable-sensor Technology , 2018 .

[2]  Vitoantonio Bevilacqua,et al.  Retinal Fundus Biometric Analysis for Personal Identifications , 2008, ICIC.

[3]  Purushothaman Geethanjali,et al.  Myoelectric control of prosthetic hands: state-of-the-art review , 2016, Medical devices.

[4]  Xiaodong Zhang,et al.  Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networks , 2018, Biomed. Signal Process. Control..

[5]  Thomas M. Deserno,et al.  Deep Learning on 1-D Biosignals: a Taxonomy-based Survey , 2018, Yearbook of Medical Informatics.

[6]  Abdulkadir Sengur,et al.  DeepEMGNet: An Application for Efficient Discrimination of ALS and Normal EMG Signals , 2017 .

[7]  D G Lloyd,et al.  Anticipatory effects on knee joint loading during running and cutting maneuvers. , 2001, Medicine and science in sports and exercise.

[8]  Roberto Merletti,et al.  Surface Electromyography: Physiology, engineering, and applications , 2016 .

[9]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[10]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Jürgen Schmidhuber,et al.  Deep Neural Network Frontend for Continuous EMG-Based Speech Recognition , 2016, INTERSPEECH.

[12]  Antonio Frisoli,et al.  Evaluation of a Pose-Shared Synergy-Based Isometric Model for Hand Force Estimation: Towards Myocontrol , 2017 .

[13]  Seong-Whan Lee,et al.  Movement intention decoding based on deep learning for multiuser myoelectric interfaces , 2016, 2016 4th International Winter Conference on Brain-Computer Interface (BCI).

[14]  Ernest Nlandu Kamavuako,et al.  A novel approach for classification of hand movements using surface EMG signals , 2017, 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[15]  Zhou Hui,et al.  Multimodal deep learning network based hand ADLs tasks classification for prosthetics control , 2017, 2017 International Conference on Progress in Informatics and Computing (PIC).

[16]  Antonio Frisoli,et al.  A Linear Optimization Procedure for an EMG-driven NeuroMusculoSkeletal Model Parameters Adjusting: Validation Through a Myoelectric Exoskeleton Control , 2016, EuroHaptics.

[17]  Xun Chen,et al.  Feasibility Study of Advanced Neural Networks Applied to sEMG-Based Force Estimation , 2018, Sensors.

[18]  P. Morasso,et al.  Direct measurement of ankle stiffness during quiet standing: implications for control modelling and clinical application. , 2005, Gait & posture.

[19]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[20]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[21]  Xinjun Sheng,et al.  Improving Myoelectric Pattern Recognition Robustness to Electrode Shift by Autoencoder , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Antonio Frisoli,et al.  Real-Time 3D Tracker in Robot-Based Neurorehabilitation , 2018 .

[23]  Yi Su,et al.  MEASUREMENT OF UPPER LIMB MUSCLE FATIGUE USING DEEP BELIEF NETWORKS , 2016 .

[24]  Adel Al-Jumaily,et al.  Auto-encoder based deep learning for surface electromyography signal processing , 2018 .

[25]  Yinghong Peng,et al.  Sensor Fusion for Myoelectric Control Based on Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[26]  Yongkang Wong,et al.  A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition , 2018, PloS one.

[27]  Gianpaolo Francesco Trotta,et al.  Computer vision and deep learning techniques for pedestrian detection and tracking: A survey , 2018, Neurocomputing.

[28]  Gianpaolo Francesco Trotta,et al.  A Novel Deep Learning Approach in Haematology for Classification of Leucocytes , 2019, Quantifying and Processing Biomedical and Behavioral Signals.

[29]  S. Micera,et al.  Age-related modifications of muscle synergies and spinal cord activity during locomotion. , 2010, Journal of neurophysiology.

[30]  Antonio Frisoli,et al.  A Linear Approach to Optimize an EMG-Driven Neuromusculoskeletal Model for Movement Intention Detection in Myo-Control: A Case Study on Shoulder and Elbow Joints , 2018, Front. Neurorobot..

[31]  Sangmin Lee,et al.  EMG Pattern Classification by Split and Merge Deep Belief Network , 2016, Symmetry.

[32]  Mohamad Ivan Fanany,et al.  Combining deep belief networks and bidirectional long short-term memory: Case study: Sleep stage classification , 2017, 2017 4th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI).

[33]  Dario Farina,et al.  Effect of muscle‐fiber velocity recovery function on motor unit action potential properties in voluntary contractions , 2008, Muscle & nerve.

[34]  Giancarlo Fortino,et al.  Human emotion recognition using deep belief network architecture , 2019, Inf. Fusion.

[35]  Hiroshi Okumura,et al.  Surface EMG Pattern Recognition Using Long Short-Term Memory Combined with Multilayer Perceptron , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Antonio Frisoli,et al.  A novel BCI-SSVEP based approach for control of walking in Virtual Environment using a Convolutional Neural Network , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[37]  Maarten De Vos,et al.  Multichannel Sleep Stage Classification and Transfer Learning using Convolutional Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[38]  Vitoantonio Bevilacqua,et al.  Advanced classification of Alzheimer's disease and healthy subjects based on EEG markers , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[39]  Hyeon-Min Shim,et al.  Multi-channel electromyography pattern classification using deep belief networks for enhanced user experience , 2015, Journal of Central South University.

[40]  Daniel Kudenko,et al.  Continuous Gesture Recognition from sEMG Sensor Data with Recurrent Neural Networks and Adversarial Domain Adaptation , 2018, 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[41]  Ziyun Ding,et al.  Deep Learning for Musculoskeletal Force Prediction , 2018, Annals of Biomedical Engineering.

[42]  Zhigang Zhu,et al.  Emotion Analysis Using Audio/Video, EMG and EEG: A Dataset and Comparison Study , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[43]  Khaled A. Harras,et al.  Multimodal Deep Learning Approach for Joint EEG-EMG Data Compression and Classification , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[44]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[45]  Yinghong Peng,et al.  EMG‐Based Estimation of Limb Movement Using Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[46]  Ilaria Bortone,et al.  Assessment and Rating of Movement Impairment in Parkinson's Disease Using a Low-Cost Vision-Based System , 2018, ICIC.

[47]  Minoru Fukumi,et al.  Personal Authentication by Lips EMG Using Dry Electrode and CNN , 2018, 2018 IEEE International Conference on Internet of Things and Intelligence System (IOTAIS).

[48]  Carlo Alberto Avizzano,et al.  A novel wearable system for the online assessment of risk for biomechanical load in repetitive efforts , 2016 .

[49]  Antonio Frisoli,et al.  A neuromusculoskeletal model of the human upper limb for a myoelectric exoskeleton control using a reduced number of muscles , 2015, 2015 IEEE World Haptics Conference (WHC).

[50]  Dario Farina,et al.  Online mapping of EMG signals into kinematics by autoencoding , 2018, Journal of NeuroEngineering and Rehabilitation.

[51]  Vitoantonio Bevilacqua,et al.  A supervised CAD to support telemedicine in hematology , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[52]  V. Rajinikanth,et al.  Deep neural network assisted diagnosis of time-frequency transformed electromyograms , 2018, Multimedia Tools and Applications.

[53]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[54]  Antonio Frisoli,et al.  WRES: A Novel 3 DoF WRist ExoSkeleton With Tendon-Driven Differential Transmission for Neuro-Rehabilitation and Teleoperation , 2018, IEEE Robotics and Automation Letters.