Surface-EMG based Wrist Kinematics Estimation using Convolutional Neural Network

In the past decades, classical machine learning (ML) methods have been widely investigated in wrist kinematics estimation for the control of prosthetic hands. Currently deeper structures have shown great potential to further improve prediction accuracy. In this paper we present a single stream convolutional neural network (CNN) for mapping surface electromyography (sEMG) to wrist angles within three degrees-of-freedom (DOFs). Two types of two dimensional (2D) sEMG images are constructed in time domain and spectrum as CNN inputs, respectively. Six typical linear and nonlinear ML models are implemented for comparison, where four efficient time-spatial hand-crafted features are extracted to represent feature engineering. Experiment results with four able-bodied participants illustrate that CNN with 2D spectrum sEMG images can achieve highest accuracy in most testing sessions. In other sessions, it is still competitive to the most promising ML techniques. The core strength of deep learning (DL), i.e. feature learning via deep structures and efficient algorithms, is verified to be more powerful than classical feature engineering, particularly in smaller datasets.

[1]  Peter Onyisi,et al.  How easily can neural networks learn relativity? , 2018, Journal of Physics: Conference Series.

[2]  Erik J. Scheme,et al.  Support Vector Regression for Improved Real-Time, Simultaneous Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Zyad Shaaban,et al.  Data Mining: A Preprocessing Engine , 2006 .

[4]  Manjunatha Mahadevappa,et al.  Estimation of continuous and constraint-free 3 DoF wrist movements from surface electromyogram signal using kernel recursive least square tracker , 2018, Biomed. Signal Process. Control..

[5]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Dario Farina,et al.  Robust extraction of basis functions for simultaneous and proportional myoelectric control via sparse non-negative matrix factorization , 2018, Journal of neural engineering.

[7]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[8]  Yinghong Peng,et al.  Sensor Fusion for Myoelectric Control Based on Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[9]  Guangjun Liu,et al.  Comparisons on different sEMG-features with dimension-reduction methods in hand motion recognition , 2016, 2016 International Conference on Advanced Robotics and Mechatronics (ICARM).

[10]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[11]  Dario Farina,et al.  Simultaneous control of multiple functions of bionic hand prostheses: Performance and robustness in end users , 2018, Science Robotics.

[12]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[13]  Erik J. Scheme,et al.  Bagged regression trees for simultaneous myoelectric force estimation , 2014, 2014 22nd Iranian Conference on Electrical Engineering (ICEE).

[14]  Ryu Kato,et al.  Control method for myoelectric hand using convolutional neural network to simplify learning of EMG signals , 2017, 2017 IEEE International Conference on Cyborg and Bionic Systems (CBS).

[15]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[16]  Feng Jiang,et al.  sEMG-Based Gesture Recognition with Convolution Neural Networks , 2018, Sustainability.