Continuous estimation of upper limb joint angle from sEMG signals based on SCA-LSTM deep learning approach

Abstract Robotic arm control has drawn a lot of attention along with the development of industrialization. The methods based on myoelectric pattern recognition have been proposed with multiple degrees of freedom for years. While these methods can support the actuation of several classes of discrete movements sequentially, they do not allow simultaneous control of multiple movements in a continuous manner like natural arms. In this study, we proposed a short connected autoencoder long short-term memory (SCA-LSTM) based simultaneous and proportional (SP) scheme that estimates continuous arm movements using kinematic information extracted from surface electromyogram (sEMG) recordings. The sEMG signals corresponding to seven classes of shoulder-elbow joint angle movements acquired from eleven participants were preprocessed using max root mean square envelope. Afterwards, the proposed SCA-LSTM model and two commonly applied models, namely, multilayer perceptrons (MLPs) and convolutional neural network (CNN), were trained and tested using the preprocessed data for continuous estimation of arm movements. Our experimental results showed that the proposed SCA-LSTM model could achieve a significantly higher estimation accuracy of approximately 95.7% that is consistently stable across the subjects in comparison to the CNN (86.8%) and MLP (83.4%) models. These results suggest that the proposed SCA-LSTM would be a promising model for continuous estimation of upper limb movements from sEMG signals for prosthetic control.

[1]  Cheng-Yuan Liou,et al.  Autoencoder for words , 2014, Neurocomputing.

[2]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[4]  Sukhan Lee,et al.  The control of a prosthetic arm by EMG pattern recognition , 1984 .

[5]  Dario Farina,et al.  Robust extraction of basis functions for simultaneous and proportional myoelectric control via sparse non-negative matrix factorization , 2018, Journal of neural engineering.

[6]  Zeung nam Bien,et al.  New EMG pattern Recognition based on Soft Computing Techniques and Its Application to Control of a Rehabilitation Robotic Arm , 2000 .

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Tetsuya Ogata,et al.  Representation Learning of Logic Words by an RNN: From Word Sequences to Robot Actions , 2017, Front. Neurorobot..

[9]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[11]  Dario Farina,et al.  Bayesian Filtering of Surface EMG for Accurate Simultaneous and Proportional Prosthetic Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Philip A. Parker,et al.  Signal Processing for Proportional Myoelectric Control , 1984, IEEE Transactions on Biomedical Engineering.

[13]  Winnie Jensen,et al.  Simultaneous and Proportional Force Estimation in Multiple Degrees of Freedom From Intramuscular EMG , 2012, IEEE Transactions on Biomedical Engineering.

[14]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[15]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[16]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[17]  S. Parasuraman,et al.  An EMG-driven musculoskeletal model for robot assisted stroke rehabilitation system using sliding mode control , 2010, 7th International Symposium on Mechatronics and its Applications.

[18]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[19]  Hong Liu,et al.  Robust EMG pattern recognition in the presence of confounding factors: features, classifiers and adaptive learning , 2018, Expert Syst. Appl..

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Guan-Chun Luh,et al.  Muscle-gesture robot hand control based on sEMG signals with wavelet transform features and neural network classifier , 2016, 2016 International Conference on Machine Learning and Cybernetics (ICMLC).

[23]  He Huang,et al.  Musculoskeletal model predicts multi-joint wrist and hand movement from limited EMG control signals , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Patrick van der Smagt,et al.  Evidence of muscle synergies during human grasping , 2013, Biological Cybernetics.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Yan Xiao,et al.  Machine translation-based bug localization technique for bridging lexical gap , 2018, Inf. Softw. Technol..

[28]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[29]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[30]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[32]  Aurel Gontean,et al.  Controlling a robotic arm in the 3D space with stereo vision , 2013, 2013 21st Telecommunications Forum Telfor (TELFOR).

[33]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[34]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Yee Mon Aung,et al.  Estimation of Upper Limb Joint Angle Using Surface EMG Signal , 2013 .

[36]  Roland Szabó,et al.  Full 3D Robotic Arm Control with Stereo Cameras Made in LabVIEW , 2013, FedCSIS.