sEMG-Based Neural Network Prediction Model Selection of Gesture Fatigue and Dataset Optimization

The fatigue energy consumption of independent gestures can be obtained by calculating the power spectrum of surface electromyography (sEMG) signals. The existing research studies focus on the fatigue of independent gestures, while the research studies on integrated gestures are few. However, the actual gesture operation mode is usually integrated by multiple independent gestures, so the fatigue degree of integrated gestures can be predicted by training neural network of independent gestures. Three natural gestures including browsing information, playing games, and typing are divided into nine independent gestures in this paper, and the predicted model is established and trained by calculating the energy consumption of independent gestures. The artificial neural networks (ANNs) including backpropagation (BP) neural network, recurrent neural network (RNN), and long short-term memory (LSTM) are used to predict the fatigue of gesture. The support vector machine (SVM) is used to assist verification. Mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE) are utilized to evaluate the optimal prediction model. Furthermore, the different datasets of the processed sEMG signal and its decomposed wavelet coefficients are trained, respectively, and the changes of error functions of them are compared. The experimental results show that LSTM model is more suitable for gesture fatigue prediction. The processed sEMG signals are appropriate for using as the training set the fatigue degree of one-handed gesture. It is better to use wavelet decomposition coefficients as datasets to predict the high-dimensional sEMG signals of two-handed gestures. The experimental results can be applied to predict the fatigue degree of complex human-machine interactive gestures, help to avoid unreasonable gestures, and improve the user's interactive experience.

[1]  Hanbo Zheng,et al.  A novel model based on wavelet LS-SVM integrated improved PSO algorithm for forecasting of dissolved gas contents in power transformers , 2018 .

[2]  V. Rajinikanth,et al.  Deep neural network assisted diagnosis of time-frequency transformed electromyograms , 2018, Multimedia Tools and Applications.

[3]  P. J. García Nieto,et al.  PM10 concentration forecasting in the metropolitan area of Oviedo (Northern Spain) using models based on SVM, MLP, VARMA and ARIMA: A case study. , 2018, The Science of the total environment.

[4]  Min Du,et al.  Feature Selection of Input Variables for Intelligence Joint Moment Prediction Based on Binary Particle Swarm Optimization , 2019, IEEE Access.

[5]  Baoguo Xu,et al.  sEMG Measurement Position and Feature Optimization Strategy for Gesture Recognition Based on ANOVA and Neural Networks , 2020, IEEE Access.

[6]  Bing Dong,et al.  A hybrid model approach for forecasting future residential electricity consumption , 2016 .

[7]  Jingang Yi,et al.  Real-Time Intended Knee Joint Motion Prediction by Deep-Recurrent Neural Networks , 2019, IEEE Sensors Journal.

[8]  Zhang Xuegong,et al.  INTRODUCTION TO STATISTICAL LEARNING THEORY AND SUPPORT VECTOR MACHINES , 2000 .

[9]  Wei Chen,et al.  Cross-Comparison of EMG-to-Force Methods for Multi-DoF Finger Force Prediction Using One-DoF Training , 2020, IEEE Access.

[10]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[11]  Junliang Huang,et al.  Hybrid Brain/Muscle Signals Powered Wearable Walking Exoskeleton Enhancing Motor Ability in Climbing Stairs Activity , 2019, IEEE Transactions on Medical Robotics and Bionics.

[12]  Z. Ling,et al.  Quantitative analysis modeling for the ChemCam spectral data based on laser-induced breakdown spectroscopy using convolutional neural network , 2020 .

[13]  Yinghong Peng,et al.  EMG‐Based Estimation of Limb Movement Using Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[14]  Bing Dong,et al.  A Hierarchical Approach Using Machine Learning Methods in Solar Photovoltaic Energy Production Forecasting , 2016 .

[15]  Hassan Fathabadi,et al.  Novel filter based ANN approach for short-circuit faults detection, classification and location in power transmission lines , 2016 .

[16]  Longhan Xie,et al.  A Continuous Estimation Model of Upper Limb Joint Angles by Using Surface Electromyography and Deep Learning Method , 2019, IEEE Access.

[17]  Xiaodong Zhang,et al.  Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networks , 2018, Biomed. Signal Process. Control..

[18]  Zhan Li,et al.  Real-time estimation of FES-induced joint torque with evoked EMG , 2016, Journal of NeuroEngineering and Rehabilitation.

[19]  S. G. Kahalekar,et al.  Artifacts removal from EEG signal: FLM optimization-based learning algorithm for neural network-enhanced adaptive filtering , 2017 .

[20]  Wahyu Caesarendra,et al.  Grasp Posture Control of Wearable Extra Robotic Fingers with Flex Sensors Based on Neural Network , 2020, Electronics.

[21]  Jhony K. Pontes,et al.  A flexible hierarchical approach for facial age estimation based on multiple features , 2016, Pattern Recognit..

[22]  Chen Lv,et al.  A Study on Objective Evaluation of Vehicle Steering Comfort Based on Driver's Electromyogram and Movement Trajectory , 2018, IEEE Transactions on Human-Machine Systems.

[23]  Zhang Lei,et al.  An upper limb movement estimation from electromyography by using BP neural network , 2019, Biomed. Signal Process. Control..

[24]  Mahdi Hasanipanah,et al.  Developing a least squares support vector machine for estimating the blast-induced flyrock , 2017, Engineering with Computers.

[25]  Sungzoon Cho,et al.  Semi-supervised support vector regression based on self-training with label uncertainty: An application to virtual metrology in semiconductor manufacturing , 2016, Expert Syst. Appl..

[26]  Cory Merkel,et al.  Design and Analysis of a Neuromemristive Reservoir Computing Architecture for Biosignal Processing , 2016, Front. Neurosci..

[27]  Tien-Tuan Dao,et al.  From deep learning to transfer learning for the prediction of skeletal muscle forces , 2018, Medical & Biological Engineering & Computing.

[28]  Barenya Bikash Hazarika,et al.  Modelling and forecasting of COVID-19 spread using wavelet-coupled random vector functional link networks , 2020, Applied Soft Computing.

[29]  Gongfa Li,et al.  Grasping force prediction based on sEMG signals , 2020 .

[30]  Jazuli Abdullahi,et al.  Multi-step ahead modeling of reference evapotranspiration using a multi-model approach , 2020 .

[31]  Yuehua Wu,et al.  A Comparative Assessment of Six Machine Learning Models for Prediction of Bending Force in Hot Strip Rolling Process , 2020, Metals.

[32]  Wahyu Caesarendra,et al.  Pattern Recognition of Single-Channel sEMG Signal Using PCA and ANN Method to Classify Nine Hand Movements , 2020, Symmetry.

[33]  F. Granata,et al.  Support Vector Regression for Rainfall-Runoff Modeling in Urban Drainage: A Comparison with the EPA’s Storm Water Management Model , 2016 .