Joint torque estimation for the human arm from sEMG using backpropagation neural networks and autoencoders

Abstract Estimation of joint torque for human arm is important to help a robot adapt to a human partner in human-robot collaboration. In this study, we proposed an estimating model combined the back propagation neural networks (BPNN) and autoencoders to estimate the joint torque of human arm from surface electromyography (sEMG). Autoencoders were used to select the appropriate features of sEMG signals. The joint angles obtained from a vision-system were combined with the sEMG features, which were set as the input data for the estimating model. A 4-layer BPNN was used to map the sEMG features to the joint torque. The proposed estimating model was compared to other five models through experiments by estimating shoulder joint torque and elbow joint torque. The root mean square error and correlation coefficient between the estimated joint torque value and a theoretic value calculated by inverse dynamics were used to evaluate the proposed model. The root mean square error and correlation coefficient for the proposed model is 1.3842 and 0.9439, respectively. Experimental results showed that the proposed model can derive lower root mean square error and higher correlation coefficient by comparing to other models, which indicates the proposed model can estimate more accurate joint torque from sEMG than other models.

[1]  Nianfeng Wang,et al.  The recognition of multi-finger prehensile postures using LDA , 2013, Biomed. Signal Process. Control..

[2]  Dingguo Zhang,et al.  A Practical and Adaptive Method to Achieve EMG-Based Torque Estimation for a Robotic Exoskeleton , 2019, IEEE/ASME Transactions on Mechatronics.

[3]  Chang-Soo Han,et al.  Development of a muscle circumference sensor to estimate torque of the human elbow joint , 2014 .

[4]  Wenzhong Guo,et al.  An Overview of Unsupervised Deep Feature Representation for Text Categorization , 2019, IEEE Transactions on Computational Social Systems.

[5]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[6]  Gentiane Venture,et al.  Human elbow joint torque estimation during dynamic movements with moment arm compensation method , 2014 .

[7]  Shuxiang Guo,et al.  Comparison of sEMG-Based Feature Extraction and Motion Classification Methods for Upper-Limb Movement , 2015, Sensors.

[8]  Dilip Kumar Pratihar,et al.  Estimation of Joint Torque and Power Consumption During Sit-to-Stand Motion of Human-being Using a Genetic Algorithm , 2016, KES.

[9]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  J. Ota,et al.  Development of an SEMG-Handgrip Force Model Based on Cross Model Selection , 2019, IEEE Sensors Journal.

[11]  Charles Pontonnier,et al.  Inverse dynamics method using optimization techniques for the estimation of muscles forces involved in the elbow motion , 2009 .

[12]  Shigang Li,et al.  Torque Estimation of Elbow Joint Using a Mechanomyogram Signal Based Biomechanical Model , 2018, 2018 12th France-Japan and 10th Europe-Asia Congress on Mechatronics.

[13]  T. Fukunaga,et al.  Muscle volume is a major determinant of joint torque in humans. , 2001, Acta physiologica Scandinavica.

[14]  Wei Li,et al.  sEMG-Based Identification of Hand Motion Commands Using Wavelet Neural Network Combined With Discrete Wavelet Transform , 2016, IEEE Transactions on Industrial Electronics.

[15]  Wenhui Wang,et al.  Investigating improvements to neural network based EMG to joint torque estimation , 2011, Paladyn J. Behav. Robotics.

[16]  Jianda Han,et al.  Continuous Estimation of Human Multi-Joint Angles From sEMG Using a State-Space Model. , 2017, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[17]  M. A. Serna,et al.  A modified Lagrangian formulation for the dynamic analysis of constrained mechanical systems , 1988 .

[18]  Ozkan Celik,et al.  Comparison of Human-Robot Interaction Torque Estimation Methods in a Wrist Rehabilitation Exoskeleton , 2019, J. Intell. Robotic Syst..

[19]  Hartmut Geyer,et al.  Control of a Powered Ankle–Foot Prosthesis Based on a Neuromuscular Model , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Xianmin Zhang,et al.  Estimation of human arm motion based on sEMG in human-robot cooperative manipulation , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[21]  Sanem Sariel,et al.  Cognition-Enabled Robot Manipulation in Human Environments: Requirements, Recent Work, and Open Problems , 2017, IEEE Robotics & Automation Magazine.

[22]  Mickaël Begon,et al.  Influence of Shoulder Kinematic Estimate on Joint and Muscle Mechanics Predicted by Musculoskeletal Model , 2018, IEEE Transactions on Biomedical Engineering.

[23]  Z. H. Bohari,et al.  Joint Torque Estimation Model of sEMG Signal for Arm Rehabilitation Device Using Artificial Neural Network Techniques , 2015 .

[24]  Cuntai Guan,et al.  A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration , 2019, Biomed. Signal Process. Control..

[25]  Scott L. Delp,et al.  Full-Body Musculoskeletal Model for Muscle-Driven Simulation of Human Gait , 2016, IEEE Transactions on Biomedical Engineering.

[26]  Doyoung Jeon,et al.  A Method to Accurately Estimate the Muscular Torques of Human Wearing Exoskeletons by Torque Sensors , 2015, Sensors.

[27]  Raziel Riemer,et al.  Improving joint torque calculations: optimization-based inverse dynamics to reduce the effect of motion errors. , 2008, Journal of biomechanics.

[28]  Davide Piovesan,et al.  Comparative analysis of methods for estimating arm segment parameters and joint torques from inverse dynamics. , 2011, Journal of biomechanical engineering.

[29]  Minoru Asada,et al.  Efficient human-robot collaboration: When should a robot take initiative? , 2017, Int. J. Robotics Res..

[30]  Andrew J. McDaid,et al.  Neuromuscular characterisation in Cerebral Palsy using hybrid Hill-type models on isometric contractions , 2018, Comput. Biol. Medicine.

[31]  Dario Farina,et al.  A Multi-Class Proportional Myocontrol Algorithm for Upper Limb Prosthesis Control: Validation in Real-Life Scenarios on Amputees , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Mantian Li,et al.  Towards Online Estimation of Human Joint Muscular Torque with a Lower Limb Exoskeleton Robot , 2018, Applied Sciences.

[33]  M. Kent The Oxford Dictionary of Sports Science and Medicine , 1998 .

[34]  Rong Song,et al.  Movement Performance of Human–Robot Cooperation Control Based on EMG-Driven Hill-Type and Proportional Models for an Ankle Power-Assist Exoskeleton Robot , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Doyoung Jeon,et al.  Estimation of the User’s Muscular Torque for an Over-ground Gait Rehabilitation Robot Using Torque and Insole Pressure Sensors , 2018 .

[36]  Feng Duan,et al.  Recognizing the Gradual Changes in sEMG Characteristics Based on Incremental Learning of Wavelet Neural Network Ensemble , 2017, IEEE Transactions on Industrial Electronics.

[37]  Jin Hu,et al.  iLeg—A Lower Limb Rehabilitation Robot: A Proof of Concept , 2016, IEEE Transactions on Human-Machine Systems.

[38]  K. Guelton,et al.  An alternative to inverse dynamics joint torques estimation in human stance based on a Takagi–Sugeno unknown-inputs observer in the descriptor form , 2008 .

[39]  Hidenori Ishihara,et al.  Muscle Strength Assessment System Using sEMG-Based Force Prediction Method for Wrist Joint , 2016 .

[40]  J. Challis,et al.  Quantification of the uncertainties in resultant joint moments computed in a dynamic activity. , 1996, Journal of sports sciences.

[41]  Changmok Choi,et al.  Real-time pinch force estimation by surface electromyography using an artificial neural network. , 2010, Medical engineering & physics.