Generalized EMG-based isometric contact force estimation using a deep learning approach

Abstract EMG-based force estimation is generally done in a subject specific manner. In this paper, we explore force estimation in a manner generalizable across individuals, where the EMG signals are recorded from the long head and the short head of biceps brachii, and the brachioradialis, under isometric elbow flexion, while the contact force is measured at the wrist. Deep convolutional neural networks (CNN), which utilize feature-level fusion of representations learned from high-density (HD) EMG in the time and frequency domains, are developed. The performance of the proposed solution (CNN-FLF) is compared to a number of baselines including CNNs with input-level fusion of HD-EMG data in the time and frequency domains, CNNs which estimate force from time or frequency domain EMG data separately, and a number of classical machine learning methods, which use hand-crafted features extracted from the EMG signals. Results show that the CNN-FLF, with optimized hyper-parameters, outperformed all other methods, giving a normalized mean squared error for estimated force of 1.6±3.69% (mean±SD). In visualization of the extracted features for the different CNN models, it is apparent that the final features of the CNN-FLF enable finding an accurate regressive relationship with output force levels.

[1]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[2]  Panagiotis K. Artemiadis,et al.  A Switching Regime Model for the EMG-Based Control of a Robot Arm , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  P. Mousavi,et al.  Surface EMG force modeling with joint angle based calibration. , 2013, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[4]  F. Mobasser,et al.  A Comparative Approach to Hand Force Estimation using Artificial Neural Networks , 2012, Biomedical engineering and computational biology.

[5]  E. Morin,et al.  Improving Wrist Force Estimation With Surface EMG During Isometric Contractions , 2018 .

[6]  Andreas Daffertshofer,et al.  Improving EMG-based muscle force estimation by using a high-density EMG grid and principal component analysis , 2006, IEEE Transactions on Biomedical Engineering.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Thomas Schmitz-Rode,et al.  Surface electromyography and muscle force: limits in sEMG-force relationship and new approaches for applications. , 2009, Clinical biomechanics.

[9]  Bingke Zhang,et al.  The estimation of grasping force based on the feature extracted from EMG signals , 2016, 2016 IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC).

[10]  D. Lloyd,et al.  An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. , 2003, Journal of biomechanics.

[11]  Carlo Menon,et al.  Comparison of regression models for estimation of isometric wrist joint torques using surface electromyography , 2011, Journal of NeuroEngineering and Rehabilitation.

[12]  Ernest Nlandu Kamavuako,et al.  Combined surface and intramuscular EMG for improved real-time myoelectric control performance , 2014, Biomed. Signal Process. Control..

[13]  Keyvan Hashtrudi-Zaad,et al.  Estimation of Elbow-Induced Wrist Force With EMG Signals Using Fast Orthogonal Search , 2007, IEEE Transactions on Biomedical Engineering.

[14]  M. J. Korenberg,et al.  A robust orthogonal algorithm for system identification and time-series analysis , 1989, Biological Cybernetics.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Chee-Meng Chew,et al.  Muscle force estimation with surface EMG during dynamic muscle contractions: A wavelet and ANN based approach , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[18]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[19]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[20]  Evelyn Morin,et al.  An Investigation of Dimensionality Reduction Techniques for EMG-based Force Estimation , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Ernest Nlandu Kamavuako,et al.  Biomedical Signal Processing and Control , 2022 .

[22]  Pierre Portero,et al.  Repeatability of surface EMG parameters at various isometric contraction levels and during fatigue using bipolar and Laplacian electrode configurations. , 2005, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[23]  E. Clancy,et al.  Comparison of Constant-Posture Force-Varying EMG-Force Dynamic Models About the Elbow , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Pu Liu,et al.  Identification of Constant-Posture EMG–Torque Relationship About the Elbow Using Nonlinear Dynamic Models , 2012, IEEE Transactions on Biomedical Engineering.

[25]  I. Kingma,et al.  Towards optimal multi-channel EMG electrode configurations in muscle force estimation: a high density EMG study. , 2005, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[26]  Evelyn Morin,et al.  Force Modelling of Upper Limb Biomechanics Using Ensemble Fast Orthogonal Search on High-Density Electromyography , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  N. Meinshausen,et al.  High-dimensional graphs and variable selection with the Lasso , 2006, math/0608017.

[28]  Chenyun Dai,et al.  Data Management for Transfer Learning Approaches to Elbow EMG-Torque Modeling , 2021, IEEE Transactions on Biomedical Engineering.

[29]  Xinjun Sheng,et al.  Multi-DoF continuous estimation for wrist torques using stacked autoencoder , 2020, Biomed. Signal Process. Control..

[30]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Neelesh Kumar,et al.  Exoskeleton Device for Rehabilitation of Stroke Patients Using SEMG during Isometric Contraction , 2011 .

[32]  Evelyn Morin,et al.  EMG-based Force Estimation using Artificial Neural Networks , 2019 .

[33]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[34]  J. Saunders,et al.  Relation of human electromyogram to muscular tension. , 1952, Electroencephalography and clinical neurophysiology.

[35]  Nianfeng Wang,et al.  Design and Myoelectric Control of an Anthropomorphic Prosthetic Hand , 2017 .

[36]  F. J. Alonso,et al.  A comparison among different Hill-type contraction dynamics formulations for muscle force estimation , 2016 .

[37]  A. Hill The heat of shortening and the dynamic constants of muscle , 1938 .

[38]  Evelyn Morin,et al.  Use of the Fast Orthogonal Search Method to Estimate Optimal Joint Angle For Upper Limb Hill-Muscle Models , 2010, IEEE Transactions on Biomedical Engineering.

[39]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[40]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[41]  Liang Wang,et al.  Influence of Different Feature Selection Methods on EMG Pattern Recognition , 2019, 2019 IEEE International Conference on Mechatronics and Automation (ICMA).

[42]  Karim Jerbi,et al.  Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines , 2015, Journal of Neuroscience Methods.

[43]  Benno M Nigg,et al.  Muscle tuning during running: implications of an un-tuned landing. , 2006, Journal of biomechanical engineering.

[44]  Ali Etemad,et al.  Classification of Hand Movements From EEG Using a Deep Attention-Based LSTM Network , 2019, IEEE Sensors Journal.

[45]  S. Ali Etemad,et al.  Balance-based time-frequency features for discrimination of young and elderly subjects using unsupervised methods , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[46]  Evelyn Morin,et al.  Automated Channel Selection in High-Density sEMG for Improved Force Estimation , 2020, Sensors.

[47]  Adriano de Oliveira Andrade,et al.  On the relationship between features extracted from EMG and force for constant and dynamic protocols , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Erik Scheme,et al.  Regression convolutional neural network for improved simultaneous EMG control , 2019, Journal of neural engineering.

[49]  Roberto Merletti,et al.  Atlas of Muscle Innervation Zones , 2012, Springer Milan.

[50]  Roberto Merletti,et al.  Motor unit recruitment strategies investigated by surface EMG variables. , 2002, Journal of applied physiology.

[51]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[52]  S. Karlsson,et al.  Mean frequency and signal amplitude of the surface EMG of the quadriceps muscles increase with increasing torque--a study using the continuous wavelet transform. , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[53]  Xun Chen,et al.  Feasibility Study of Advanced Neural Networks Applied to sEMG-Based Force Estimation , 2018, Sensors.

[54]  A. Etemad,et al.  Self-Supervised ECG Representation Learning for Emotion Recognition , 2020, IEEE Transactions on Affective Computing.

[55]  Todd A. Kuiken,et al.  Evaluating EMG Feature and Classifier Selection for Application to Partial-Hand Prosthesis Control , 2016, Front. Neurorobot..

[56]  E.A. Clancy,et al.  Electromyogram (EMG) amplitude estimation and joint torque model performance , 2005, Proceedings of the IEEE 31st Annual Northeast Bioengineering Conference, 2005..