Simultaneous Estimations of Joint Angle and Torque in Interactions with Environments using EMG

We develop a decoding technique that estimates both the position and torque of a joint of the limb in interaction with an environment based on activities of the agonist-antagonist pair of muscles using electromyography in real time. The long short-term memory (LSTM) network is employed as the core processor of the proposed technique that is capable of learning time series of a long-time span with varying time lags. A validation that is conducted on the wrist joint shows that the decoding approach provides an agreement of greater than 95% in kinetics (i.e. torque) estimation and an agreement of greater than 85% in kinematics (i.e. angle) estimation, between the actual and estimated variables, during interactions with an environment. Also demonstrated is the fact that the proposed decoding method inherits the strengths of the LSTM network in terms of the capability of learning EMG signals and the corresponding responses with time dependency.

[1]  Gun Rae Cho,et al.  A Robust Impedance Controller Design for Series Elastic Actuators using the Singular Perturbation Theory , 2020, IEEE/ASME Transactions on Mechatronics.

[2]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[4]  Yinghong Peng,et al.  EMG‐Based Estimation of Limb Movement Using Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[5]  I. Kingma,et al.  Towards optimal multi-channel EMG electrode configurations in muscle force estimation: a high density EMG study. , 2005, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[6]  Xun Niu,et al.  Power spectral analysis of surface electromyography (EMG) at matched contraction levels of the first dorsal interosseous muscle in stroke survivors , 2014, Clinical Neurophysiology.

[7]  Yupeng Ren,et al.  EMG-Based Continuous and Simultaneous Estimation of Arm Kinematics in Able-Bodied Individuals and Stroke Survivors , 2017, Front. Neurosci..

[8]  R. Kirsch,et al.  EMG-based prediction of shoulder and elbow kinematics in able-bodied and spinal cord injured individuals. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  Phillip J. Hendrickson,et al.  Predicting EMG with generalized Volterra kernel model , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Lorenzo Masia,et al.  Position and stiffness modulation of a wrist haptic device using myoelectric interface , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[11]  Stefano Stramigioli,et al.  Stiffness and position control of a prosthetic wrist by means of an EMG interface , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[12]  R. Glisson,et al.  Functional wrist motion: a biomechanical study. , 1985, The Journal of hand surgery.

[13]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[15]  Christian Wolf,et al.  Sequential Deep Learning for Human Action Recognition , 2011, HBU.

[16]  Joris M. Lambrecht,et al.  Electromyogram-based neural network control of transhumeral prostheses. , 2011, Journal of rehabilitation research and development.

[17]  P. Chang,et al.  A new chaotic attractor and its robust function projective synchronization , 2013 .

[18]  Qiang Huang,et al.  One-Channel Surface Electromyography Decomposition for Muscle Force Estimation , 2018, Front. Neurorobot..

[19]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[20]  Corso Elvezia Bridging Long Time Lags by Weight Guessing and \long Short Term Memory" , 1996 .

[21]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Ann M. Simon,et al.  A comparison of proportional control methods for pattern recognition control , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[24]  Dario Farina,et al.  Effect of arm position on the prediction of kinematics from EMG in amputees , 2012, Medical & Biological Engineering & Computing.

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Volkan Patoglu,et al.  Tele-impedance control of a variable stiffness prosthetic hand , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[27]  Jitendra Kumar,et al.  Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters , 2018 .

[28]  A. Palmer,et al.  Frequency spectrum analysis of wrist motion for activities of daily living , 1989, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.