Recurrent Fusion of Time-Domain Descriptors Improves EMG-based Hand Movement Recognition

Controlling powered prostheses with myoelectric pattern recognition (PR) provides a natural human-robot interfacing scheme for amputees who lost their limbs. Research in this direction reveals that the challenges prohibiting reliable clinical translation of myoelectric interfaces are mainly driven by the quality of the extracted features. Hence, developing accurate and reliable feature extraction techniques is of vital importance for facilitating clinical implementation of Electromyogram (EMG) PR systems. To overcome this challenge, we proposed a combination of Range Spatial Filtering (RSF) and Recurrent Fusion of Time Domain Descriptors (RFTDD) in order to improve the classifier performance and make the prosthetic hand control more appropriate for clinical applications. RSF is used to increase the number of EMG signals available for feature extraction by focusing on the spatial information between all possible logical combinations of the physical EMG channels. RFTDD is then used to capture the temporal information by applying a recurrent data fusion process on the resulting orientation-based time-domain (TD) features, with a sigmoidal function to limit the features range and overcome the vanishing amplitudes problem. The main advantages of the proposed method include 1) its potential in capturing the temporal-spatial dependencies of the EMG signals, leading to reduced classification errors, and 2) the simplicity with which the features are extracted, as any kind of simple TD features can be adopted with this method. The performance of the proposed RFTDD is then benchmarked across many well-known TD features individually and as sets to prove the power of the RFTDD method on two EMG datasets with a total of 31 subjects. Testing results revealed an approximate reduction of 12% in classification errors across all subjects when using the proposed method against traditional feature extraction methods.Clinical Relevance—Establishing significance and importance of RFTDD, with simple time-domain features, for robust and low-cost clinical applications.

[1]  Xiangyang Zhu,et al.  Combining Improved Gray-Level Co-Occurrence Matrix With High Density Grid for Myoelectric Control Robustness to Electrode Shift , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[3]  Adel Al-Jumaily,et al.  A fusion of time-domain descriptors for improved myoelectric hand control , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[4]  Jinguo Liu,et al.  Hand gesture recognition using multimodal data fusion and multiscale parallel convolutional neural network for human–robot interaction , 2020, Expert Syst. J. Knowl. Eng..

[5]  Benoit Gosselin,et al.  Interpreting Deep Learning Features for Myoelectric Control: A Comparison With Handcrafted Features , 2020, Frontiers in Bioengineering and Biotechnology.

[6]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[7]  Guido Bugmann,et al.  Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Erik Scheme,et al.  Real-time, simultaneous myoelectric control using a convolutional neural network , 2018, PloS one.

[9]  Adel Al-Jumaily,et al.  A Framework of Temporal-Spatial Descriptors-Based Feature Extraction for Improved Myoelectric Pattern Recognition , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Xinjun Sheng,et al.  Invariant Surface EMG Feature Against Varying Contraction Level for Myoelectric Control Based on Muscle Coordination , 2015, IEEE Journal of Biomedical and Health Informatics.

[11]  Benoit Gosselin,et al.  A Low-Cost, Wireless, 3-D-Printed Custom Armband for sEMG Hand Gesture Recognition , 2019, Sensors.

[12]  Rami N. Khushaba,et al.  Correlation Analysis of Electromyogram Signals for Multiuser Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Ali Samadani,et al.  Gated Recurrent Neural Networks for EMG-Based Hand Gesture Classification. A Comparative Study , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  B. Hjorth.  EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[15]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[16]  Adel Al-Jumaily,et al.  Spatially Filtered Low-Density EMG and Time-Domain Descriptors Improves Hand Movement Recognition , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Angkoon Phinyomark,et al.  Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors , 2018, Sensors.

[18]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[19]  Kazunori Okada,et al.  Simple space-domain features for low-resolution sEMG pattern recognition , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Khairul Anam,et al.  Two-channel surface electromyography for individual and combined finger movements , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[23]  K. Englehart,et al.  Determination of optimum threshold values for EMG time domain features; a multi-dataset investigation. , 2016, Journal of neural engineering.