Surface Electromyography-Based Action Recognition and Manipulator Control

To improve the quality of lives of disabled people, the application of intelligent prosthesis was presented and investigated. In particular, surface Electromyography (sEMG) signals succeeded in controlling the manipulator in human–machine interface, due to the fact that EMG activity belongs to one of the most widely utilized biosignals and can reflect the straightforward motion intention of humans. However, the accuracy of real-time action recognition is usually low and there is usually obvious delay in a controlling manipulator, as a result of which the task of tracking human movement precisely, cannot be guaranteed. Therefore, this study proposes a method of action recognition and manipulator control. We built a multifunctional sEMG detection and action recognition system that integrated all discrete components. A biopotential measurement analog-to-digital converter with a high signal–noise rate (SNR) was chosen to ensure the high quality of the acquired sEMG signals. The acquired data were divided into sliding windows for processing in a shorter time. Mean Absolute Value (MAV), Waveform Length (WL), and Root Mean Square (RMS) were finally extracted and we found that compared to the Genetic-Algorithm-based Support Vector Machine (GA–SVM), the back propagation (BP) neural network performed better in joint action classification. The results showed that the average accuracy of judging the 5 actions (fist clenching, hand opening, wrist flexion, wrist extension, and calling me) was up to 93.2% and the response time was within 200 ms, which achieved a simultaneous control of the manipulator. Our work took into account the action recognition accuracy and real-time performance, and realized the sEMG-based manipulator control eventually, which made it easier for people with arm disabilities to communicate better with the outside world.

[1]  Vladimir G. Dimitrov,et al.  Interpretation of EMG integral or RMS and estimates of "neuromuscular efficiency" can be misleading in fatiguing contraction. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[2]  Hui Zhang,et al.  Prediction of Protein-Protein Interactions from Amino Acid Sequences Based on Continuous and Discrete Wavelet Transform Features , 2018, Molecules.

[3]  Hamidreza Namazi,et al.  FRACTAL-BASED CLASSIFICATION OF ELECTROMYOGRAPHY (EMG) SIGNAL IN RESPONSE TO BASIC MOVEMENTS OF THE FINGERS , 2019, Fractals.

[4]  Yinfeng Fang,et al.  Simultaneous Prediction of Wrist/Hand Motion via Wearable Ultrasound Sensing , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  E. J. Tehovnik,et al.  Microstimulation of V1 delays visually guided saccades: a parametric evaluation of delay fields , 2006, Experimental Brain Research.

[6]  Yang Han,et al.  A hybrid EMD-AR model for nonlinear and non-stationary wave forecasting , 2016 .

[7]  Bing Wu,et al.  Error compensation based on BP neural network for airborne laser ranging , 2016 .

[8]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[9]  Michele Piana,et al.  Solar hard X-ray imaging by means of Compressed Sensing and Finite Isotropic Wavelet Transform , 2017, ArXiv.

[10]  Jian Yang,et al.  BP Neural Network Application Model of Predicting the Apple Hardness , 2015 .

[11]  Rahmat Budiarto,et al.  Evaluating Trust Prediction and Confusion Matrix Measures for Web Services Ranking , 2020, IEEE Access.

[12]  Erkan Bostanci,et al.  A genetic algorithm solution to the collaborative filtering problem , 2016, Expert Syst. Appl..

[13]  Mohd Hafiz Jali,et al.  Features extraction of EMG signal using time domain analysis for arm rehabilitation device , 2015 .

[14]  Chen Ling,et al.  EMG Signals based Human Action Recognition via Deep Belief Networks , 2019, IFAC-PapersOnLine.

[15]  Jiang Zhe,et al.  A Thermal Management Device for a Lower-Limb Prosthesis , 2015 .

[16]  Peng Chen,et al.  An improved SVM classifier based on double chains quantum genetic algorithm and its application in analogue circuit diagnosis , 2016, Neurocomputing.

[17]  Dingguo Zhang,et al.  sEMG Bias-Driven Functional Electrical Stimulation System for Upper-Limb Stroke Rehabilitation , 2018, IEEE Sensors Journal.

[18]  K. Nazarpour,et al.  Surface EMG Signal Classification Using a Selective Mix of Higher Order Statistics , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[19]  Tejal Udhan,et al.  Optimal time- and frequency-domain feature characterization for emotion recognition using electromyographic speech , 2016 .

[20]  Dario Farina,et al.  Adaptive Spatial Filtering of High-Density EMG for Reducing the Influence of Noise and Artefacts in Myoelectric Control , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Taehee Kim,et al.  Development of an Armband EMG Module and a Pattern Recognition Algorithm for the 5-Finger Myoelectric Hand Prosthesis , 2019, International Journal of Precision Engineering and Manufacturing.

[22]  Kenneth R. Lyons,et al.  Upper Limb Prosthesis Control for High-Level Amputees via Myoelectric Recognition of Leg Gestures , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Amit M. Joshi,et al.  Portable EMG Data Acquisition Module for Upper Limb Prosthesis Application , 2018, IEEE Sensors Journal.

[24]  Jing Mei-li Research of the Classification Method Based on Confusion Matrixes and Ensemble Learning , 2012 .

[25]  Duoqian Miao,et al.  Three-way confusion matrix for classification: A measure driven view , 2020, Inf. Sci..

[26]  Yang Ju Fast algorithm for building Delaunay triangulation based on grid division , 2016 .

[27]  G. Pucciarelli Wavelet Analysis in Volcanology: The Case of Phlegrean Fields , 2017 .

[28]  M. Descarreaux,et al.  Muscle Activity Adaptations to Spinal Tissue Creep in the Presence of Muscle Fatigue , 2016, PloS one.

[29]  李东明 Li Dong-ming,et al.  Application of BP Artificial Neural Network in Blood Glucose Prediction Based on Multi-Spectrum , 2017 .

[30]  Wang Fei Electromyography Movement Pattern Recognition Based on the Wavelet Eigenvalues and Pi-sigma Network , 2006 .

[31]  Varun Bajaj,et al.  Motor imagery tasks-based EEG signals classification using tunable-Q wavelet transform , 2019, Neural Computing and Applications.

[32]  Shu Shen,et al.  Motion Classification Based on sEMG Signals Using Deep Learning , 2019, ICML 2019.

[33]  Hanchao Yu,et al.  Learning Effective Spatial–Temporal Features for sEMG Armband-Based Gesture Recognition , 2020, IEEE Internet of Things Journal.

[34]  Jun Wu,et al.  Mechatronics modeling and vibration analysis of a 2-DOF parallel manipulator in a 5-DOF hybrid machine tool , 2018 .

[35]  Nurhazimah Nazmi,et al.  Assessment on stationarity of EMG signals with different windows size during isotonic contractions , 2017 .

[36]  T. Sasilatha,et al.  System on Chip (SOC) Based Cardiac Monitoring System Using Kalman Filtering with Fast Fourier Transform (FFT) Signal Analysis Algorithm , 2016 .

[37]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[38]  Adhi Dharma Wibawa,et al.  Klasifikasi Bahasa Isyarat Indonesia Berbasis Sinyal EMG Menggunakan Fitur Time Domain (MAV, RMS, VAR, SSI) , 2018 .

[39]  Houyuan Jiang,et al.  Network capacity management under competition , 2011, Comput. Optim. Appl..

[40]  Jawad K. Oleiwi,et al.  Study the Mechanical Properties of Polymeric Blends (SR/PMMA) Using for Maxillofacial Prosthesis Application , 2018, IOP Conference Series: Materials Science and Engineering.

[41]  L. Benini,et al.  An sEMG-Based Human–Robot Interface for Robotic Hands Using Machine Learning and Synergies , 2018, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[42]  Kyoung Kwan Ahn,et al.  A Neural Network Based Sliding Mode Control for Tracking Performance with Parameters Variation of a 3-DOF Manipulator , 2019 .

[43]  N. P. Reddy,et al.  Toward direct biocontrol using surface EMG signals: control of finger and wrist joint models. , 2007, Medical engineering & physics.

[44]  Swati Banerjee,et al.  How young is your Muscle? A Machine Learning framework for motor functional assessment with ageing by NMF based analysis of HD-sEMG signal , 2020 .