Classification of Task Weight During Dynamic Motion Using EEG–EMG Fusion

Musculoskeletal disorders are the biggest cause of disability worldwide and wearable mechatronic rehabilitation devices have been proposed as a potential tool for providing treatment; however, before such devices can be widely adopted, improvements in reliability are necessary. Changes in system dynamics caused by user actions, such as picking up a weight, can greatly affect control stability; hence, detecting these changes can lead to improved system performance. It is difficult to integrate conventional sensing technologies for completing this task into a wearable device in an unobtrusive way, therefore an alternative solution using bioelectrical signals, such as electroencephalography (EEG) and electromyography (EMG), to detect task weight is proposed. In this study, EEG and EMG signals were collected during dynamic elbow flexion–extension motion at different speeds, while holding different weights. These biosignals were used to develop different EEG–EMG fusion models to classify the weight the user was holding while moving. It was found that using a Weighted Average fusion method, and incorporating speed information into the model, provided the best performance, with an accuracy of 83.01 ± 6.04% when classifying three task weights. This work demonstrated the feasibility of using EEG–EMG fusion for classification of task weight during dynamic motion, which can be used to improve the adaptability and robustness of wearable mechatronic rehabilitation devices.

[1]  Hendrik Wöhrle,et al.  A Hybrid FPGA-Based System for EEG- and EMG-Based Online Movement Prediction , 2017, Sensors.

[2]  Oluwarotimi Williams Samuel,et al.  A motion-classification strategy based on sEMG-EEG signal combination for upper-limb amputees , 2017, Journal of NeuroEngineering and Rehabilitation.

[3]  Mads Jochumsen,et al.  Detection and classification of movement-related cortical potentials associated with task force and speed , 2013, Journal of neural engineering.

[4]  Daniel P. Ferris,et al.  An EEG-based study of discrete isometric and isotonic human lower limb muscle contractions , 2012, Journal of NeuroEngineering and Rehabilitation.

[5]  Ana Luisa Trejos,et al.  A wearable mechatronic brace for arm rehabilitation , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[6]  C. Kuthe,et al.  Surface electromyography based method for computing muscle strength and fatigue of biceps brachii muscle and its clinical implementation , 2018 .

[7]  I. Cosic,et al.  Power changes of EEG signals associated with muscle fatigue: the root mean square analysis of EEG bands , 2004, Proceedings of the 2004 Intelligent Sensors, Sensor Networks and Information Processing Conference, 2004..

[8]  Yue Zhou,et al.  Rehabilitative and assistive wearable mechatronic upper-limb devices: A review , 2020, Journal of rehabilitation and assistive technologies engineering.

[9]  Manjunatha Mahadevappa,et al.  EEG based motor imagery study of time domain features for classification of power and precision hand grasps , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[10]  Chris H. Q. Ding,et al.  Minimum redundancy feature selection from microarray gene expression data , 2003, Computational Systems Bioinformatics. CSB2003. Proceedings of the 2003 IEEE Bioinformatics Conference. CSB2003.

[11]  Kejun Zhang,et al.  An Upper-Limb Power-Assist Exoskeleton Using Proportional Myoelectric Control , 2014, Sensors.

[12]  Randal S. Olson,et al.  Relief-Based Feature Selection: Introduction and Review , 2017, J. Biomed. Informatics.

[13]  Robert Riener,et al.  A survey of sensor fusion methods in wearable robotics , 2015, Robotics Auton. Syst..

[14]  Catherine Marque,et al.  Evaluation of muscle force classification using shape analysis of the sEMG probability density function: a simulation study , 2014, Medical & Biological Engineering & Computing.

[15]  Junichi Ushiba,et al.  Two-stage regression of high-density scalp electroencephalograms visualizes force regulation signaling during muscle contraction , 2019, Journal of neural engineering.

[16]  Kwee-Bo Sim,et al.  Analysis the effect of PCA for feature reduction in non-stationary EEG based motor imagery of BCI system , 2014 .

[17]  Russ Greiner,et al.  Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals , 2016, Artif. Intell. Res..

[18]  Ricardo Chavarriaga,et al.  A hybrid brain–computer interface based on the fusion of electroencephalographic and electromyographic activities , 2011, Journal of neural engineering.

[19]  Ana Luisa Trejos,et al.  Evaluating Muscle Activation Models for Elbow Motion Estimation , 2018, Sensors.

[20]  Q. Yang,et al.  Linear correlation between fractal dimension of EEG signal and handgrip force , 2005, Biological Cybernetics.

[21]  Fei Meng,et al.  A Minimal Set of Electrodes for Motor Imagery BCI to Control an Assistive Device in Chronic Stroke Subjects: A Multi-Session Study , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Pornchai Phukpattaranont,et al.  Fractal analysis features for weak and single-channel upper-limb EMG signals , 2012, Expert Syst. Appl..

[23]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[24]  Anas Ibrahim,et al.  Design of User-Independent Hand Gesture Recognition Using Multilayer Perceptron Networks and Sensor Fusion Techniques , 2019, 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

[25]  Pornchai Phukpattaranont,et al.  Force classification using surface electromyography from various object lengths and wrist postures , 2019, Signal Image Video Process..

[26]  Paolo Castiglioni,et al.  What is wrong in Katz's method? Comments on: "A note on fractal dimensions of biomedical waveforms" , 2010, Comput. Biol. Medicine.

[27]  Ana Luisa Trejos,et al.  Performance Evaluation of EEG/EMG Fusion Methods for Motion Classification , 2019, 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

[28]  Sirinee Thongpanja,et al.  Mean and Median Frequency of EMG Signal to Determine Muscle Force based on Time- dependent Power Spectrum , 2013 .