WPT-ANN and Belief Theory Based EEG/EMG Data Fusion for Movement Identification

Received: 11 July 2019 Accepted: 17 September 2019 The electromyography (EMG) and electroencephalography (EEG) are two frequently used modalities of bio-signals in the field of bio-robotics. However, it is insufficient to use a single isolated modality, due to the presence of artifacts, the lack of information, etc. To solve the problem, this paper proposes an EEG/EMG data fusion method that take advantages of both signals and overcome their drawbacks to achieve accurate identification of movements. The two types of bio-signals were preprocessed through wavelet packets transform (WPT) and classified by the artificial neural network (ANN). Then, the belief theory was introduced to allow for model uncertainty and imprecision, which adapts to the ambiguities and conflicts between sources. Experimental results show that the proposed EEG/EMG data fusion method outperformed the strategies based on only one modality. The research findings provide new impetus to bio-robotic applications.

[1]  Francisco José Madrid-Cuevas,et al.  Multi-camera people tracking using evidential filters , 2009, Int. J. Approx. Reason..

[2]  Abdulhamit Subasi,et al.  Classification of EMG signals using combined features and soft computing techniques , 2012, Appl. Soft Comput..

[3]  C. M. Duque,et al.  Data Fusion Applied to Biometric Identification – A Review , 2017 .

[4]  Robin R. Murphy,et al.  Dempster-Shafer theory for sensor fusion in autonomous mobile robots , 1998, IEEE Trans. Robotics Autom..

[5]  Yoichi Hori,et al.  A New Control Method for Power-Assisted Wheelchair Based on the Surface Myoelectric Signal , 2010, IEEE Transactions on Industrial Electronics.

[6]  Zhijun Li,et al.  Adaptive Admittance Control for an Ankle Exoskeleton Using an EMG-Driven Musculoskeletal Model , 2018, Front. Neurorobot..

[7]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[8]  Cagdas D. Onal,et al.  Towards user-centered design of a robotic prosthetic hand with EMG control interfaces , 2015, PETRA.

[9]  M. Nicolelis,et al.  Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation. , 2017, Physiological reviews.

[10]  R. Yager On the dempster-shafer framework and new combination rules , 1987, Inf. Sci..

[11]  J. Orbach Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms. , 1962 .

[12]  Francisco José Madrid-Cuevas,et al.  Shape from silhouette using Dempster-Shafer theory , 2010, Pattern Recognit..

[13]  Chiharu Ishii,et al.  A Control of Electric Wheelchair Using an EMG Based on Degree of Muscular Activity , 2016, 2016 Euromicro Conference on Digital System Design (DSD).

[14]  Alejandra Figliola,et al.  Time-frequency analysis of electroencephalogram series. III. Wavelet packets and information cost function , 1998 .

[15]  Mohamed Abouelela,et al.  EEG Mind Controlled Smart Prosthetic Arm – A Comprehensive Study , 2017 .

[16]  Chunhe Xie,et al.  Failure mode and effects analysis based on a novel fuzzy evidential method , 2017, Appl. Soft Comput..

[17]  Jie Yang,et al.  Sensor Fusion Using Dempster-Shafer Theory , 2002 .

[18]  Simona Crea,et al.  Feasibility and safety of shared EEG/EOG and vision-guided autonomous whole-arm exoskeleton control to perform activities of daily living , 2018, Scientific Reports.

[19]  Philippe Smets,et al.  Constructing the Pignistic Probability Function in a Context of Uncertainty , 1989, UAI.

[20]  Kazuo Kiguchi,et al.  Towards Control of a Transhumeral Prosthesis with EEG Signals , 2018, Bioengineering.

[21]  Seong-Whan Lee,et al.  Commanding a Brain-Controlled Wheelchair Using Steady-State Somatosensory Evoked Potentials , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Sim Kok Swee,et al.  EEG Controlled Wheelchair , 2016 .

[23]  Mousa K. Wali,et al.  Wavelet Packet Transform Based Driver Distraction Level Classification Using EEG , 2013 .

[24]  J. del R. Millán,et al.  Multimodal Fusion of Muscle and Brain Signals for a Hybrid-BCI , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[25]  Abdelghani Chibani,et al.  New evidence combination rules for activity recognition in smart home , 2013, Proceedings of the 16th International Conference on Information Fusion.

[26]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[27]  Nasser Kehtarnavaz,et al.  Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors , 2015, IEEE Transactions on Human-Machine Systems.

[28]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Chong Liu,et al.  Urban Change Detection Based on Dempster-Shafer Theory for Multitemporal Very High-Resolution Imagery , 2018, Remote. Sens..

[30]  C. Gargour,et al.  A short introduction to wavelets and their applications , 2009, IEEE Circuits and Systems Magazine.

[31]  Mohamed Guiatni,et al.  A combined EEG and EOG signals based wheelchair control in virtual environment , 2017, 2017 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B).

[32]  Ying Sun,et al.  Rehabilitation Training for Leg Based on EEG-EMG Fusion , 2017, ICIRA.

[33]  Eric Lefebvre,et al.  Advances and challenges in multisensor data and information processing , 2007 .

[34]  Trieu Phat Luu,et al.  Brain–machine interfaces for controlling lower-limb powered robotic systems , 2018, Journal of neural engineering.

[35]  Yoshiaki Hayashi,et al.  Towards Hybrid EEG-EMG-Based Control Approaches to be Used in Bio-robotics Applications: Current Status, Challenges and Future Directions , 2013, Paladyn J. Behav. Robotics.

[36]  R. Haddad,et al.  Multiresolution Signal Decomposition: Transforms, Subbands, and Wavelets , 1992 .

[37]  Ricardo Chavarriaga,et al.  A hybrid brain–computer interface based on the fusion of electroencephalographic and electromyographic activities , 2011, Journal of neural engineering.

[38]  Shubhajit Roy Chowdhury,et al.  Accuracy Enhancement in a Fuzzy Expert Decision Making System Through Appropriate Determination of Membership Functions and Its Application in a Medical Diagnostic Decision Making System , 2012, Journal of Medical Systems.

[39]  Ronald R. Yager,et al.  Classic Works of the Dempster-Shafer Theory of Belief Functions , 2010, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[40]  P. Smets Data fusion in the transferable belief model , 2000, Proceedings of the Third International Conference on Information Fusion.

[41]  Ho Chit Siu,et al.  Implementation of a Surface Electromyography-Based Upper Extremity Exoskeleton Controller Using Learning from Demonstration , 2018, Sensors.

[42]  Anna T. Winslow,et al.  Evaluation of EMG pattern recognition for upper limb prosthesis control: a case study in comparison with direct myoelectric control , 2018, Journal of NeuroEngineering and Rehabilitation.

[43]  Alberto Borboni,et al.  EEG-Based Control for Upper and Lower Limb Exoskeletons and Prostheses: A Systematic Review , 2018, Sensors.

[44]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[45]  Wilbert van Norden,et al.  Applying the PCR6 Rule of combination in real time classification systems , 2009, 2009 12th International Conference on Information Fusion.

[46]  Rampriya Mahendran,et al.  EMG signal based control of an intelligent wheelchair , 2014, 2014 International Conference on Communication and Signal Processing.

[47]  Xiaoling Chen,et al.  Identification Method of Human Movement Intention based on the Fusion Feature of EEG and EMG , .

[48]  Dibo Hou,et al.  Detection of water-quality contamination events based on multi-sensor fusion using an extented Dempster–Shafer method , 2013 .

[49]  Didier Dubois,et al.  Qualitative decision theory: from savage's axioms to nonmonotonic reasoning , 2002, JACM.

[50]  Antonio Frisoli,et al.  An EMG-Controlled Robotic Hand Exoskeleton for Bilateral Rehabilitation , 2015, IEEE Transactions on Haptics.