A motion-classification strategy based on sEMG-EEG signal combination for upper-limb amputees

BackgroundMost of the modern motorized prostheses are controlled with the surface electromyography (sEMG) recorded on the residual muscles of amputated limbs. However, the residual muscles are usually limited, especially after above-elbow amputations, which would not provide enough sEMG for the control of prostheses with multiple degrees of freedom. Signal fusion is a possible approach to solve the problem of insufficient control commands, where some non-EMG signals are combined with sEMG signals to provide sufficient information for motion intension decoding. In this study, a motion-classification method that combines sEMG and electroencephalography (EEG) signals were proposed and investigated, in order to improve the control performance of upper-limb prostheses.MethodsFour transhumeral amputees without any form of neurological disease were recruited in the experiments. Five motion classes including hand-open, hand-close, wrist-pronation, wrist-supination, and no-movement were specified. During the motion performances, sEMG and EEG signals were simultaneously acquired from the skin surface and scalp of the amputees, respectively. The two types of signals were independently preprocessed and then combined as a parallel control input. Four time-domain features were extracted and fed into a classifier trained by the Linear Discriminant Analysis (LDA) algorithm for motion recognition. In addition, channel selections were performed by using the Sequential Forward Selection (SFS) algorithm to optimize the performance of the proposed method.ResultsThe classification performance achieved by the fusion of sEMG and EEG signals was significantly better than that obtained by single signal source of either sEMG or EEG. An increment of more than 14% in classification accuracy was achieved when using a combination of 32-channel sEMG and 64-channel EEG. Furthermore, based on the SFS algorithm, two optimized electrode arrangements (10-channel sEMG + 10-channel EEG, 10-channel sEMG + 20-channel EEG) were obtained with classification accuracies of 84.2 and 87.0%, respectively, which were about 7.2 and 10% higher than the accuracy by using only 32-channel sEMG input.ConclusionsThis study demonstrated the feasibility of fusing sEMG and EEG signals towards improving motion classification accuracy for above-elbow amputees, which might enhance the control performances of multifunctional myoelectric prostheses in clinical application.Trial registrationThe study was approved by the ethics committee of Institutional Review Board of Shenzhen Institutes of Advanced Technology, and the reference number is SIAT-IRB-150515-H0077.

[1]  A. Geurts,et al.  Definition dependent properties of the cortical silent period in upper-extremity muscles, a methodological study , 2014, Journal of NeuroEngineering and Rehabilitation.

[2]  K. Reilly,et al.  Disentangling motor execution from motor imagery with the phantom limb. , 2012, Brain : a journal of neurology.

[3]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[4]  Oluwarotimi Williams Samuel,et al.  Towards reducing the impacts of unwanted movements on identification of motion intentions. , 2016, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[5]  Thomas M. Cover,et al.  The Best Two Independent Measurements Are Not the Two Best , 1974, IEEE Trans. Syst. Man Cybern..

[6]  Aurel Gontean,et al.  Brain-Computer Interface review , 2016, 2016 12th IEEE International Symposium on Electronics and Telecommunications (ISETC).

[7]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[8]  Fan Zhang,et al.  Continuous Locomotion-Mode Identification for Prosthetic Legs Based on Neuromuscular–Mechanical Fusion , 2011, IEEE Transactions on Biomedical Engineering.

[9]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[10]  Li Liu,et al.  Material-aware cloth simulation via constrained geometric deformation , 2013, Comput. Graph..

[11]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[12]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Herta Flor,et al.  Mirrored, imagined and executed movements differentially activate sensorimotor cortex in amputees with and without phantom limb pain , 2010, PAIN®.

[14]  Guanglin Li,et al.  New Control Strategies for Multifunctional Prostheses that Combine Electromyographic and Speech Signals , 2015, IEEE Intelligent Systems.

[15]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[16]  G. Lightbody,et al.  A comparison of quantitative EEG features for neonatal seizure detection , 2008, Clinical Neurophysiology.

[17]  Yuan-Ting Zhang,et al.  A novel channel selection method for multiple motion classification using high-density electromyography , 2014, BioMedical Engineering OnLine.

[18]  He Huang,et al.  An Analysis of EMG Electrode Configuration for Targeted Muscle Reinnervation Based Neural Machine Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Andreas Attenberger,et al.  Prostheses Control with Combined Near-Infrared and Myoelectric Signals , 2011, EUROCAST.

[20]  T. Kuiken,et al.  Neural Interfaces for Control of Upper Limb Prostheses: The State of the Art and Future Possibilities , 2011, PM & R : the journal of injury, function, and rehabilitation.

[21]  Kevin Englehart,et al.  High density electromyography data of normally limbed and transradial amputee subjects for multifunction prosthetic control. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[22]  Hui Wang,et al.  Towards determining the afferent sites of perception feedback on residual arms of amputees with transcutaneous electrical stimulation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[24]  A. Woodhouse,et al.  Phantom limb sensation , 2005, Clinical and experimental pharmacology & physiology.

[25]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  P. Geethanjali,et al.  Time domain Feature extraction and classification of EEG data for Brain Computer Interface , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[28]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[29]  Guanglin Li,et al.  Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees , 2012, Journal of NeuroEngineering and Rehabilitation.

[30]  Yoshiaki Hayashi,et al.  Towards Hybrid EEG-EMG-Based Control Approaches to be Used in Bio-robotics Applications: Current Status, Challenges and Future Directions , 2013, Paladyn J. Behav. Robotics.

[31]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[32]  Joan Lobo-Prat,et al.  Non-invasive control interfaces for intention detection in active movement-assistive devices , 2014, Journal of NeuroEngineering and Rehabilitation.

[33]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Mohammad Hassan Moradi,et al.  Evaluation of the forearm EMG signal features for the control of a prosthetic hand. , 2003, Physiological measurement.

[35]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[36]  Ahmet Omurtag,et al.  Technical and clinical analysis of microEEG: a miniature wireless EEG device designed to record high-quality EEG in the emergency department , 2012, International Journal of Emergency Medicine.

[37]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[38]  R. B. Reilly,et al.  FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection , 2010, Journal of Neuroscience Methods.

[39]  Winnie Jensen,et al.  Introduction to Neural Engineering for Motor Rehabilitation , 2013 .

[40]  Guanglin Li,et al.  Effects of non-training movements on the performance of motion classification in electromyography pattern recognition , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Guitao Cao,et al.  A random forest model based classification scheme for neonatal amplitude-integrated EEG , 2014, Biomedical engineering online.

[42]  Xinjun Sheng,et al.  Improving Myoelectric Control for Amputees through Transcranial Direct Current Stimulation , 2015, IEEE Transactions on Biomedical Engineering.

[43]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.