Single-Trial Classification of Different Movements on One Arm Based on ERD/ERS and Corticomuscular Coherence

Electroencephalography (EEG)-based brain-machine interface (BMI) is widely applied to control external devices like a wheel chair or a robotic arm, to restore motor function. EEG is useful to distinguish between left arm and right arm movements, however, it is difficult to classify the different movements on one arm. In this paper, a two-step single-trial classification method is proposed to recognize three movements (make a fist, hand extension and elbow flexion) of left and right arms: (1) distinguish between left arm and right arm movements by decoding event-related (de) synchronization (ERD/ERS) and (2) recognize the specific movement of this arm using corticomuscular coherence as features. Four healthy subjects are employed in a cue-based motor execution (ME) experiment. In Step one, ERD and post-movement ERS are found over the contralateral sensorimotor area; in Step two, for each movement, only the beta-band coherence between C3/C4 and the corresponding agonistic muscle is significant. The classification results show the best accuracy of Step one and Step two is 88.10% and 93.33%, respectively. This proposed method achieves a total accuracy of 82.22%. This study demonstrates that our method is effective to classify different movements on one arm, and provides the theoretic basis and technical support for the practical development of BMI-based motor restoration applications.

[1]  G. Pfurtscheller,et al.  Motor imagery and action observation: Modulation of sensorimotor brain rhythms during mental control of a brain–computer interface , 2009, Clinical Neurophysiology.

[2]  M Hallett,et al.  Coherence Between Cortical and Muscular Activities After Subcortical Stroke , 2001, Stroke.

[3]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[4]  Cuntai Guan,et al.  EEG-Based Strategies to Detect Motor Imagery for Control and Rehabilitation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[6]  Bin He,et al.  EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks , 2016, IEEE Transactions on Biomedical Engineering.

[7]  Xingyu Wang,et al.  Sparse Bayesian Classification of EEG for Brain–Computer Interface , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  M. Hallett,et al.  Force level modulates human cortical oscillatory activities , 1999, Neuroscience Letters.

[9]  Isabelle Bloch,et al.  Time-frequency optimization for discrimination between imagination of right and left hand movements based on two bipolar electroencephalography channels , 2014, EURASIP Journal on Advances in Signal Processing.

[10]  Chao Li,et al.  A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control , 2016, Sensors.

[11]  Shouqian Sun,et al.  Single-trial EEG classification of motor imagery using deep convolutional neural networks , 2017 .

[12]  Jieyu Zhao,et al.  Transferring Common Spatial Filters With Semi-Supervised Learning for Zero-Training Motor Imagery Brain-Computer Interface , 2019, IEEE Access.

[13]  G. Pfurtscheller,et al.  Could the beta rebound in the EEG be suitable to realize a “brain switch”? , 2009, Clinical Neurophysiology.

[14]  Dezhi Zheng,et al.  Domain Transfer Multiple Kernel Boosting for Classification of EEG Motor Imagery Signals , 2019, IEEE Access.

[15]  A. K. Das,et al.  A discriminative subject-specific spatio-spectral filter selection approach for EEG based motor-imagery task classification , 2016, Expert Syst. Appl..

[16]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[17]  Marco J. M. Hoozemans Prediction of handgrip forces using surface EMG , 2003 .

[18]  Hans-Jochen Heinze,et al.  Single trial discrimination of individual finger movements on one hand: A combined MEG and EEG study , 2012, NeuroImage.

[19]  Kentaro Yamanaka Performance and cortical EEG dynamics during bimanual go/stop tasks in right- and left-handed individuals , 2014 .

[20]  Vivek Prabhakaran,et al.  Ipsilesional Mu Rhythm Desynchronization and Changes in Motor Behavior Following Post Stroke BCI Intervention for Motor Rehabilitation , 2019, Front. Neurosci..

[21]  M. Hallett,et al.  A high performance sensorimotor beta rhythm-based brain–computer interface associated with human natural motor behavior , 2008, Journal of neural engineering.

[22]  J. Millán,et al.  Brain-actuated functional electrical stimulation elicits lasting arm motor recovery after stroke , 2018, Nature Communications.

[23]  P. Hodges,et al.  Experimental Pain Decreases Corticomuscular Coherence in a Force- But Not a Position-Control Task. , 2019, The journal of pain : official journal of the American Pain Society.

[24]  Yu Zhang,et al.  EEG classification using sparse Bayesian extreme learning machine for brain–computer interface , 2018, Neural Computing and Applications.

[25]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[26]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[28]  Kun Wang,et al.  Recognizing Motor Imagery Between Hand and Forearm in the Same Limb in a Hybrid Brain Computer Interface Paradigm: An Online Study , 2019, IEEE Access.

[29]  D. N. Tibarewala,et al.  Comparing ANN, LDA, QDA, KNN and SVM algorithms in classifying relaxed and stressful mental state from two-channel prefrontal EEG data , 2012, Int. J. Artif. Intell. Soft Comput..

[30]  Dennis J. McFarland,et al.  Brain-computer interface (BCI) operation: signal and noise during early training sessions , 2005, Clinical Neurophysiology.

[31]  Akio Kimura,et al.  Muscle fatigue-induced enhancement of corticomuscular coherence following sustained submaximal isometric contraction of the tibialis anterior muscle , 2011, Neuroscience Research.

[32]  Muhammad Abd-El-Barr,et al.  Long-term Training With a Brain-Machine Interface-Based Gait Protocol Induces Partial Neurological Recovery in Paraplegic Patients. , 2016, Neurosurgery.

[33]  Jar Lenman Biofeedback, Principles, and Practice for Clinicians , 1980 .

[34]  Eduardo Iáñez,et al.  Improving Real-Time Lower Limb Motor Imagery Detection Using tDCS and an Exoskeleton , 2018, Front. Neurosci..

[35]  Jean Gotman,et al.  Low-frequency theta oscillations in the human hippocampus during real-world and virtual navigation , 2017, Nature Communications.

[36]  M. Hallett,et al.  Asymmetric spatiotemporal patterns of event-related desynchronization preceding voluntary sequential finger movements: a high-resolution EEG study , 2005, Clinical Neurophysiology.

[37]  Yu Zhang,et al.  Sparse Group Representation Model for Motor Imagery EEG Classification , 2019, IEEE Journal of Biomedical and Health Informatics.

[38]  Tatsuya Mima,et al.  Cortical-muscular coherence , 2002 .

[39]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[40]  C Grozea,et al.  On the feasibility of using motor imagery EEG-based brain–computer interface in chronic tetraplegics for assistive robotic arm control: a clinical test and long-term post-trial follow-up , 2012, Spinal Cord.

[41]  Mario Cortese,et al.  Hybrid EEG/EOG-based brain/neural hand exoskeleton restores fully independent daily living activities after quadriplegia , 2016, Science Robotics.

[42]  Chethan Pandarinath,et al.  Brain-machine interface cursor position only weakly affects monkey and human motor cortical activity in the absence of arm movements , 2018, Scientific Reports.

[43]  Nitish V. Thakor,et al.  Simultaneous Neural Control of Simple Reaching and Grasping With the Modular Prosthetic Limb Using Intracranial EEG , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Xuedong Chen,et al.  Decoding human motor activity from EEG single trials for a discrete two-dimensional cursor control , 2009, Journal of neural engineering.

[45]  Silvestro Micera,et al.  Electronic dura mater for long-term multimodal neural interfaces , 2015, Science.

[46]  Xingyu Wang,et al.  Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI , 2019, IEEE Transactions on Cybernetics.

[47]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[48]  G. Curio,et al.  Voluntary control of corticomuscular coherence through neurofeedback: A proof-of-principle study in healthy subjects , 2015, Neuroscience.

[49]  M. Hallett,et al.  Corticomuscular coherence: a review. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[50]  W Laurig,et al.  Electromyographical study on surgeons in urology. II. Determination of muscular fatigue. , 1996, Ergonomics.

[51]  Alan Smith,et al.  Myoelectric control techniques for a rehabilitation robot , 2011 .