Subject-specific time-frequency selection for multi-class motor imagery-based BCIs using few Laplacian EEG channels

Abstract The essential task of a motor imagery brain–computer interface (BCI) is to extract the motor imagery-related features from electroencephalogram (EEG) signals for classifying motor intentions. However, the optimal frequency band and time segment for extracting such features differ from subject to subject. In this work, we aim to improve the multi-class classification and to reduce the required EEG channel in motor imagery-based BCI by subject-specific time-frequency selection. Our method is based on a criterion namely Fisher discriminant analysis-type F-score to simultaneously select the optimal frequency band and time segment for multi-class classification. The proposed method uses only few Laplacian EEG channels (C3, Cz and C4) located around the sensorimotor area for classification. Applied to a standard multi-class BCI dataset (BCI competition III dataset IIIa), our method leads to better classification performance and smaller standard deviation across subjects compared to the state-of-art methods. Moreover, adding artifacts contaminated trials to the training dataset does not necessarily deteriorate our classification results, indicating that our method is tolerant to artifacts.

[1]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Xiaorong Gao,et al.  Bipolar electrode selection for a motor imagery based brain–computer interface , 2008, Journal of neural engineering.

[3]  Raghav Swaminathan,et al.  Brain Computer Interface Used in Health Care Technologies , 2016 .

[4]  Gert Pfurtscheller,et al.  Overt foot movement detection in one single Laplacian EEG derivation , 2008, Journal of Neuroscience Methods.

[5]  Cristina Becchio,et al.  Grasping others' movements: Rapid discrimination of object size from observed hand movements. , 2016, Journal of experimental psychology. Human perception and performance.

[6]  S P Fitzgibbon,et al.  Surface Laplacian of scalp electrical signals and independent component analysis resolve EMG contamination of electroencephalogram. , 2015, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[7]  Jun Zhang,et al.  Dynamic frequency feature selection based approach for classification of motor imageries , 2016, Comput. Biol. Medicine.

[8]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[9]  Bin He,et al.  BRAIN^COMPUTER INTERFACE , 2007 .

[10]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  K. Jellinger Toward Brain-Computer Interfacing , 2009 .

[12]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[13]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Rini Akmeliawati,et al.  Motor imagery task classification using transformation based features , 2017, Biomed. Signal Process. Control..

[15]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Elsa Lauwers,et al.  Frontiers in Synaptic Neuroscience Synaptic Neuroscience , 2022 .

[17]  Haixian Wang Harmonic Mean of Kullback–Leibler Divergences for Optimizing Multi-Class EEG Spatio-Temporal Filters , 2012, Neural Processing Letters.

[18]  S. Bonnet,et al.  Channel selection procedure using riemannian distance for BCI applications , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[19]  Nicole Krämer,et al.  Time Domain Parameters as a feature for EEG-based Brain-Computer Interfaces , 2009, Neural Networks.

[20]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[21]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[22]  Jie Deng,et al.  Classification of the intention to generate a shoulder versus elbow torque by means of a time–frequency synthesized spatial patterns BCI algorithm , 2005, Journal of neural engineering.

[23]  Isabelle Bloch,et al.  Data Ranking and Clustering via Normalized Graph Cut Based on Asymmetric Affinity , 2013, ICIAP.

[24]  Feng Xu,et al.  Engineering a High-Throughput 3-D In Vitro Glioblastoma Model , 2015, IEEE Journal of Translational Engineering in Health and Medicine.

[25]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[26]  Cheolsoo Park,et al.  Classification of Motor Imagery BCI Using Multivariate Empirical Mode Decomposition , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Hong Zeng,et al.  Discriminative spatial-frequency-temporal feature extraction and classification of motor imagery EEG: An sparse regression and Weighted Naïve Bayesian Classifier-based approach , 2017, Journal of Neuroscience Methods.

[28]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[29]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[30]  Robert P. W. Duin,et al.  Using two-class classifiers for multiclass classification , 2002, Object recognition supported by user interaction for service robots.

[31]  Isabelle Bloch,et al.  Time-frequency optimization for discrimination between imagination of right and left hand movements based on two bipolar electroencephalography channels , 2014, EURASIP Journal on Advances in Signal Processing.

[32]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Yuan Yang,et al.  Predicting Object Size from Hand Kinematics: A Temporal Perspective , 2015, PloS one.

[34]  Isabelle Bloch,et al.  Subject-Specific Channel Selection Using Time Information for Motor Imagery Brain–Computer Interfaces , 2016, Cognitive Computation.

[35]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[36]  Isabelle Bloch,et al.  Towards next generation human-computer interaction -- brain-computer interfaces: applications and challenges , 2013 .

[37]  Yuanqing Li,et al.  Channel selection by Rayleigh coefficient maximization based genetic algorithm for classifying single-trial motor imagery EEG , 2013, Neurocomputing.

[38]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[39]  B. Hjorth An on-line transformation of EEG scalp potentials into orthogonal source derivations. , 1975, Electroencephalography and clinical neurophysiology.

[40]  Xingyu Wang,et al.  Optimized Motor Imagery Paradigm Based on Imagining Chinese Characters Writing Movement , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Christopher J. James,et al.  Extracting Rhythmic Brain Activity for Brain-Computer Interfacing through Constrained Independent Component Analysis , 2007, Comput. Intell. Neurosci..

[42]  Moritz Grosse-Wentrup,et al.  Multiclass Common Spatial Patterns and Information Theoretic Feature Extraction , 2008, IEEE Transactions on Biomedical Engineering.

[43]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[44]  Aida Khorshidtalab,et al.  Motor Imagery Task Classification Using a Signal-Dependent Orthogonal Transform Based Feature Extraction , 2015, ICONIP.

[45]  Bin He,et al.  A novel channel selection method for optimal classification in different motor imagery BCI paradigms , 2015, Biomedical engineering online.

[46]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[47]  Banghua Yang,et al.  Subject-based feature extraction by using fisher WPD-CSP in brain-computer interfaces , 2016, Comput. Methods Programs Biomed..

[48]  Xingyu Wang,et al.  A new hybrid BCI paradigm based on P300 and SSVEP , 2015, Journal of Neuroscience Methods.

[49]  Kup-Sze Choi,et al.  Improving the discrimination of hand motor imagery via virtual reality based visual guidance , 2016, Comput. Methods Programs Biomed..

[50]  Isabelle Bloch,et al.  Time-frequency selection in two bipolar channels for improving the classification of motor imagery EEG , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[51]  K. Mardia Measures of multivariate skewness and kurtosis with applications , 1970 .

[52]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[53]  Isabelle Bloch,et al.  Automatic selection of the number of spatial filters for motor-imagery BCI , 2012, ESANN.

[54]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[55]  S. Silvoni,et al.  Brain-Computer Interface in Stroke: A Review of Progress , 2011, Clinical EEG and neuroscience.

[56]  Horst Bischof,et al.  The Self-Paced Graz Brain-Computer Interface: Methods and Applications , 2007, Comput. Intell. Neurosci..

[57]  Isabelle Bloch,et al.  Subject-specific channel selection for classification of motor imagery electroencephalographic data , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[58]  E. Curran,et al.  Learning to control brain activity: A review of the production and control of EEG components for driving brain–computer interface (BCI) systems , 2003, Brain and Cognition.

[59]  Aida Khorshidtalab,et al.  A Transform-Based Feature Extraction Approach for Motor Imagery Tasks Classification , 2015, IEEE Journal of Translational Engineering in Health and Medicine.

[60]  Hui Li,et al.  Simultaneous Channel and Feature Selection of Fused EEG Features Based on Sparse Group Lasso , 2015, BioMed research international.