Decoding EEG in Cognitive Tasks With Time-Frequency and Connectivity Masks

Electroencephalogram (EEG) is a measurable window looking into brain dynamics. Brain activities may exhibit different representations while executing different cognitive tasks, which can be recognized by decoding EEG. This is crucial for constructing a brain-computer interface (BCI), which directly bridges between the human brain and external experiments or devices for communication or function restoration. This paper proposed a mask-based approach integrating time-frequency mask (TFM) and connectivity mask (CM) to improve BCI performance. The TFM method does not require the discriminative time-frequency points to be centralized together as the specific-frequency-specific-time (SFST) method does. It can also achieve good performance when discriminative features are scattered. Moreover, this paper also developed a CM method in the spatial domain to extract interchannel connectivity features. The performance of these methods was quantitatively evaluated on three datasets involving different cognitive tasks: 1) a pointing movement dataset; 2) a self-paced finger-tapping dataset in BCI competition II; and 3) a slow cortical potential dataset in BCI competition II. Empirical results of this paper showed that the TFM method outperformed the SFST method on all three datasets and achieved comparable performance to the winning methods in the two BCI competition datasets. The performance was further improved by combining TFM and CM, exceeding that of the winning methods in the BCI competition datasets.

[1]  Liqing Zhang,et al.  Feature learning from incomplete EEG with denoising autoencoder , 2014, Neurocomputing.

[2]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[3]  Wei-Yen Hsu,et al.  EEG-based motor imagery classification using neuro-fuzzy prediction and wavelet fractal features , 2010, Journal of Neuroscience Methods.

[4]  Andrzej Cichocki,et al.  A comparative study of synchrony measures for the early diagnosis of Alzheimer's disease based on EEG , 2010, NeuroImage.

[5]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[6]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[7]  Liqing Zhang,et al.  A competitive brain computer interface: Multi-person car racing system , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Gernot R. Müller-Putz,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3152–3155 c ○ 2005 Hindawi Publishing Corporation EEG-Based Asynchronous BCI Controls Functional Electrical Stimulation in a Tetraplegic Patient , 2004 .

[9]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[10]  Tzyy-Ping Jung,et al.  Combining ERPs and EEG spectral features for decoding intended movement direction , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Clemens Brunner,et al.  Single-trial connectivity estimation for classification of motor imagery data , 2013, Journal of neural engineering.

[12]  Jean-Lon Chen,et al.  Dynamic changes of ICA‐derived EEG functional connectivity in the resting state , 2013, Human brain mapping.

[13]  Mingzhou Ding,et al.  Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance , 2001, Biological Cybernetics.

[14]  A. Bezerianos,et al.  Functional cortical connectivity analysis of mental fatigue unmasks hemispheric asymmetry and changes in small-world networks , 2014, Brain and Cognition.

[15]  Xingyu Wang,et al.  Spatial-Temporal Discriminant Analysis for ERP-Based Brain-Computer Interface , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Yijun Wang,et al.  Predicting Intended Movement Direction Using EEG from Human Posterior Parietal Cortex , 2009, HCI.

[17]  M. Hallett,et al.  A high performance sensorimotor beta rhythm-based brain–computer interface associated with human natural motor behavior , 2008, Journal of neural engineering.

[18]  Liqing Zhang,et al.  Bilateral adaptation and neurofeedback for brain computer interface system , 2010, Journal of Neuroscience Methods.

[19]  Fusheng Yang,et al.  BCI competition 2003-data set IV:An algorithm based on CSSD and FDA for classifying single-trial EEG , 2004, IEEE Transactions on Biomedical Engineering.

[20]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[22]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[23]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[24]  Niels Birbaumer,et al.  Real-time support vector classification and feedback of multiple emotional brain states , 2011, NeuroImage.

[25]  S. Hsieh,et al.  Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns , 2014, PloS one.

[26]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[27]  Chao Li,et al.  Canonical Polyadic Decomposition With Auxiliary Information for Brain–Computer Interface , 2014, IEEE Journal of Biomedical and Health Informatics.

[28]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[29]  M. Stokes,et al.  Cognitive tasks for driving a brain-computer interfacing system: a pilot study , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Cuntai Guan,et al.  Optimum Spatio-Spectral Filtering Network for Brain–Computer Interface , 2011, IEEE Transactions on Neural Networks.

[31]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Jie Li,et al.  Design of assistive Wheelchair System directly Steered by Human Thoughts , 2013, Int. J. Neural Syst..

[33]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[34]  Thomas Dierks,et al.  Increased phase synchronization during continuous face integration measured simultaneously with EEG and fMRI , 2012, Clinical Neurophysiology.

[35]  F. Mormann,et al.  Mean phase coherence as a measure for phase synchronization and its application to the EEG of epilepsy patients , 2000 .

[36]  Xiaofeng Gong,et al.  Tensor decomposition of EEG signals: A brief review , 2015, Journal of Neuroscience Methods.

[37]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[38]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[39]  Abraham Z. Snyder,et al.  Function in the human connectome: Task-fMRI and individual differences in behavior , 2013, NeuroImage.

[40]  Ian Daly,et al.  Brain computer interface control via functional connectivity dynamics , 2012, Pattern Recognit..

[41]  Tianzi Jiang,et al.  Changes in hippocampal connectivity in the early stages of Alzheimer's disease: Evidence from resting state fMRI , 2006, NeuroImage.

[42]  Klaus-Robert Müller,et al.  Optimizing spatio-temporal filters for improving Brain-Computer Interfacing , 2005, NIPS.

[43]  Vladimir Bostanov,et al.  BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram , 2004, IEEE Transactions on Biomedical Engineering.