Information-preserving feature filter for short-term EEG signals

Abstract The brain-computer interface (BCI) has become one of the most important biomedical research fields and has many useful applications. An important component of BCI, electroencephalography (EEG) is in general sensitive to noise and rich in all kinds of information from our brain. In this paper, we study the feature fusion problem in electroencephalography (EEG). We introduce (1) a discriminative feature extractor which can classify multi-labels from short-term EEG signals, and (2) a new strategy to filter out unwanted features from EEG signals based on our feature extractor. Filtering out signals relating to one property of the EEG signal while retaining another is similar to the way we can listen to just one voice during a party, which is known as the cocktail party problem in the machine learning area. Built based on the success of short-term EEG discriminative model, the feature filter is an end-to-end framework which is trained to map EEG signals with unwanted features directly to EEG signals without those features. Our experimental results on an alcoholism dataset show that our novel model can filter out over 90% of alcoholism information on average from EEG signals, with an average of only 4.2% useful feature accuracy lost, showing effectiveness for our proposed task.

[1]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[2]  Ming Zhou,et al.  Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study , 2018, ArXiv.

[3]  Samaher Al-Janabi,et al.  Survey of main challenges (security and privacy) in wireless body area networks for healthcare applications , 2017 .

[4]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  Yong Yu,et al.  Long Text Generation via Adversarial Training with Leaked Information , 2017, AAAI.

[7]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[8]  Bernhard Schölkopf,et al.  Robust EEG Channel Selection across Subjects for Brain-Computer Interfaces , 2005, EURASIP J. Adv. Signal Process..

[9]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  J. Kulynych,et al.  Legal and ethical issues in neuroimaging research: human subjects protection, medical privacy, and the public communication of research results , 2002, Brain and Cognition.

[11]  Bharti W. Gawali,et al.  Correlation of EEG Images and Speech Signals for Emotion Analysis , 2015 .

[12]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[13]  Begoña Garcia-Zapirain,et al.  EEG artifact removal—state-of-the-art and guidelines , 2015, Journal of neural engineering.

[14]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[15]  F. Ebrahimi,et al.  Automatic sleep stage classification based on EEG signals by using neural networks and wavelet packet coefficients , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Brian Roark,et al.  RSVP keyboard: An EEG based typing interface , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Tamás D. Gedeon,et al.  Deep Feature Learning and Visualization for EEG Recording Using Autoencoders , 2018, ICONIP.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[21]  Tzyy-Ping Jung,et al.  EEG-based prediction of driver's cognitive performance by deep convolutional neural network , 2016, Signal Process. Image Commun..

[22]  Yitong Li,et al.  Targeting EEG/LFP Synchrony with Neural Nets , 2017, NIPS.

[23]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[24]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[25]  Alois Schlögl An overview on data formats for biomedical signals , 2009 .

[26]  Tom Gedeon,et al.  Generalized Alignment for Multimodal Physiological Signal Learning , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[27]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[28]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[29]  Chong Jin Ong,et al.  Automatic EEG Artifact Removal: A Weighted Support Vector Machine Approach With Error Correction , 2009, IEEE Transactions on Biomedical Engineering.

[30]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[31]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[32]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Taesung Park,et al.  CyCADA: Cycle-Consistent Adversarial Domain Adaptation , 2017, ICML.

[34]  Mario Lucic,et al.  Are GANs Created Equal? A Large-Scale Study , 2017, NeurIPS.

[35]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Fei Su,et al.  EEG-based Personal Identification: from Proof-of-Concept to A Practical System , 2010, 2010 20th International Conference on Pattern Recognition.

[37]  Elizabeth B. Varghese,et al.  A novel approach for ensuring the privacy of EEG signals using application-specific feature extraction and AES algorithm , 2016, 2016 International Conference on Inventive Computation Technologies (ICICT).

[38]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[39]  Stephen J. Roberts,et al.  Adaptive Classification by Variational Kalman Filtering , 2002, NIPS.

[40]  Tim Oates,et al.  Denoising Time Series Data Using Asymmetric Generative Adversarial Networks , 2018, PAKDD.

[41]  Jan Kautz,et al.  Unsupervised Image-to-Image Translation Networks , 2017, NIPS.

[42]  Qiang Ji,et al.  Cross-subject workload classification with a hierarchical Bayes model , 2012, NeuroImage.