Applying Transfer Learning To Deep Learned Models For EEG Analysis

The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in neuroscience, lies in the complexity of the information that is processed, the availability of data and the cost of producing sufficient high quality annotations. Inspired by its application in computer vision, we introduce transfer learning on electrophysiological data to enable training a model with limited amounts of data. Our method was tested on the dataset of the BCI competition IV 2a and compared to the top results that were obtained using traditional machine learning techniques. Using our DL model we outperform the top result of the competition by 33%. We also explore transferability of knowledge between trained models over different experiments, called inter-experimental transfer learning. This reduces the amount of required data even further and is especially useful when few subjects are available. This method is able to outperform the standard deep learning methods used in the BCI competition IV 2b approaches by 18%. In this project we propose a method that can produce reliable electroencephalography (EEG) signal classification, based on modest amounts of training data through the use of transfer learning.

[1]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[2]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[3]  R. Leeb,et al.  BCI Competition 2008 { Graz data set B , 2008 .

[4]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[5]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[8]  Winston H. Hsu,et al.  Transfer Learning for Video Recognition with Scarce Training Data , 2014, ArXiv.

[9]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[10]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[11]  Ayman Atia,et al.  Brain computer interfacing: Applications and challenges , 2015 .

[12]  Swati Vaid,et al.  EEG Signal Analysis for BCI Interface: A Review , 2015, 2015 Fifth International Conference on Advanced Computing & Communication Technologies.

[13]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[14]  Dario Pompili,et al.  Cloud-based deep learning of big EEG data for epileptic seizure prediction , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[15]  Addison W. Bohannon,et al.  Spectral Transfer Learning Using Information Geometry for a User-Independent Brain-Computer Interface , 2016, Front. Neurosci..

[16]  Antonio Jimeno-Yepes,et al.  Decoding EEG and LFP signals using deep learning: heading TrueNorth , 2016, Conf. Computing Frontiers.

[17]  Hiroshi Ishikawa,et al.  Let there be color! , 2016, ACM Trans. Graph..

[18]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[19]  T. Jung,et al.  Improving EEG-Based Emotion Classification Using Conditional Transfer Learning , 2017, Front. Hum. Neurosci..

[20]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[21]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[22]  Ahmad Nabot,et al.  Number 3 , 2017 .

[23]  Cuntai Guan,et al.  Convolutional neural network-based transfer learning and knowledge distillation using multi-subject data in motor imagery BCI , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[24]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[26]  Tonio Ball,et al.  Deep learning with convolutional neural networks for decoding and visualization of EEG pathology , 2017, 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[27]  Wen Yan,et al.  Unsupervised End-to-end Learning for Deformable Medical Image Registration , 2017, ArXiv.

[28]  M. Arns,et al.  Predicting sex from brain rhythms with deep learning , 2018, Scientific Reports.

[29]  Ivo D. Dinov,et al.  Deep learning for neural networks , 2018 .

[30]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.