EEG-based biometric identification with convolutional neural network

Although more interest arising in biometric identification with electroencephalogram (EEG) signals, there is still a lack of simple and robust models that can be applied in real applications. This work proposes a new convolutional neural network with global spatial and local temporal filter called (GSLT-CNN), which works directly with raw EEG data, not requiring the need for engineering features. We investigate the performance of the GSLT-CNN model on datasets of 157 subjects collected from 4 different experiments that measure endogenous brain states (driving fatigue and emotion) as well as time-locked artificially induced brain responses such as rapid serial visual response (RSVP). We evaluate the GSLT-CNN model against the comparable SVM, Bagging Tree and LDA models with effective feature selection method. The results show the GSLT-CNN model is highly efficient and robust in training more than 279 K epochs within less than 0.5 h and achieves 96% accuracy in identifying 157 subjects, which is 3% better than the best accuracy of SVM on selected PSD feature, 10% better than that of SVM on selected AR feature and 23% better than that of normal CV-CNN model on raw EEG feature. It demonstrates the potential of deep learning solutions for real-life EEG-based biometric identification. We also show that the cross-session identification accuracy from time-locked RSVP data (99%) is slightly higher than that from single-session non-time-locked driving fatigue data (97%) and much higher than that from epochs measuring random brain states (90%), which implies RSVP could be a more beneficial design to achieve high identification accuracy with EEG and our GSLT-CNN model is robust for cross-session identification in RSVP experiment.

[1]  R. Palaniappan,et al.  Identifying Individuality Using Mental Task Based Brain Computer Interface , 2005, 2005 3rd International Conference on Intelligent Sensing and Information Processing.

[2]  Hallowell Davis,et al.  ACTION POTENTIALS OF THE BRAIN: IN NORMAL PERSONS AND IN NORMAL STATES OF CEREBRAL ACTIVITY , 1936 .

[3]  Yufei Huang,et al.  Design of deep convolutional networks for prediction of image rapid serial visual presentation events , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Yufei Huang,et al.  EEG-based biometric identification with deep learning , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[5]  Himanshu Monga,et al.  Efficient Biometric Iris Recognition Using Hough Transform , 2014 .

[6]  Laxman M. Waghmare,et al.  Iris Biometric Recognition for Person Identification in Security Systems , 2011 .

[7]  B. V. K. Vijaya Kumar,et al.  Subject identification from electroencephalogram (EEG) signals during imagined speech , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[8]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[9]  Yufei Huang,et al.  Generating target/non-target images of an RSVP experiment from brain signals in by conditional generative adversarial network , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[10]  R DineshJacksonSamuel,et al.  Cybernetic microbial detection system using transfer learning , 2020 .

[11]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[13]  Andrew McCallum,et al.  A comparison of event models for naive bayes text classification , 1998, AAAI 1998.

[14]  Carlos M Travieso,et al.  EEG biometric identification: a thorough exploration of the time-frequency domain. , 2015, Journal of neural engineering.

[15]  Anthony J. Ries,et al.  Common EEG features for behavioral estimation in disparate, real-world tasks , 2016, Biological Psychology.

[16]  Miguel P. Eckstein,et al.  Single-Trial Classification of Event-Related Potentials in Rapid Serial Visual Presentation Tasks Using Supervised Spatial Filtering , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Yuan-Pin Lin,et al.  EEG-Based Emotion Recognition in Music Listening , 2010, IEEE Transactions on Biomedical Engineering.

[18]  R. Dinesh Jackson Samuel,et al.  Tuberculosis (TB) detection system using deep neural networks , 2019, Neural Computing and Applications.

[19]  Heung-Il Suk,et al.  Person authentication from neural activity of face-specific visual self-representation , 2013, Pattern Recognit..

[20]  Kyungmin Su,et al.  The PREP pipeline: standardized preprocessing for large-scale EEG analysis , 2015, Front. Neuroinform..

[21]  Patrizio Campisi,et al.  Brain waves for automatic biometric-based user recognition , 2014, IEEE Transactions on Information Forensics and Security.

[22]  Mohammad Bagher Shamsollahi,et al.  Person Identification by Using AR Model for EEG Signals , 2007 .

[23]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[24]  G.K. Singhal,et al.  Person Identification Using Evoked Potentials and Peak Matching , 2007, 2007 Biometrics Symposium.

[25]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[26]  Jon Touryan,et al.  Estimating endogenous changes in task performance from EEG , 2014, Front. Neurosci..

[27]  Rajesh Kanna B,et al.  Cybernetic microbial detection system using transfer learning , 2018, Multimedia Tools and Applications.

[28]  Patrizio Campisi,et al.  Eigenbrains and Eigentensorbrains: Parsimonious bases for EEG biometrics , 2016, Neurocomputing.

[29]  Hyoung Joong Kim,et al.  A High-Security EEG-Based Login System with RSVP Stimuli and Dry Electrodes , 2016, IEEE Transactions on Information Forensics and Security.

[30]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[31]  MaioranaEmanuele,et al.  Eigenbrains and Eigentensorbrains , 2016 .

[32]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[33]  Jonathan R Wolpaw,et al.  Brain–computer interfaces as new brain output pathways , 2007, The Journal of physiology.

[34]  Constantine Kotropoulos,et al.  Information Loss of the Mahalanobis Distance in High Dimensions: Application to Feature Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Scott E. Kerick,et al.  Brain–Computer Interface Technologies in the Coming Decades , 2012, Proceedings of the IEEE.

[36]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[37]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[38]  Tzyy-Ping Jung,et al.  Predicting EEG Sample Size Required for Classification Calibration , 2016, HCI.

[39]  Constantine Kotropoulos,et al.  Fast and accurate sequential floating forward feature selection with the Bayes classifier applied to speech emotion recognition , 2008, Signal Process..

[40]  Zhanpeng Jin,et al.  CEREBRE: A Novel Method for Very High Accuracy Event-Related Potential Biometric Identification , 2016, IEEE Transactions on Information Forensics and Security.