Deep learning for EEG-based biometric recognition

Abstract The exploitation of brain signals for biometric recognition purposes has received significant attention from the scientific community in the last decade, with most of the efforts so far devoted to the quest for discriminative information within electroencephalography (EEG) recordings. Yet, currently-achievable recognition rates are still not comparable with those granted by more-commonly-used biometric characteristics, posing an issue for the practical deployment of EEG-based recognition in real-life applications. Within this regard, the present study investigates the effectiveness of deep learning techniques in extracting distinctive features from EEG signals. Both convolutional and recurrent neural networks, as well as their combinations, are employed as strategies to derive personal identifiers from the collected EEG data. In order to assess the robustness of the considered techniques, an extensive set of experimental tests is conducted under very challenging conditions, trying to determine whether it is feasible to identify subjects through their brain signals regardless the performed mental task, and comparing acquisitions collected at a temporal distance greater than one year. The obtained results suggest that the proposed networks are actually able to exploit the dynamic temporal behavior of EEG signals to achieve high-level accuracy for brain-based biometric recognition.

[1]  Patrizio Campisi,et al.  Motor Imagery for Eeg Biometrics Using Convolutional Neural Network , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  B. V. K. Vijaya Kumar,et al.  Subject identification from electroencephalogram (EEG) signals during imagined speech , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[3]  W. Klimesch,et al.  Event-related desynchronization in the alpha band and the processing of semantic information. , 1997, Brain research. Cognitive brain research.

[4]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[5]  Charles D. Creusere,et al.  Subject identification based on EEG responses to video stimuli , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[6]  Wei Yang,et al.  A residual feature-based replay attack detection approach for brainprint biometric systems , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[7]  J. Wolpaw,et al.  Mu and Beta Rhythm Topographies During Motor Imagery and Actual Movements , 2004, Brain Topography.

[8]  Ruifeng Xu,et al.  A novel convolutional neural networks for emotion recognition based on EEG signal , 2017, 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[9]  Hussein A. Abbass,et al.  Convolution Neural Networks for Person Identification and Verification Using Steady State Visual Evoked Potential , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[10]  Sung-Phil Kim,et al.  Electroencephalographic feature evaluation for improving personal authentication performance , 2018, Neurocomputing.

[11]  Benny P. L. Lo,et al.  EEG-based user identification system using 1D-convolutional long short-term memory neural networks , 2019, Expert Syst. Appl..

[12]  Yunhao Liu,et al.  MindID: Person Identification from Brain Waves through Aention-based Recurrent Neural Network , 2017 .

[13]  Su Yang,et al.  On the Usability of Electroencephalographic Signals for Biometric Recognition: A Survey , 2017, IEEE Transactions on Human-Machine Systems.

[14]  Dharmendra Sharma,et al.  A Proposed Feature Extraction Method for EEG-based Person Identification , 2012 .

[15]  R. Barry,et al.  EEG differences between eyes-closed and eyes-open resting conditions , 2007, Clinical Neurophysiology.

[16]  Ekapol Chuangsuwanich,et al.  Universal Joint Feature Extraction for P300 EEG Classification Using Multi-Task Autoencoder , 2018, IEEE Access.

[17]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[18]  Subhrajit Roy,et al.  Deep Learning Enabled Automatic Abnormal EEG Identification , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Binqiang Chen,et al.  Centralized Wavelet Multiresolution for Exact Translation Invariant Processing of ECG Signals , 2019, IEEE Access.

[20]  Paul Rad,et al.  Voice biometrics: Deep learning-based voiceprint authentication system , 2017, 2017 12th System of Systems Engineering Conference (SoSE).

[21]  Thierry Blu,et al.  Resting State EEG-based biometrics for individual identification using convolutional neural networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Steven Kay,et al.  Modern Spectral Estimation: Theory and Application , 1988 .

[23]  Zhanpeng Jin,et al.  CEREBRE: A Novel Method for Very High Accuracy Event-Related Potential Biometric Identification , 2016, IEEE Transactions on Information Forensics and Security.

[24]  Petr Klimes,et al.  Intracerebral EEG Artifact Identification Using Convolutional Neural Networks , 2018, Neuroinformatics.

[25]  Patrizio Campisi,et al.  Longitudinal Evaluation of EEG-Based Biometric Recognition , 2017, IEEE Transactions on Information Forensics and Security.

[26]  H. Stassen,et al.  Computerized recognition of persons by EEG spectral patterns , 1980 .

[27]  Chi Zhang,et al.  An EEG-Based Person Authentication System with Open-Set Capability Combining Eye Blinking Signals , 2018, Sensors.

[28]  T. Fernández,et al.  EEG delta activity: an indicator of attention to internal processing during performance of mental tasks. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  Fuchun Sun,et al.  Deep Transfer Learning for EEG-Based Brain Computer Interface , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Zhanpeng Jin,et al.  A Survey on Brain Biometrics , 2019, ACM Comput. Surv..

[31]  Paolo Napoletano,et al.  Biometric Recognition Using Multimodal Physiological Signals , 2019, IEEE Access.

[32]  Patrizio Campisi,et al.  Brain waves for automatic biometric-based user recognition , 2014, IEEE Transactions on Information Forensics and Security.

[33]  Zhanpeng Jin,et al.  Brainprint: Assessing the uniqueness, collectability, and permanence of a novel method for ERP biometrics , 2015, Neurocomputing.

[34]  Kenneth Revett,et al.  Cognitive biometrics: a novel approach to person authentication , 2012 .

[35]  Ramesh Maddula,et al.  Deep Recurrent Convolutional Neural Networks for Classifying P300 BCI signals , 2017, GBCIC.

[36]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[37]  Patrizio Campisi,et al.  On the Permanence of EEG Signals for Biometric Recognition , 2016, IEEE Transactions on Information Forensics and Security.

[38]  Patrizio Campisi,et al.  EEG Biometrics for User Recognition Using Visually Evoked Potentials , 2015, 2015 International Conference of the Biometrics Special Interest Group (BIOSIG).

[39]  Yufei Huang,et al.  EEG-based biometric identification with deep learning , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[40]  Seong-Eun Moon,et al.  Convolutional Neural Network Approach for Eeg-Based Emotion Recognition Using Brain Connectivity and its Spatial Information , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Gernot R. Müller-Putz,et al.  Evaluation of Different EEG Acquisition Systems Concerning Their Suitability for Building a Brain–Computer Interface: Case Studies , 2016, Front. Neurosci..

[42]  Fabio Babiloni,et al.  Brain waves based user recognition using the “eyes closed resting conditions” protocol , 2011, 2011 IEEE International Workshop on Information Forensics and Security.

[43]  Patrizio Campisi,et al.  Eigenbrains and Eigentensorbrains: Parsimonious bases for EEG biometrics , 2016, Neurocomputing.

[44]  Yanjun Sun,et al.  The novel recognition method with Optimal Wavelet Packet and LSTM based Recurrent Neural Network , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).