Convolution Neural Networks for Person Identification and Verification Using Steady State Visual Evoked Potential

EEG signals could reveal unique information of an individual's brain activities. They have been regarded as one of the most promising biometric signals for person identification and verification. Steady-State Visual Evoked Potentials (SSVEPs), as EEG responses to visual stimulations at specific frequencies, could provide biometric information. However, current methods on SSVEP biometrics with hand-crafted power spectrum features and canonical correlation analysis (CCA) present only a limited range of individual distinctions and suffer relatively low accuracy. In this paper, we propose convolution neural networks (CNNs) with raw SSVEPs for person identification and verification without the need for any hand-crafted features. We conduct a comprehensive comparison between the performance of CNN with raw signals and a number of classical methods on two SSVEP datasets consisting of four and ten subjects, respectively. The proposed method achieved an averaged identification accuracy of 96.8%±0.01, which outperformed the other methods by an average of 45.5% (p-value < 0.05). In addition, it achieved an averaged False Acceptance Rate (FAR) of 1.53%±0.01 and True Acceptance Rate (TAR) of 97.09%±0.02 for person verification. The averaged verification accuracy is 98.34% ± 0.01, which outperformed the other methods by an average of 11.8% (p-value < 0.05). The proposed method based on deep learning offers opportunities to design a general-purpose EEG-based biometric system without the need for complex pre-processing and feature extraction techniques, making it feasible for real-time embedded systems.

[1]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[2]  José del R. Millán,et al.  Person Authentication Using Brainwaves (EEG) and Maximum A Posteriori Model Adaptation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Giuseppe Andreoni,et al.  A Robust and Self-Paced BCI System Based on a Four Class SSVEP Paradigm: Algorithms and Protocols for a High-Transfer-Rate Direct Brain Communication , 2009, Comput. Intell. Neurosci..

[4]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[5]  Sylvain Chevallier,et al.  SSVEP enhancement based on Canonical Correlation Analysis to improve BCI performances , 2013, 2013 Africon.

[6]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[7]  B. V. K. Vijaya Kumar,et al.  Subject identification from electroencephalogram (EEG) signals during imagined speech , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[8]  Abdullah Al Mamun,et al.  Artifact Removal from EEG Using a Multi-objective Independent Component Analysis Model , 2014, ICONIP.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Lianghua He,et al.  A Deep Learning Method for Classification of EEG Data Based on Motor Imagery , 2014, ICIC.

[12]  Stephanie Brandl,et al.  Robust artifactual independent component classification for BCI practitioners , 2014, Journal of neural engineering.

[13]  Xingyu Wang,et al.  Frequency Recognition in SSVEP-Based BCI using Multiset Canonical Correlation Analysis , 2013, Int. J. Neural Syst..

[14]  Danilo P. Mandic,et al.  Biometrics from Brain Electrical Activity: A Machine Learning Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Patrizio Campisi,et al.  On the Repeatability of EEG Features in a Biometric Recognition Framework using a Resting State Protocol , 2016, BIOSIGNALS.

[16]  Ronald M. Aarts,et al.  A Survey of Stimulation Methods Used in SSVEP-Based BCIs , 2010, Comput. Intell. Neurosci..

[17]  Kenneth P. Camilleri,et al.  EEG-based biometry using steady state visual evoked potentials , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Marios Poulos,et al.  Neural network based person identification using EEG features , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[19]  Patrizio Campisi,et al.  Brain waves for automatic biometric-based user recognition , 2014, IEEE Transactions on Information Forensics and Security.

[20]  Emmanuel K. Kalunga,et al.  Online SSVEP-based BCI using Riemannian geometry , 2015, Neurocomputing.