A survey on methods and challenges in EEG based authentication

Abstract EEG is the recording of electrical activities of the brain, usually along the scalp surface, which are the results of synaptic activations of the brain’s neurons. In recent years, it has been shown that EEG is an appropriate signal for the biometric authentication and has important features such as resistance to spoofing attacks and impossibility to use under pressure and coercion states. In this paper, the state-of-the-art methods in EEG based authentication are reviewed. This review includes a number of aspects such as the various tasks that the user required to perform during the authentication, devices and available datasets, the preprocessing procedures and the classification methods used in the EEG biometric authentication. Both shallow and deep classification methods are reviewed in this paper. The study shows that the deep learning approaches which are used in the past few years, although still require further research, have shown great results. Moreover, the paper summarizes the works to address the open challenges of this area. The EEG authentication challenges have been discussed from a variety of points of view, including privacy, user-friendliness, attacks, and authentication requirements such as universality, permanency, uniqueness, and collectability. This paper can be used as a preliminary plan and a roadmap for researchers interested in EEG biometric.

[1]  Chris Roberts,et al.  Biometric attack vectors and defences , 2007, Comput. Secur..

[2]  Yufei Huang,et al.  EEG-based biometric identification with deep learning , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[3]  Mohammed Abo-Zahhad,et al.  A New EEG Acquisition Protocol for Biometric Identification Using Eye Blinking Signals , 2015 .

[4]  Michael Cohen,et al.  BrainID: Development of an EEG-based biometric authentication system , 2016, 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[5]  Vitor Nazário Coelho,et al.  Convolutional Network for EEG-Based Biometric , 2017, CIARP.

[6]  Nurul Nadia Ahmad,et al.  Analysis of the EEG Signal for a Practical Biometric System , 2010 .

[7]  Ping Wang,et al.  Two Birds with One Stone: Two-Factor Authentication with Security Beyond Conventional Bound , 2018, IEEE Transactions on Dependable and Secure Computing.

[8]  Ehsan Arbabi,et al.  Human identification with EEG signals in different emotional states , 2016, 2016 23rd Iranian Conference on Biomedical Engineering and 2016 1st International Iranian Conference on Biomedical Engineering (ICBME).

[9]  Ping Wang,et al.  Zipf’s Law in Passwords , 2017, IEEE Transactions on Information Forensics and Security.

[10]  J. Démos Getting Started with Neurofeedback , 2005 .

[11]  Wenyao Xu,et al.  Exploring EEG-based biometrics for user identification and authentication , 2014, 2014 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[12]  Fu Quan Zhang,et al.  Deep Learning Models for EEG-based Rapid Serial Visual Presentation Event Classification , 2018, J. Inf. Hiding Multim. Signal Process..

[13]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[14]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. , 1980 .

[15]  Theerawit Wilaiprasitporn,et al.  Affective EEG-Based Person Identification Using the Deep Learning Approach , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[16]  Hyoung Joong Kim,et al.  A High-Security EEG-Based Login System with RSVP Stimuli and Dry Electrodes , 2016, IEEE Transactions on Information Forensics and Security.

[17]  Jordi Solé i Casals,et al.  EEG signal preprocessing for biometric recognition , 2016, Machine Vision and Applications.

[18]  Arif I. Sarwat,et al.  A Generic Framework for EEG-Based Biometric Authentication , 2015, 2015 12th International Conference on Information Technology - New Generations.

[19]  Mei-chun Cheung,et al.  Increased theta coherence during Chinese reading. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  Z. Keirn,et al.  A new mode of communication between man and his surroundings , 1990, IEEE Transactions on Biomedical Engineering.

[21]  Patrizio Campisi,et al.  EEG Biometrics Using Visual Stimuli: A Longitudinal Study , 2016, IEEE Signal Processing Letters.

[22]  Yufeng Ke,et al.  Robustness Analysis of Identification Using Resting-State EEG Signals , 2019, IEEE Access.

[23]  Li Tong,et al.  EEG-Based Identity Authentication Framework Using Face Rapid Serial Visual Presentation with Optimized Channels , 2018, Sensors.

[24]  Yufei Huang,et al.  Generating EEG signals of an RSVP Experiment by a Class Conditioned Wasserstein Generative Adversarial Network , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[25]  Zhenkai Liang,et al.  I Can See Your Brain: Investigating Home-Use Electroencephalography System Security , 2019, IEEE Internet of Things Journal.

[26]  Bernadette Dorizzi,et al.  Application of Biometrics to Obtain High Entropy Cryptographic Keys , 2009 .

[27]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[28]  Pong C. Yuen,et al.  Binary Discriminant Analysis for Generating Binary Face Template , 2012, IEEE Transactions on Information Forensics and Security.

[29]  Sébastien Marcel,et al.  Image Quality Assessment for Fake Biometric Detection: Application to Iris, Fingerprint, and Face Recognition , 2014, IEEE Transactions on Image Processing.

[30]  Naeem Ramzan,et al.  ES1D: A Deep Network for EEG-Based Subject Identification , 2017, 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE).

[31]  Debiao He,et al.  Robust Biometrics-Based Authentication Scheme for Multiserver Environment , 2015, IEEE Systems Journal.

[32]  Jianfeng Hu,et al.  Identification of Motor Imagery EEG Signal , 2010, 2010 International Conference on Biomedical Engineering and Computer Science.

[33]  José del R. Millán,et al.  Person Authentication Using Brainwaves (EEG) and Maximum A Posteriori Model Adaptation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Koosha Sadeghi,et al.  E-BIAS: A Pervasive EEG-Based Identification and Authentication System , 2015, Q2SWinet@MSWiM.

[35]  Guoyin Wang,et al.  EEG-Based Person Recognition Analysis and Criticism , 2017, 2017 IEEE International Conference on Big Knowledge (ICBK).

[36]  Swati Aggarwal,et al.  EEG Based Participant Independent Emotion Classification using Gradient Boosting Machines , 2018, 2018 IEEE 8th International Advance Computing Conference (IACC).

[37]  H. Begleiter,et al.  Event related potentials during object recognition tasks , 1995, Brain Research Bulletin.

[38]  Alan F. Smeaton,et al.  A review of feature extraction and classification algorithms for image RSVP based BCI , 2018 .

[39]  Patrizio Campisi,et al.  Motor Imagery for Eeg Biometrics Using Convolutional Neural Network , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Toby P. Breckon,et al.  Simulating Brain Signals: Creating Synthetic EEG Data via Neural-Based Generative Models for Improved SSVEP Classification , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[41]  Juan E. Tapiador,et al.  A Survey of Wearable Biometric Recognition Systems , 2016, ACM Comput. Surv..

[42]  M. Kostilek,et al.  EEG biometric identification: Repeatability and influence of movement-related EEG , 2012, 2012 International Conference on Applied Electronics.

[43]  Koosha Sadeghi,et al.  Systematic analysis of liveness detection methods in biometrie security systems , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[44]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[45]  Nurul Nadia Ahmad,et al.  Analysis of effective channel placement for an EEG-based biometric system , 2010, 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[46]  Saeid Sanei,et al.  Adaptive Processing of Brain Signals , 2013 .

[47]  Ernesto Pereda,et al.  Measuring second language proficiency with EEG synchronization: how functional cortical networks and hemispheric involvement differ as a function of proficiency level in second language speakers , 2009 .

[48]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[49]  Zhanpeng Jin,et al.  Brainprint: Assessing the uniqueness, collectability, and permanence of a novel method for ERP biometrics , 2015, Neurocomputing.

[50]  O. Rosso,et al.  The Australian EEG Database , 2005, Clinical EEG and neuroscience.

[51]  Thuc Dinh Nguyen,et al.  Gait authentication on mobile phone using biometric cryptosystem and fuzzy commitment scheme , 2015, International Journal of Information Security.

[52]  Hu Jian-feng,et al.  Multifeature biometric system based on EEG signals , 2009 .

[53]  S. Luck An Introduction to the Event-Related Potential Technique , 2005 .

[54]  Mohammed Abo-Zahhad,et al.  State-of-the-art methods and future perspectives for personal recognition based on electroencephalogram signals , 2015, IET Biom..

[55]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[56]  Zijing Mao,et al.  EEG-based biometric identification with convolutional neural network , 2019, Multimedia Tools and Applications.

[57]  Garima Bajwa,et al.  Neurokey: Towards a new paradigm of cancelable biometrics-based key generation using electroencephalograms , 2016, Comput. Secur..

[58]  A. Prasad Vinod,et al.  EEG-Based Biometric Authentication Using Gamma Band Power During Rest State , 2017, Circuits, Systems, and Signal Processing.

[59]  Chidchanok Lursinsap,et al.  Personal Identification by EEG Using ICA and Neural Network , 2010, ICCSA.

[60]  Peng Li,et al.  An effective biometric cryptosystem combining fingerprints with error correction codes , 2012, Expert Syst. Appl..

[61]  Koosha Sadeghi,et al.  A novel spoofing attack against electroencephalogram-based security systems , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[62]  Pei Huang,et al.  Securing a UAV using individual characteristics from an EEG signal , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[63]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[64]  Z. I. Yusoh,et al.  Identifying Visual Evoked Potential (VEP) Electrodes Setting for Person Authentication , 2015 .

[65]  Zhanpeng Jin,et al.  Permanence of the CEREBRE brain biometric protocol , 2017, Pattern Recognit. Lett..

[66]  Wanli Ma,et al.  A study on the stability of EEG signals for user authentication , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[67]  A. Prasad Vinod,et al.  Online Biometric Authentication Using Subject-Specific Band Power features of EEG , 2017, ICCSP '17.

[68]  Benjamin Johnson,et al.  My thoughts are not your thoughts , 2014, UbiComp Adjunct.

[69]  Brijraj Singh,et al.  EEG based biometric identification with reduced number of channels , 2015, 2015 17th International Conference on Advanced Communication Technology (ICACT).

[70]  Dinesh Singh,et al.  Neuro signals: A future biomertic approach towards user identification , 2017, 2017 7th International Conference on Cloud Computing, Data Science & Engineering - Confluence.

[71]  Carlos M Travieso,et al.  EEG biometric identification: a thorough exploration of the time-frequency domain. , 2015, Journal of neural engineering.

[72]  Chin-Feng Lin,et al.  Chaos Based Encryption System for Encrypting Electroencephalogram Signals , 2014, Journal of Medical Systems.

[73]  H. Olesen,et al.  ID Proof on the Go: Development of a Mobile EEG-Based Biometric Authentication System , 2012, IEEE Vehicular Technology Magazine.

[74]  Patrizio Campisi,et al.  Visually evoked potentials for EEG biometric recognition , 2016, 2016 First International Workshop on Sensing, Processing and Learning for Intelligent Machines (SPLINE).

[75]  Sarineh Keshishzadeh,et al.  Improved EEG based human authentication system on large dataset , 2016, 2016 24th Iranian Conference on Electrical Engineering (ICEE).

[76]  Kenneth P. Camilleri,et al.  Steady-State Visual Evoked Potentials for EEG-Based Biometric Identification , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[77]  Patrizio Campisi,et al.  EEG Biometrics for User Recognition Using Visually Evoked Potentials , 2015, 2015 International Conference of the Biometrics Special Interest Group (BIOSIG).

[78]  Tien Pham,et al.  Multi-factor EEG-based user authentication , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[79]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[80]  Abhishek Vaish,et al.  Individual identification based on neuro-signal using motor movement and imaginary cognitive process , 2016 .

[81]  Thierry Blu,et al.  Resting State EEG-based biometrics for individual identification using convolutional neural networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[82]  John C.-I. Chuang,et al.  Faking it, Making it: Fooling and Improving Brain-Based Authentication with Generative Adversarial Networks , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[83]  F. Tenore,et al.  Low-cost electroencephalogram (EEG) based authentication , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[84]  Sherif N. Abbas,et al.  A new multi-level approach to EEG based human authentication using eye blinking , 2016, Pattern Recognit. Lett..

[85]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[86]  Zhanpeng Jin,et al.  CEREBRE: A Novel Method for Very High Accuracy Event-Related Potential Biometric Identification , 2016, IEEE Transactions on Information Forensics and Security.

[87]  Patrizio Campisi,et al.  Stable EEG Features for Biometric Recognition in Resting State Conditions , 2013, BIOSTEC.

[88]  Joydeep Bhattacharya,et al.  On a Possible Relationship between Linguistic Expertise and EEG Gamma Band Phase Synchrony , 2011, Front. Psychology.

[89]  Jesús B. Alonso,et al.  Electroencephalogram subject identification: A review , 2014, Expert Syst. Appl..

[90]  Jian-feng Hu,et al.  Biometric System Based on EEG Signals by Feature Combination , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[91]  W. Klimesch Memory processes, brain oscillations and EEG synchronization. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[92]  Khairul Azami Sidek,et al.  EEG Based Biometric Identification Using Correlation and MLPNN Models , 2019, Int. J. Online Biomed. Eng..

[93]  Andreas Uhl,et al.  Do EEG-Biometric Templates Threaten User Privacy? , 2018, IH&MMSec.

[94]  Danilo P. Mandic,et al.  In-Ear EEG Biometrics for Feasible and Readily Collectable Real-World Person Authentication , 2017, IEEE Transactions on Information Forensics and Security.

[95]  Montri Phothisonothai,et al.  An investigation of using SSVEP for EEG-based user authentication system , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[96]  Anil K. Jain,et al.  Biometric Template Security , 2008, EURASIP J. Adv. Signal Process..

[97]  Shinji Watanabe,et al.  High-accuracy user identification using EEG biometrics , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[98]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[99]  Dezhong Yao,et al.  Large-Scale Functional Networks Identified from Resting-State EEG Using Spatial ICA , 2016, PloS one.

[100]  Charles Wang,et al.  I Think, Therefore I Am: Usability and Security of Authentication Using Brainwaves , 2013, Financial Cryptography Workshops.

[101]  Ramaswamy Palaniappan,et al.  Electroencephalogram Signals from Imagined Activities: A Novel Biometric Identifier for a Small Population , 2006, IDEAL.

[102]  Jian-feng Hu,et al.  New biometric approach based on motor imagery EEG signals , 2009, 2009 International Conference on Future BioMedical Information Engineering (FBIE).

[103]  Zhanpeng Jin,et al.  Brainprint: Identifying Unique Features of Neural Activity with Machine Learning , 2014, CogSci.

[104]  João Paulo Papa,et al.  EEG-based Person Authentication Using Multi-objective Flower Pollination Algorithm , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[105]  Daniel P. Lopresti,et al.  Secure speech biometric templates for user authentication , 2012, IET Biom..

[106]  Marios Poulos,et al.  Person identification via the EEG using computational geometry algorithms , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[107]  Stanislav Shidlovskiy,et al.  Evolution of the Brain Computing Interface (BCI) and Proposed Electroencephalography (EEG) Signals Based Authentication Model , 2018 .

[108]  Guillaume A. Rousselet,et al.  Reliability of ERP and single-trial analyses , 2011, NeuroImage.

[109]  Kiseon Kim,et al.  Resting State EEG-Based Biometric System Using Concatenation of Quadrantal Functional Networks , 2019, IEEE Access.

[110]  Sung-Phil Kim,et al.  Electroencephalographic feature evaluation for improving personal authentication performance , 2018, Neurocomputing.

[111]  Dharmendra Sharma,et al.  A Proposed Feature Extraction Method for EEG-based Person Identification , 2012 .

[112]  Tien Pham,et al.  Using Shannon Entropy as EEG Signal Feature for Fast Person Identification , 2014, ESANN.

[113]  Koosha Sadeghi,et al.  Geometrical Analysis of Machine Learning Security in Biometric Authentication Systems , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[114]  S. Bressler,et al.  Response preparation and inhibition: The role of the cortical sensorimotor beta rhythm , 2008, Neuroscience.

[115]  R. Barry,et al.  EEG differences between eyes-closed and eyes-open resting conditions , 2007, Clinical Neurophysiology.

[116]  Dieter Gollmann,et al.  EEG-Based Biometrics , 2018, Biometric-Based Physical and Cybersecurity Systems.

[117]  Ping Wang,et al.  Preserving privacy for free: Efficient and provably secure two-factor authentication scheme with user anonymity , 2015, Inf. Sci..

[118]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[119]  Lei Xie,et al.  Confused or not Confused?: Disentangling Brain Activity from EEG Data Using Bidirectional LSTM Recurrent Neural Networks , 2017, BCB.

[120]  R. Palaniappan,et al.  Data Encryption Using Event-related Brain Signals , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[121]  Feng Hao,et al.  Combining Crypto with Biometrics Effectively , 2006, IEEE Transactions on Computers.

[122]  Ye Wang,et al.  Adversarial Deep Learning in EEG Biometrics , 2019, IEEE Signal Processing Letters.

[123]  Yin Fen Low,et al.  EEG-based biometric authentication modelling using incremental fuzzy-rough nearest neighbour technique , 2017, IET Biom..

[124]  André Zúquete,et al.  Biometric Authentication using Brain Responses to Visual Stimuli , 2010, BIOSIGNALS.

[125]  Kenji Yoshigoe,et al.  Personalizable neurological user authentication framework , 2017, 2017 International Conference on Computing, Networking and Communications (ICNC).

[126]  Shang-Lin Wu,et al.  EEG-Based Brain-Computer Interfaces: A Novel Neurotechnology and Computational Intelligence Method , 2017, IEEE Systems, Man, and Cybernetics Magazine.

[127]  Christophe Rosenberger,et al.  A Review on Authentication Methods , 2013 .

[128]  Wanli Ma,et al.  On The Study of EEG-based Cryptographic Key Generation , 2017, KES.

[129]  Patrizio Campisi,et al.  On the Permanence of EEG Signals for Biometric Recognition , 2016, IEEE Transactions on Information Forensics and Security.

[130]  Vikrant Bhateja,et al.  Artificial Neural Networks Based Fusion and Classification of EEG/EOG Signals , 2019 .

[131]  Gian Luca Marcialis,et al.  An EEG-Based Biometric System Using Eigenvector Centrality in Resting State Brain Networks , 2015, IEEE Signal Processing Letters.

[132]  Patrizio Campisi,et al.  Longitudinal Evaluation of EEG-Based Biometric Recognition , 2017, IEEE Transactions on Information Forensics and Security.

[133]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[134]  Samuel K. Moore "Brainprint" biometric id hits 100% accuracy [News] , 2016 .

[135]  Chi Zhang,et al.  An EEG-Based Person Authentication System with Open-Set Capability Combining Eye Blinking Signals , 2018, Sensors.

[136]  Partha Pratim Roy,et al.  A Novel framework of EEG-based user identification by analyzing music-listening behavior , 2017, Multimedia Tools and Applications.

[137]  Su Yang,et al.  Task sensitivity in EEG biometric recognition , 2018, Pattern Analysis and Applications.

[138]  Jianfeng Hu,et al.  Method of Individual Identification Based on Electroencephalogram Analysis , 2009, 2009 International Conference on New Trends in Information and Service Science.

[139]  Debi Prosad Dogra,et al.  A bio-signal based framework to secure mobile devices , 2017, J. Netw. Comput. Appl..

[140]  Benny P. L. Lo,et al.  EEG-based user identification system using 1D-convolutional long short-term memory neural networks , 2019, Expert Syst. Appl..

[141]  Laleh Najafizadeh,et al.  On the invariance of EEG-based signatures of individuality with application in biometric identification , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[142]  Su Yang,et al.  On the Usability of Electroencephalographic Signals for Biometric Recognition: A Survey , 2017, IEEE Transactions on Human-Machine Systems.

[143]  Sébastien Marcel,et al.  Towards Measuring the Amount of Discriminatory Information in Finger Vein Biometric Characteristics Using a Relative Entropy Estimator , 2019, Handbook of Vascular Biometrics.

[144]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[145]  J. Shane Culpepper,et al.  Entropy of the Retina Template , 2009, ICB.

[146]  Abhishek Vaish,et al.  Feature-level fusion of mental task’s brain signal for an efficient identification system , 2015, Neural Computing and Applications.