A Novel framework of EEG-based user identification by analyzing music-listening behavior

This paper introduces a novel framework for user identification by analyzing neuro-signals. Studies regarding Electroencephalography (EEG) revealed that such bio-signals are sensitive, hard to forge, confidential, and unique which the conventional biometric systems like face, speaker, signature and voice lack. Traditionally, researchers investigated the neuro-signal patterns by asking users to perform various imaginary, visual or calculative tasks. In this work, we have analyzed this neuro-signal pattern using audio as stimuli. The EEG signals are recorded simultaneously while user is listening to music. Four different genres of music are considered as users have their own preference and accordingly they respond with different emotions and interests. The users are also asked to provide music preference which acts as a personal identification mechanism. The framework offers the benefit of uniqueness in neuro-signal pattern even with the same music preference by different users. We used two different classifiers i.e. Hidden Markov Model (HMM) based temporal classifier and Support Vector Machine (SVM) for user identification system. A dataset of 2400 EEG signals while listening to music was collected from 60 users. User identification performance of 97.50 % and 93.83 % have been recorded with HMM and SVM classifiers, respectively. Finally, the performance of the system is also evaluated on various emotional states after showing different emotional videos to users.

[1]  Jean-Yves Ramel,et al.  Signature Based Document Retrieval Using GHT of Background Information , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.

[2]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[3]  Arif I. Sarwat,et al.  A Generic Framework for EEG-Based Biometric Authentication , 2015, 2015 12th International Conference on Information Technology - New Generations.

[4]  Gernot R. Müller-Putz,et al.  Computational Sensemaking on Examples of Knowledge Discovery from Neuroscience Data: Towards Enhancing Stroke Rehabilitation , 2012, ITBAM.

[5]  Yan Guozheng,et al.  EEG feature extraction based on wavelet packet decomposition for brain computer interface , 2008 .

[6]  David Zhang,et al.  Palm line extraction and matching for personal authentication , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  S. Benbadis,et al.  Handbook of EEG Interpretation , 2007 .

[8]  Mauridhi Hery Purnomo,et al.  Eeg Signal Identification Based on Root Mean Square and Average Power Spectrum By Using Backpropagation , 2014 .

[9]  Piotr Klosowski,et al.  Biometric Voice Identification Based on Fuzzy Kernel Classifier , 2013, CN.

[10]  Sherif N. Abbas,et al.  A new multi-level approach to EEG based human authentication using eye blinking , 2016, Pattern Recognit. Lett..

[11]  Hareesh Ravi,et al.  A novel method for touch-less finger print authentication , 2013, 2013 IEEE International Conference on Technologies for Homeland Security (HST).

[12]  Xu Huang,et al.  Development of a novel EEG wave controlled security system , 2015, 2015 IEEE Seventh International Conference on Intelligent Computing and Information Systems (ICICIS).

[13]  Eduardo Borba Neves,et al.  Biometric-oriented Iris Identification Based on Mathematical Morphology , 2015, J. Signal Process. Syst..

[14]  Alireza Alaei,et al.  Multi-script off-line signature identification , 2012, 2012 12th International Conference on Hybrid Intelligent Systems (HIS).

[15]  Fabio Babiloni,et al.  Brain waves based user recognition using the “eyes closed resting conditions” protocol , 2011, 2011 IEEE International Workshop on Information Forensics and Security.

[16]  Salman Yussof,et al.  Online Handwritten Signature Verification Using Neural Network Classifier Based on Principal Component Analysis , 2014, TheScientificWorldJournal.

[17]  K. N. Pushpalatha,et al.  Offline signature verification based on contourlet transform and textural features using HMM , 2014, International Conference on Recent Advances and Innovations in Engineering (ICRAIE-2014).

[18]  Javier Muguerza,et al.  User Adapted Motor-Imaginary Brain-Computer Interface by means of EEG Channel Selection Based on Estimation of Distributed Algorithms , 2016 .

[19]  Thierry Pun,et al.  Multimodal Emotion Recognition in Response to Videos , 2012, IEEE Transactions on Affective Computing.

[20]  Yuan-Pin Lin,et al.  Support vector machine for EEG signal classification during listening to emotional music , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[21]  Raghav Swaminathan,et al.  Brain Computer Interface Used in Health Care Technologies , 2016 .

[22]  Heung-Il Suk,et al.  Person authentication from neural activity of face-specific visual self-representation , 2013, Pattern Recognit..

[23]  Ramaswamy Palaniappan,et al.  Two-Stage Biometric Authentication Method Using Thought Activity Brain Waves , 2008, Int. J. Neural Syst..

[24]  Leontios J. Hadjileontiadis,et al.  Toward an EEG-Based Recognition of Music Liking Using Time-Frequency Analysis , 2012, IEEE Transactions on Biomedical Engineering.

[25]  G. McArthur,et al.  Validation of the Emotiv EPOC® EEG gaming system for measuring research quality auditory ERPs , 2013, PeerJ.

[26]  Chandra Sekhar Seelamantula,et al.  On the Selection of Optimum Savitzky-Golay Filters , 2013, IEEE Transactions on Signal Processing.

[27]  Danilo P. Mandic,et al.  Biometrics from Brain Electrical Activity: A Machine Learning Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Ayman Atia,et al.  Single Trial Authentication with Mental Password Writing , 2015, HCI.

[29]  Sergio I. Giraldo,et al.  Musical neurofeedback for treating depression in elderly people , 2015, Front. Neurosci..

[30]  Masayuki Numao,et al.  An Emotion Model for Music Using Brain Waves , 2012, ISMIR.

[31]  Yijun Wang,et al.  Brain-Computer Interfaces Based on Visual Evoked Potentials , 2008, IEEE Engineering in Medicine and Biology Magazine.

[32]  Hamdan Ahmed Alzahrani Remote Authentication Using Vaulted Fingerprint Verification , 2016 .

[33]  André Zúquete,et al.  Biometric Authentication using Brain Responses to Visual Stimuli , 2010, BIOSIGNALS.

[34]  Eva Kiktova,et al.  Acoustical keystroke analysis for user identification and authentication , 2016, 2016 26th International Conference Radioelektronika (RADIOELEKTRONIKA).

[35]  Charles Wang,et al.  I Think, Therefore I Am: Usability and Security of Authentication Using Brainwaves , 2013, Financial Cryptography Workshops.

[36]  Cosima Prahm,et al.  Evaluation of consumer EEG device Emotiv EPOC , 2011 .

[37]  Bin Hu,et al.  EEG-based biometric identification using local probability centers , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[38]  Maria Vargas-Vera,et al.  Pervasive Computing and the Networked World , 2013, Lecture Notes in Computer Science.

[39]  Josef Fink,et al.  Enhancing Universal Access - EEG Based Learnability Assessment , 2007, HCI.

[40]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[41]  Jen-Chun Lee,et al.  A novel biometric system based on palm vein image , 2012, Pattern Recognit. Lett..

[42]  Qiushi Zhao,et al.  Biometric Authentication System Based on Palm Vein , 2013, 2013 International Conference on Computer Sciences and Applications.

[43]  Mahendrakumar Rai Watermarking Scheme for Colour Images Using Hidden Markov Model , 2014 .

[44]  Madasu Hanmandlu,et al.  A palm print authentication system using quantized phase feature representation , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[45]  Isabelle Peretz,et al.  Tagging the Neuronal Entrainment to Beat and Meter , 2011, The Journal of Neuroscience.

[46]  H. Azami,et al.  An Improved Signal Segmentation Using Moving Average and Savitzky-Golay Filter , 2012 .

[47]  Isabelle Peretz,et al.  Selective Neuronal Entrainment to the Beat and Meter Embedded in a Musical Rhythm , 2012, The Journal of Neuroscience.

[48]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..

[49]  Grega Repovš,et al.  Dealing with Noise in EEG Recording and Data Analysis , 2010 .

[50]  Patrizio Campisi,et al.  On the Repeatability of EEG Features in a Biometric Recognition Framework using a Resting State Protocol , 2016, BIOSIGNALS.

[51]  José del R. Millán,et al.  Person Authentication Using Brainwaves (EEG) and Maximum A Posteriori Model Adaptation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Colin J. Champion,et al.  Application of continuous state Hidden Markov Models to a classical problem in speech recognition , 2016, Comput. Speech Lang..

[53]  Stefanie N. Lindstaedt,et al.  iScope - Viewing Biosignals on Mobile Devices , 2012, ICPCA/SWS.

[54]  Ayman AbuBaker,et al.  EEG Mouse:A Machine Learning-Based Brain Computer Interface , 2014 .

[55]  J. Rafiee,et al.  Wavelet basis functions in biomedical signal processing , 2011, Expert Syst. Appl..