Online music emotion prediction on multiple sessions of EEG data using SVM

Electroencephalogram (EEG) has been used in the domain of emotion recognition, especially during the experience from music stimulus. A number of works have been submitted with promising results in emotion prediction tasks. Unfortunately, the majority of literature did not sufficiently take into account a non-stationary characteristic of EEG signals which could differ in each recording session, and this issue might be underlying reason why such research could not be transferred into real-world application. In this paper, we are proposing a novel solution by introducing a method of normalization across session. In particular, we performed a comparison of several normalization techniques to explore various techniques to address the issue of non-stationary in EEG data. The three proposed techniques in this study are rescaling, z-score standardization, and frequency band percentage. In our experiment, we collected EEG data from ten subjects in two scenarios: consecutive session and time varied session. Our emotion prediction results suggested that z-score technique was superior to other normalization techniques based on using support vector machine (SVM). To encourage other researchers to test the efficiency of their own approach with multiple session data, our dataset is publicly provided.

[1]  Olga Sourina,et al.  Stability of Features in Real-Time EEG-based Emotion Recognition Algorithm , 2014, 2014 International Conference on Cyberworlds.

[2]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[3]  Pasin Israsena,et al.  Emotion classification using minimal EEG channels and frequency bands , 2013, The 2013 10th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[4]  T. Jung,et al.  Fusion of electroencephalographic dynamics and musical contents for estimating emotional responses in music listening , 2014, Front. Neurosci..

[5]  LastMark Online classification of nonstationary data streams , 2002 .

[6]  Yi-Hung Liu,et al.  Single-trial EEG-based emotion recognition using kernel Eigen-emotion pattern and adaptive support vector machine , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Mark Last,et al.  Online classification of nonstationary data streams , 2002, Intell. Data Anal..

[8]  Masayuki Numao,et al.  EEG-Based Emotion Recognition during Music Listening , 2014 .

[9]  Li Li,et al.  Emotion recognition based on the sample entropy of EEG. , 2014, Bio-medical materials and engineering.

[10]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[11]  J. Russell A circumplex model of affect. , 1980 .

[12]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[13]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[14]  Yuan-Pin Lin,et al.  Exploring day-to-day variability in EEG-based emotion classification , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Olga Sourina,et al.  Real-Time Subject-Dependent EEG-Based Emotion Recognition Algorithm , 2014, Trans. Comput. Sci..

[16]  Pasin Israsena,et al.  Real-Time EEG-Based Happiness Detection System , 2013, TheScientificWorldJournal.

[17]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.