Subject independent emotion recognition from EEG using VMD and deep learning

Abstract Emotion recognition from Electroencephalography (EEG) is proved to be a good choice as it cannot be mimicked like speech signals or facial expressions. EEG signals of emotions are not unique and it varies from person to person as each one has different emotional responses to the same stimuli. Thus EEG signals are subject dependent and proved to be effective for subject dependent emotion recognition. However, subject independent emotion recognition plays an important role in situations like emotion recognition from paralyzed or burnt face, where EEG of emotions of the subjects before the incidents are not available to build the emotion recognition model. Hence there is a need to identify common EEG patterns corresponds to each emotion independent of the subjects. In this paper, a subject independent emotion recognition technique is proposed from EEG signals using Variational Mode Decomposition (VMD) as a feature extraction technique and Deep Neural Network as the classifier. The performance evaluation of the proposed method with the benchmark DEAP dataset shows that the combination of VMD and Deep Neural Network performs better compared to the state of the art techniques in subject-independent emotion recognition from EEG.

[1]  Humera Farooq,et al.  Investigating EEG Patterns for Dual-Stimuli Induced Human Fear Emotional State , 2019, Sensors.

[2]  Gernot R. Müller-Putz,et al.  Domain Adaptation Techniques for EEG-Based Emotion Recognition: A Comparative Study on Two Public Datasets , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[3]  Yuan-Pin Lin,et al.  EEG-Based Emotion Recognition in Music Listening , 2010, IEEE Transactions on Biomedical Engineering.

[4]  Yi-Hung Liu,et al.  Single-trial EEG-based emotion recognition using kernel Eigen-emotion pattern and adaptive support vector machine , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ida Laila Ahmad,et al.  Determination of Angry Condition based on EEG, Speech and Heartbeat , 2012 .

[8]  Bin Hu,et al.  Exploring EEG Features in Cross-Subject Emotion Recognition , 2018, Front. Neurosci..

[9]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[10]  Olga Sourina,et al.  Real-Time Subject-Dependent EEG-Based Emotion Recognition Algorithm , 2014, Trans. Comput. Sci..

[11]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[12]  Soraia M. Alarcão,et al.  Emotions Recognition Using EEG Signals: A Survey , 2019, IEEE Transactions on Affective Computing.

[13]  Bin Hu,et al.  A Pervasive Approach to EEG-Based Depression Detection , 2018, Complex..

[14]  Thierry Pun,et al.  Multimodal Emotion Recognition in Response to Videos , 2012, IEEE Transactions on Affective Computing.

[15]  Sahar Moghimi,et al.  Toward automatic detection of brain responses to emotional music through analysis of EEG effective connectivity , 2016, Comput. Hum. Behav..

[16]  Turgay Kaya,et al.  Wavelet-based study of valence–arousal model of emotions on EEG signals with LabVIEW , 2016, Brain Informatics.

[17]  B. F. Momin,et al.  Stress detection and reduction using EEG signals , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[18]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[19]  Chi Zhang,et al.  Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain , 2017, BioMed research international.

[20]  Mohammad Soleymani,et al.  CROSS-CORPUS EEG-BASED EMOTION RECOGNITION , 2018, 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP).

[21]  Li Che,et al.  Feature Extraction and Reconstruction by Using 2D-VMD Based on Carrier-Free UWB Radar Application in Human Motion Recognition , 2019, Sensors.

[22]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[23]  Pasin Israsena,et al.  Real-Time EEG-Based Happiness Detection System , 2013, TheScientificWorldJournal.

[24]  T. Jung,et al.  Fusion of electroencephalographic dynamics and musical contents for estimating emotional responses in music listening , 2014, Front. Neurosci..

[25]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[26]  D. N. Tibarewala,et al.  EEG based emotion recognition system using MFDFA as feature extractor , 2015, 2015 International Conference on Robotics, Automation, Control and Embedded Systems (RACE).

[27]  J. Russell.  A circumplex model of affect. , 1980 .

[28]  John Atkinson,et al.  Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers , 2016, Expert Syst. Appl..

[29]  Suman Dabbu,et al.  ANN based Joint Time and frequency analysis of EEG for detection of driver drowsiness , 2017 .

[30]  J. Lerner,et al.  Emotion and decision making. , 2015, Annual review of psychology.

[31]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[32]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[33]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[34]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[35]  Klaus Wehrle,et al.  EEG-based automatic emotion recognition: Feature extraction, selection and classification methods , 2016, 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom).

[36]  Abeer J. Hani,et al.  American Clinical Neurophysiology Society Guideline 2: Guidelines for Standard Electrode Position Nomenclature , 2016, The Neurodiagnostic journal.

[37]  Hansa Rani Gupta,et al.  Power Spectrum Estimation using Welch Method for various Window Techniques , 2013 .

[38]  Yu Cao,et al.  ReliefF-Based EEG Sensor Selection Methods for Emotion Recognition , 2016, Sensors.

[39]  Aydin Akan,et al.  Emotion recognition from EEG signals by using multivariate empirical mode decomposition , 2018, Pattern Analysis and Applications.

[40]  Olga Sourina,et al.  Real-time EEG-based emotion monitoring using stable features , 2015, The Visual Computer.

[41]  K. R. Seeja,et al.  Subject-Independent Emotion Detection from EEG Signals Using Deep Neural Network , 2018, International Conference on Innovative Computing and Communications.

[42]  Dominique Zosso,et al.  Variational Mode Decomposition , 2014, IEEE Transactions on Signal Processing.

[43]  Konstantinos N. Plataniotis,et al.  Affect recognition using EEG signal , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[44]  Bao-Liang Lu,et al.  EEG-Based Emotion Recognition Using Frequency Domain Features and Support Vector Machines , 2011, ICONIP.

[45]  K. R. Seeja,et al.  Emotional State Recognition with EEG Signals Using Subject Independent Approach , 2018, WIR.

[46]  Javad Frounchi,et al.  Wavelet-based emotion recognition system using EEG signal , 2017, Neural Computing and Applications.