Emotion classification using single-channel scalp-EEG recording

Several studies have found evidence for corticolimbic Theta electroencephalographic (EEG) oscillation in the neural processing of visual stimuli perceived as fear or threatening scene. Recent studies showed that neural oscillations' patterns in Theta, Alpha, Beta and Gamma sub-bands play a main role in brain's emotional processing. The main goal of this study is to classify two different emotional states by means of EEG data recorded through a single-electrode EEG headset. Nineteen young subjects participated in an EEG experiment while watching a video clip that evoked three emotional states: neutral, relaxation and scary. Following each video clip, participants were asked to report on their subjective affect by giving a score between 0 to 10. First, recorded EEG data were preprocessed by stationary wavelet transform (SWT) based denoising to remove artifacts. Afterward, the distribution of power in time-frequency space was obtained using short-time Fourier transform (STFT) and then, the mean value of energy was calculated for each EEG sub-band. Finally, 46 features, as the mean energy of frequency bands between 4 and 50 Hz, containing 689 instances - for each subject -were collected in order to classify the emotional states. Our experimental results show that EEG dynamics induced by horror and relaxing movies can be classified with average classification rate of 92% using support vector machine (SVM) classifier. We also compared the performance of SVM to K-nearest neighbors (K-NN). The results show that K-NN achieves a better classification rate by 94% accuracy. The findings of this work are expected to pave the way to a new horizon in neuroscience by proving the point that only single-channel EEG data carry enough information for emotion classification.

[1]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[2]  Ido Amihai,et al.  Arousal vs. Relaxation: A Comparison of the Neurophysiological and Cognitive Correlates of Vajrayana and Theravada Meditative Practices , 2014, PloS one.

[3]  D. Pizzagalli,et al.  Prefrontal Oscillations during Recall of Conditioned and Extinguished Fear in Humans , 2014, The Journal of Neuroscience.

[4]  I. Christie,et al.  Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[5]  Jeffrey S. Spence,et al.  Electrophysiological spatiotemporal dynamics during implicit visual threat processing , 2014, Brain and Cognition.

[6]  Amir Rastegarnia,et al.  Artifact characterization and removal for in vivo neural recording , 2014, Journal of Neuroscience Methods.

[7]  G. D. Jacobs,et al.  EEG Spectral Analysis of Relaxation Techniques , 2004, Applied psychophysiology and biofeedback.

[8]  R. Davidson What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research , 2004, Biological Psychology.

[9]  Amir Rastegarnia,et al.  A Wavelet-Based Artifact Reduction From Scalp EEG for Epileptic Seizure Detection , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Kenneth Sundaraj,et al.  Optimal set of EEG features for emotional state classification and trajectory visualization in Parkinson's disease. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Debatri Chatterjee,et al.  Cognitive load measurement - A methodology to compare low cost commercial EEG devices , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[12]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .

[13]  Toshihisa Tanaka,et al.  Artifact suppression from EEG signals using data adaptive time domain filtering , 2012, Neurocomputing.

[14]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[15]  Andrea Petracca,et al.  A real-time classification algorithm for EEG-based BCI driven by self-induced emotions , 2015, Comput. Methods Programs Biomed..

[16]  L. Buydens,et al.  Facilitating the application of Support Vector Regression by using a universal Pearson VII function based kernel , 2006 .

[17]  P. Ekman,et al.  Emotion and autonomic nervous system activity in the Minangkabau of west Sumatra. , 1992, Journal of personality and social psychology.

[18]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  T. Costa,et al.  Relationship between adult attachment patterns, emotional experience and EEG frontal asymmetry , 2008 .

[20]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[21]  Bao-Liang Lu,et al.  Emotion classification based on gamma-band EEG , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Pasin Israsena,et al.  Emotion classification using minimal EEG channels and frequency bands , 2013, The 2013 10th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[23]  Bruce R. Dunn,et al.  Concentration and Mindfulness Meditations: Unique Forms of Consciousness? , 1999, Applied psychophysiology and biofeedback.

[24]  Eamonn J. Keogh A Gentle Introduction to Machine Learning and Data Mining for the Database Community , 2003, SBBD.

[25]  John J. B. Allen,et al.  Frontal EEG asymmetry as a moderator and mediator of emotion , 2004, Biological Psychology.

[26]  S. Hsieh,et al.  Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns , 2014, PloS one.

[27]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[28]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[29]  World Medical Association (WMA),et al.  Declaration of Helsinki. Ethical Principles for Medical Research Involving Human Subjects , 2009, Journal of the Indian Medical Association.

[30]  Leontios J. Hadjileontiadis,et al.  A Novel Emotion Elicitation Index Using Frontal Brain Asymmetry for Enhanced EEG-Based Emotion Recognition , 2011, IEEE Transactions on Information Technology in Biomedicine.

[31]  C. Sidney Burrus,et al.  Convolution using the undecimated discrete wavelet transform , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[32]  J. Krystal,et al.  A Meta-analysis of D-cycloserine and the Facilitation of Fear Extinction and Exposure Therapy , 2022 .

[33]  J. Henry,et al.  A meta-analytic review of emotion recognition and aging: Implications for neuropsychological models of aging , 2008, Neuroscience & Biobehavioral Reviews.

[34]  Olga Sourina,et al.  Real-Time EEG-Based Emotion Recognition and Its Applications , 2011, Trans. Comput. Sci..

[35]  Pasin Israsena,et al.  Real-Time EEG-Based Happiness Detection System , 2013, TheScientificWorldJournal.