Factor Analysis for Finding Invariant Neural Descriptors of Human Emotions

A major challenge in decoding human emotions from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intrasubject differences. Most of the previous studies are focused in building an individual discrimination model for every subject (subject dependent model). Building subject-independent models is a harder problem due to the high data variability between different subjects and different experiments with the same subject. This paper explores, for the first time, the Factor Analysis as an efficient technique to extract temporal and spatial EEG features suitable to build brain-computer interface for decoding human emotions across various subjects. Our findings show that early waves (temporal window of 200–400 ms after the stimulus onset) carry more information about the valence of the emotion. Also, spatial location of features, with a stronger impact on the emotional valence, occurs in the parietal and occipital regions of the brain. All discrimination models (NN, SVM, kNN, and RF) demonstrate better discrimination rate of the positive valence. These results match closely experimental psychology hypothesis that, during early periods after the stimulus presentation, the brain response—to images with highly positive valence—is stronger.

[1]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[2]  Jiahui Pan,et al.  Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition , 2017, Comput. Intell. Neurosci..

[3]  Isabel M. Santos,et al.  EEG-based Subject Independent Affective Computing Models , 2015, INNS Conference on Big Data.

[4]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[5]  Guido Sanguinetti,et al.  Single-trial classification of EEG in a visual object task using ICA and machine learning , 2014, Journal of Neuroscience Methods.

[6]  Robert E. Schapire,et al.  Explaining AdaBoost , 2013, Empirical Inference.

[7]  Petia D. Koprinkova-Hristova,et al.  Learning to decode human emotions with Echo State Networks , 2016, Neural Networks.

[8]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[9]  Pasin Israsena,et al.  Real-Time EEG-Based Happiness Detection System , 2013, TheScientificWorldJournal.

[10]  Francesco Masulli,et al.  Unsupervised Analysis of Event-Related Potentials (ERPs) During an Emotional Go/NoGo Task , 2016, WILF.

[11]  Petia Georgieva,et al.  Brain Neural Data Analysis with Feature Space Defined by Descriptive Statistics , 2015, IbPRIA.

[12]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[13]  Chi Zhang,et al.  Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain , 2017, BioMed research international.

[14]  Herbert Jaeger,et al.  Echo state network , 2007, Scholarpedia.

[15]  Jian Zhang,et al.  Deep Extreme Learning Machine and Its Application in EEG Classification , 2015 .

[16]  A. Keil,et al.  Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception. , 2006, Cerebral cortex.

[17]  Juan José Rodríguez Diez,et al.  Interval feature extraction for classification of event-related potentials (ERP) in EEG data analysis , 2013, Progress in Artificial Intelligence.

[18]  Isabel M. Santos,et al.  Learning to decode human emotions from event-related potentials , 2014, Neural Computing and Applications.

[19]  Miyoung Kim,et al.  A Review on the Computational Methods for Emotional State Estimation from the Human EEG , 2013, Comput. Math. Methods Medicine.

[20]  J. Akunna,et al.  Surface and groundwater water quality assessment using multivariate analytical methods: a case study of the Western Niger Delta, Nigeria , 2008 .

[21]  John Polich,et al.  Affective visual event-related potentials: Arousal, repetition, and time-on-task , 2007, Biological Psychology.

[22]  Andreas Mueller,et al.  Classification of ADHD patients on the basis of independent ERP components using a machine learning system , 2010, Nonlinear biomedical physics.

[23]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[24]  Rosa Gil,et al.  Method for Improving EEG Based Emotion Recognition by Combining It with Synchronized Biometric and Eye Tracking Technologies in a Non-invasive and Low Cost Way , 2016, Front. Comput. Neurosci..