Emotion Assessment Based on Functional Connectivity Variability and Relevance Analysis

The evaluation of emotional states has relevance in the development of systems that can automatically interact with human beings. The use of brain mapping techniques, e.g., electroencephalogram (EEG), improves the robustness of the emotion assessment methodologies in comparison to those schemes that use only audiovisual information. However, the high amount of data derived from EEG and the complex spatiotemporal relationships among channels impose several signal processing issues. Recently, functional connectivity (FC) approaches have emerged as an alternative to estimate brain connectivity patterns from EEG. Thereby, FC allows depicting the cognitive processes inside the human brain to support further brain activity discrimination stages. In this work, we propose an FC-based strategy to classify emotional states from EEG data. Our approach comprises a variability-based representation from three different FC measures, i.e., correlation, coherence, and mutual information, and a supervised kernel-based scheme to quantify the relevance of each measure. Thus, our proposal codes the inter-subject brain activity variability regarding FC representations. Obtained results on a public dataset show that the introduced strategy is competitive in comparison to state-of-the-art methods classifying arousal and valence emotional dimensional spaces.

[1]  Ram Bilas Pachori,et al.  Detection of Human Emotions Using Features Based on the Multiwavelet Transform of EEG Signals , 2015, Brain-Computer Interfaces.

[2]  Francisco del Pozo,et al.  HERMES: Towards an Integrated Toolbox to Characterize Functional and Effective Brain Connectivity , 2013, Neuroinformatics.

[3]  Germán Castellanos-Domínguez,et al.  Emotion Discrimination Using Spatially Compact Regions of Interest Extracted from Imaging EEG Activity , 2016, Front. Comput. Neurosci..

[4]  Anton Nijholt,et al.  Emotional brain-computer interfaces , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[5]  Tiago H. Falk,et al.  Relevance vector classifier decision fusion and EEG graph-theoretic features for automatic affective state characterization , 2016, Neurocomputing.

[6]  Ting-Ting Yang,et al.  Gesture recognition based on HMM-FNN model using a Kinect , 2016, Journal on Multimodal User Interfaces.

[7]  Andreas Keil,et al.  Quantification of neural functional connectivity during an active avoidance task , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Mauricio A. Álvarez,et al.  SVM-based feature selection methods for emotion recognition from multimodal data , 2016, Journal on Multimodal User Interfaces.

[9]  Karl J. Friston Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[10]  Kalyana Chakravarthy Veluvolu,et al.  Identification of emotion associated brain functional network with phase locking value , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Mehryar Mohri,et al.  Algorithms for Learning Kernels Based on Centered Alignment , 2012, J. Mach. Learn. Res..

[12]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[13]  Thierry Pun,et al.  Multimodal Emotion Recognition in Response to Videos , 2012, IEEE Transactions on Affective Computing.

[14]  Goutam Saha,et al.  Classification of emotions induced by music videos and correlation with participants' rating , 2014, Expert Syst. Appl..