Personalization Effect on Emotion Recognition from Physiological Data: An Investigation of Performance on Different Setups and Classifiers

This paper addresses the problem of emotion recognition from physiological signals. Features are extracted and ranked based on their effect on classification accuracy. Different classifiers are compared. The inter-subject variability and the personalization effect are thoroughly investigated, through trial-based and subject-based cross-validation. Finally, a personalized model is introduced, that would allow for enhanced emotional state prediction, based on the physiological data of subjects that exhibit a certain degree of similarity, without the requirement of further feedback.

[1]  Mykola Pechenizkiy,et al.  Stress detection from speech and Galvanic Skin Response signals , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[2]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[3]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[4]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[5]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[6]  Dan Wang,et al.  Modeling Physiological Data with Deep Belief Networks. , 2013, International journal of information and education technology.

[7]  Chao Chen,et al.  Using Random Forest to Learn Imbalanced Data , 2004 .

[8]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[9]  Pasin Israsena,et al.  Real-Time EEG-Based Happiness Detection System , 2013, TheScientificWorldJournal.

[10]  Martin Buss,et al.  Feature Extraction and Selection for Emotion Recognition from EEG , 2014, IEEE Transactions on Affective Computing.

[11]  Subramanian Ramanathan,et al.  User-centric Affective Video Tagging from MEG and Peripheral Physiological Responses , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[12]  J. Russell.  A circumplex model of affect. , 1980 .

[13]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[15]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[16]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[17]  D. Song,et al.  EEG Based Emotion Identification Using Unsupervised Deep Feature Learning , 2015 .

[18]  Mélodie Vidal,et al.  Analysing EOG signal features for the discrimination of eye movements with wearable devices , 2011, PETMEI '11.

[19]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.