Emotion detection using noninvasive low cost sensors

Emotion recognition from biometrics is relevant to a wide range of application domains, including healthcare. Existing approaches usually adopt multi-electrodes sensors that could be expensive or uncomfortable to be used in real-life situations. In this study, we investigate whether we can reliably recognize high vs. low emotional valence and arousal by relying on noninvasive low cost EEG, EMG, and GSR sensors. We report the results of an empirical study involving 19 subjects. We achieve state-of-the-art classification performance for both valence and arousal even in a cross-subject classification setting, which eliminates the need for individual training and tuning of classification models.

[1]  S. Murugappan,et al.  Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT) , 2013, 2013 IEEE 9th International Colloquium on Signal Processing and its Applications.

[2]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Andrew Begel,et al.  Using psycho-physiological measures to assess task difficulty in software development , 2014, ICSE.

[4]  Yihong Gong,et al.  Recognition of multiple drivers’ emotional state , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  A. Alias,et al.  Motivation and emotion , 2009 .

[6]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hugo Silva,et al.  Multimodal biosignal sensor data handling for emotion recognition , 2011, 2011 IEEE SENSORS Proceedings.

[8]  Maja Pantic,et al.  The Automatic Detection of Chronic Pain-Related Expression: Requirements, Challenges and the Multimodal EmoPain Dataset , 2016, IEEE Transactions on Affective Computing.

[9]  Myer Kutz,et al.  Standard Handbook of Biomedical Engineering and Design , 2002 .

[10]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[11]  Thierry Pun,et al.  Multimodal Emotion Recognition in Response to Videos , 2012, IEEE Transactions on Affective Computing.

[12]  R. Plutchik Emotions : a general psychoevolutionary theory , 1984 .

[13]  Stefan Schmidt,et al.  Electrodermal Activity (Eda) -- State-of-the-Art Measurement and Techniques for Parapsychological Purposes , 1999 .

[14]  R. Lazarus Emotion and Adaptation , 1991 .

[15]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[16]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[17]  Enzo Pasquale Scilingo,et al.  Autonomic Nervous System Dynamics for Mood and Emotional-State Recognition: Significant Advances in Data Acquisition, Signal Processing and Classification , 2013 .

[18]  Kai Juan Wong,et al.  Analysis of physiological responses from multiple subjects for emotion recognition , 2012, 2012 IEEE 14th International Conference on e-Health Networking, Applications and Services (Healthcom).

[19]  Max Kuhn,et al.  caret: Classification and Regression Training , 2015 .

[20]  Christine L. Lisetti,et al.  Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals , 2004, EURASIP J. Adv. Signal Process..

[21]  H. Prendinger,et al.  Emotion Recognition from Electromyography and Skin Conductance , 2005 .

[22]  Alain Pruski,et al.  Emotion recognition from physiological signals using fusion of wavelet based features , 2015, 2015 7th International Conference on Modelling, Identification and Control (ICMIC).

[23]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[24]  Enzo Pasquale Scilingo,et al.  Autonomic nervous system dynamics for mood and emotional-state recognition , 2014 .

[25]  John L. Sibert,et al.  Heart rate variability: indicator of user state as an aid to human-computer interaction , 1998, CHI.

[26]  Fethi Bereksi-Reguig,et al.  Negative emotion detection using EMG signal , 2014, 2014 International Conference on Control, Decision and Information Technologies (CoDIT).

[27]  Nicole Novielli,et al.  Cognitive Emotion Modeling in Natural Language Communication , 2009, Affective Information Processing.