Towards the development of physiological models for emotions evaluation*

In the last decades numerous researches have revealed a strong link between emotions and several physiological responses. However, the automatic recognition of emotions still remains a challenge. In this work we describe a novel approach to estimate valence, arousal and dominance values from various biological parameters (derived from electrodermal activity, heart rate variability signal and electroencephalography), by means of multiple linear regression models. The models training was performed by using a set of pictures pre-evaluated in terms of valence, arousal and dominance, selected from the International Affective Picture System (IAPS) database. By using the step-wise regression method, all the possible combinations of considered biological parameters were tested as input variables for the models. The three multiple linear regression models that could provide the best fit for IAPS pictures valence, arousal and dominance values were selected. The features included in the optimal models were the average of the inter-beat duration (mean RR), the EEG spectral power computed in alpha, beta and theta frequency bands (Alpha, Beta and Theta power) and the average value of EDA signal (mean EDA). The obtained models show an overall good performance in predicting valence, arousal and dominance values.

[1]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[2]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[3]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[4]  L. Aftanas,et al.  Time-dependent cortical asymmetries induced by emotional arousal: EEG analysis of event-related synchronization and desynchronization in individually defined frequency bands. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[5]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[6]  Giovanni Vecchiato,et al.  Analysis of EEG variables to measure the affective dimensions of arousal and valence related to the vision of emotional pictures , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andreas Kerren,et al.  A survey of technologies on the rise for emotion-enhanced interaction , 2015, J. Vis. Lang. Comput..

[10]  L. de Silva,et al.  Facial emotion recognition using multi-modal information , 1997, Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat..

[11]  Measuring arousal in consumer research: a new EDA signal processing method , 2012 .

[12]  Claude Frasson,et al.  Exploring the Relationship between Learner EEG Mental Engagement and Affect , 2010, Intelligent Tutoring Systems.

[13]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[14]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[15]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[16]  Mariano Alcañiz Raya,et al.  A Comparison of Physiological Signal Analysis Techniques and Classifiers for Automatic Emotional Evaluation of Audiovisual Contents , 2016, Front. Comput. Neurosci..

[17]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[18]  M. Bensafi,et al.  Autonomic nervous system responses to odours: the role of pleasantness and arousal. , 2002, Chemical senses.

[19]  Carlo Vercellis,et al.  Business Intelligence: Data Mining and Optimization for Decision Making , 2009 .

[20]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[21]  Anna M. Bianchi,et al.  Integrated data analysis for the quantification of emotional responses during video observation , 2017, 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI).

[22]  L. Aftanas,et al.  Affective picture processing: event-related synchronization within individually defined human theta band is modulated by valence dimension. , 2001, Neuroscience Letters.

[23]  Paul Gerrard,et al.  Mechanisms of modafinil: A review of current research , 2007, Neuropsychiatric disease and treatment.

[24]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[25]  Oliver W. Sakowitz,et al.  Oscillatory frontal theta responses are increased upon bisensory stimulation , 2000, Clinical Neurophysiology.

[26]  Ashutosh Gupta,et al.  Correlation of Neuromarketing to Neurology , 2017 .