Emotion induction and emotion recognition using their physiological signals

This study is related with emotions and their recognition. Three different emotional states (boredom, pain and surprise) are evoked by emotional stimuli, physiological signals (EDA, ECG, PPG and SKT) for the induced emotions are measured as the reactions of stimuli, and 27 features are extracted from their physiological signals for emotion recognition. The stimuli are used to provoke emotions and tested their appropriateness and effectiveness. Audio-visual film clips used as stimuli are captured originally from movies, documentary, and TV shows with the appropriateness of 86%, 97.3% and 94.1% for boredom, pain and surprise, respectively, and the effectiveness of 5.23 for happiness, 4.96 for pain and 6.12 for surprise (7 point Likert scale). Also, for the three emotion recognition, we propose a Fuzzy c-means clustering based neural networks using the physiological signals. The proposed model consists of three layers, namely, input, hidden and output layers. Here, fuzzy c-means clustering method, two types of polynomial and linear combination function are used as a kernel function in the input layer, the hidden layer and the output layer of neural networks, respectively. To evaluate the performance of emotion recognition of the proposed model, we use the 10-fold cross validation and a comparative analysis shows that the proposed model exhibit higher accuracy when compared with some other models that exist in the literature.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[3]  R. D. Young,et al.  Emotional reactions to dramatic film stimuli: the influence of cognitive and emotional empathy. , 1987, Journal of personality and social psychology.

[4]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[5]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[6]  A. Angrilli,et al.  Cardiac responses associated with affective processing of unpleasant film stimuli. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[7]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[8]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Robert M. Gray,et al.  Lloyd clustering of Gauss mixture models for image compression and classification , 2005, Signal Process. Image Commun..

[10]  P. Drummond,et al.  The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians. , 2001, Psychophysiology.

[11]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[12]  R. Lazarus,et al.  A laboratory study of psychological stress produced by a motion picture film. , 1962 .

[13]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[14]  M. V. Velzen,et al.  Self-organizing maps , 2007 .