Recognition of emotions induced by music videos using DT-CWPT

Viewers are attracted and attached to multimedia content due to their emotional experience associated with it. In this paper, we present an emotion recognition method of EEG signals elicited while watching music videos. The emotional features are extracted from EEG signals using dual-tree complex wavelet packet transform (DT-CWPT). The most discriminating emotional features are selected by Singular value decomposition (SVD), QR factorization with column pivoting (QRcp) and F-ratio based method. The selected features are used to train support vector machine (SVM) to classify emotion for each video using leave-one-out cross-validation strategy.

[1]  Fuji Ren,et al.  Affective Information Processing and Recognizing Human Emotion , 2006, MFCSIT.

[2]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[3]  Touradj Ebrahimi,et al.  Implicit emotional tagging of multimedia using EEG signals and brain computer interface , 2009, WSM@MM.

[4]  Yaacob Sazali,et al.  Classification of human emotion from EEG using discrete wavelet transform , 2010 .

[5]  Yihong Gong,et al.  Recognition of multiple drivers’ emotional state , 2008, 2008 19th International Conference on Pattern Recognition.

[6]  Gene H. Golub,et al.  Matrix computations , 1983 .

[7]  Nick G. Kingsbury,et al.  Design of Q-shift complex wavelets for image processing using frequency domain energy minimization , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Partha Pratim Kanjilal,et al.  On robust nonlinear modeling of a complex process with large number of inputs using m-QRcp factorization and Cp statistic , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .

[10]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[11]  Christine L. Lisetti,et al.  Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals , 2004, EURASIP J. Adv. Signal Process..

[12]  Ivan W. Selesnick,et al.  On the Dual-Tree Complex Wavelet Packet and $M$-Band Transforms , 2008, IEEE Transactions on Signal Processing.

[13]  J. Russell.  Culture and the categorization of emotions. , 1991, Psychological bulletin.

[14]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[15]  Mohammad A. Khalilzadeh,et al.  EMOTIONAL STRESS RECOGNITION SYSTEM FOR AFFECTIVE COMPUTING BASED ON BIO-SIGNALS , 2010 .

[16]  Goutam Saha,et al.  In Search of an SVD and QRcp Based Optimization Technique of ANN for Automatic Classification of Abnormal Heart Sounds , 2008 .

[17]  J. Russell.  A circumplex model of affect. , 1980 .

[18]  N. Kingsbury.  Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[19]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  M. Murugappan,et al.  Time-Frequency Analysis of EEG Signals for Human Emotion Detection , 2008 .

[21]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[22]  Mohammad Soleymani,et al.  Queries and tags in affect-based multimedia retrieval , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[23]  Sazali Yaacob,et al.  An investigation on visual and audiovisual stimulus based emotion recognition using EEG , 2009, Int. J. Medical Eng. Informatics.

[24]  Mohammad Soleymani,et al.  Continuous emotion detection in response to music videos , 2011, Face and Gesture 2011.

[25]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[26]  W. G. Parrott,et al.  Emotions in social psychology : essential readings , 2001 .

[27]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[28]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..