Emotion recognition from facial EMG signals using higher order statistics and principal component analysis

Higher order statistics (HOS) is an efficient feature extraction method used in diverse applications such as bio signal processing, seismic data processing, image processing, sonar, and radar. In this work, we have investigated the application of HOS to derive a set of features from facial electromyography (fEMG) signals for classifying six emotional states (happy, sad, afraid, surprised, disgusted, and neutral). fEMG signals were collected from different types of subjects in a controlled environment using audio-visual (film clips/ video clips) stimuli. Acquired fEMG signals were preprocessed using moving average filter and a set of statistical features were extracted from fEMG signals. Extracted features were mapped into corresponding emotions using k-nearest neighbor classifier. Principal component analysis was utilized to analyze the efficacy of HOS features over conventional statistical features on retaining the emotional information retrieval from fEMG signals. The results of this work indicate an improved mean emotion recognition rate of 69.5% from this proposed methodology to recognize six emotional states.

[1]  Christos D. Katsis,et al.  A User Independent, Biosignal Based, Emotion Recognition Method , 2007, User Modeling.

[2]  G. Tsolis,et al.  Signal Denoising Using Empirical Mode Decomposition and Higher Order Statistics , 2011 .

[3]  Christine L. Lisetti,et al.  Emotion recognition from physiological signals using wireless sensors for presence technologies , 2004, Cognition, Technology & Work.

[4]  Ganesh R. Naik,et al.  Evaluation of higher order statistics parameters for multi channel sEMG using different force levels , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Jacqueline Walker,et al.  Application of higher order statistics techniques to EMG signals to characterize the motor unit action potential , 2005, IEEE Transactions on Biomedical Engineering.

[6]  Stavros M. Panas,et al.  Enhancement of R-wave detection in ECG data analysis using higher-order statistics , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  M. H. Schut,et al.  Computing emotion awareness through galvanic skin response and facial electromyography , 2008 .

[8]  Lan Li,et al.  Emotion Recognition Using Physiological Signals from Multiple Subjects , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[9]  Michel Besserve,et al.  Classification methods for ongoing EEG and MEG signals. , 2007, Biological research.

[10]  Elisabeth André,et al.  Four-Channel Biosignal Analysis and Feature Extraction for Automatic Emotion Recognition , 2008, BIOSTEC.

[11]  Wen Wan-Hui,et al.  Electrocardiography Recording, Feature Extraction and Classification for Emotion Recognition , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[12]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[13]  Béatrice de Gelder,et al.  Emotional contagion for unseen bodily expressions , 2008 .

[14]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[15]  Nilanjan Sarkar,et al.  A New Approach to Implicit Human-Robot Interaction Using Affective Cues , 2006 .

[16]  Novakovic Jasmina,et al.  Classification Accuracy of Neural Networks with PCA in Emotion Recognition , 2011 .

[17]  Mohamed Chetouani,et al.  Hilbert-Huang transform based physiological signals analysis for emotion recognition , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[18]  J. Arroyo-Palacios.  Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems , 2008 .

[19]  Anton van Boxtel,et al.  Facial EMG as a tool for inferring affective states , 2010 .

[20]  T. James,et al.  Affective auditory stimuli: Characterization of the International Affective Digitized Sounds (IADS) by discrete emotional categories , 2008, Behavior research methods.

[21]  A. Ebrahimzadeh,et al.  Higher order statistics for automated classification of ECG beats , 2011, 2011 International Conference on Electrical and Control Engineering.

[22]  Minjuan Wang,et al.  Affective e-Learning: Using "Emotional" Data to Improve Learning in Pervasive Learning Environment , 2009, J. Educ. Technol. Soc..

[23]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Shanxiao Yang,et al.  Emotion Recognition of Electromyography Based on Support Vector Machine , 2010, 2010 Third International Symposium on Intelligent Information Technology and Security Informatics.

[26]  Carlos A. Duque,et al.  HOS-based method for classification of power quality disturbances , 2009 .

[27]  Bo Cheng,et al.  Emotion Recognition from Surface EMG Signal Using Wavelet Transform and Neural Network , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[28]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[29]  L.B.P. Ang,et al.  Facial expression recognition through pattern analysis of facial muscle movements utilizing electromyogram sensors , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[30]  S. Porges,et al.  Emotion Recognition in Children with Autism Spectrum Disorders: Relations to Eye Gaze and Autonomic State , 2010, Journal of autism and developmental disorders.

[31]  C. Maaoui,et al.  Emotion Recognition through Physiological Signals for Human-Machine Communication , 2010 .

[32]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[33]  Robert X. Gao,et al.  PCA-based feature selection scheme for machine defect classification , 2004, IEEE Transactions on Instrumentation and Measurement.

[34]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .