Hilbert-Huang transform based physiological signals analysis for emotion recognition

This paper presents a feature extraction technique based on the Hilbert-Huang Transform (HHT) method for emotion recognition from physiological signals. Four kinds of physiological signals were used for analysis: electrocardiogram (ECG), electromyogram (EMG), skin conductivity (SC) and respiration changes (RSP). Each signal is decomposed into a finite set of AM-FM mono components (fission process) by the Empirical Mode Decomposition (EMD) which is the key part of the HHT. The information components of interest are then combined to create feature vectors (fusion process) for the next classification stage. In addition, classification is performed by using Support Vector Machines (SVM). The classification scores show that HHT based methods outperform traditional statistical techniques and provide a promising framework for both analysis and recognition of physiological signals in emotion recognition.

[1]  Toshihisa Tanaka,et al.  Complex Empirical Mode Decomposition for Multichannel Information Fusion , 2008 .

[2]  Gabriel Rilling,et al.  On empirical mode decomposition and its algorithms , 2003 .

[3]  Zhizhong Wang,et al.  Mean frequency derived via Hilbert-Huang transform with application to fatigue EMG signal analysis , 2006, Comput. Methods Programs Biomed..

[4]  R. Cohen,et al.  An Efficient Algorithm for Spectral Analysis of Heart Rate Variability , 1986, IEEE Transactions on Biomedical Engineering.

[5]  Rameswar Debnath,et al.  A decision based one-against-one method for multi-class support vector machine , 2004, Pattern Analysis and Applications.

[6]  Li Helong,et al.  Application of Hilbert-Huang Transform to Heart Rate Variability Analysis , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[7]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Nigel H. Lovell,et al.  Accelerometry based classification of gait patterns using empirical mode decomposition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Antoine Cornuéjols,et al.  Apprentissage artificiel - Concepts et algorithmes , 2003 .

[10]  Dong-Soo Kwon,et al.  Emotional interaction model for a service robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  M. S. Woolfson,et al.  Application of empirical mode decomposition to heart rate variability analysis , 2001, Medical and Biological Engineering and Computing.

[12]  Alain Pruski,et al.  Emotion recognition for human-machine communication , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[14]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[16]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[17]  E P Souza Neto,et al.  Assessment of Cardiovascular Autonomic Control by the Empirical Mode Decomposition , 2004, Methods of Information in Medicine.

[18]  D. Sloan,et al.  Emotion regulation in action: emotional reactivity in experiential avoidance. , 2004, Behaviour research and therapy.