Emotion recognition system using short-term monitoring of physiological signals

A physiological signal-based emotion recognition system is reported. The system was developed to operate as a user-independent system, based on physiological signal databases obtained from multiple subjects. The input signals were electrocardiogram, skin temperature variation and electrodermal activity, all of which were acquired without much discomfort from the body surface, and can reflect the influence of emotion on the autonomic nervous system. The system consisted of preprocessing, feature extraction and pattern classification stages. Preprocessing and feature extraction methods were devised so that emotion-specific characteristics could be extracted from short-segment signals. Although the features were carefully extracted, their distribution formed a classification problem, with large overlap among clusters and large variance within clusters. A support vector machine was adopted as a pattern classifier to resolve this difficulty. Correct-classification ratios for 50 subjects were 78.4% and 61.8%, for the recognition of three and four categories, respectively.

[1]  Richard J. Doyle,et al.  AI in Space: An international forum for Space AI and Robotics , 1999, IEEE Intell. Syst..

[2]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[3]  Petros Maragos,et al.  On amplitude and frequency demodulation using energy operators , 1993, IEEE Trans. Signal Process..

[4]  H Bung.  Automatic speech recognition and understanding : A first step toward natural human-machine communication , 2000 .

[5]  G.D. Pinna,et al.  Effects of record length selection on the accuracy of spectral estimates of heart rate variability: a simulation study , 1996, IEEE Transactions on Biomedical Engineering.

[6]  R. Cohen,et al.  An Efficient Algorithm for Spectral Analysis of Heart Rate Variability , 1986, IEEE Transactions on Biomedical Engineering.

[7]  K. Luan Phan,et al.  Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI , 2002, NeuroImage.

[8]  Jiang Li,et al.  A novel approach to analyze the result of polygraph , 2000, SMC.

[9]  H. Schwan,et al.  Biological Engineering , 1970 .

[10]  P. Drummond,et al.  The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians. , 2001, Psychophysiology.

[11]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[12]  Robert C. Spicer,et al.  Author's biography , 1993 .

[13]  V. Shusterman,et al.  Analysis of skin-temperature variability compared to variability of blood pressure and heart rate , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[14]  Anastasios Tefas,et al.  Using Support Vector Machines to Enhance the Performance of Elastic Graph Matching for Frontal Face Authentication , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  R. Mccraty,et al.  The effects of emotions on short-term power spectrum analysis of heart rate variability . , 1995, The American journal of cardiology.

[16]  S. Furui,et al.  Automatic recognition and understanding of spoken language - a first step toward natural human-machine communication , 2000, Proceedings of the IEEE.

[17]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  Rosalind W. Picard.  Affective Computing , 1997 .

[20]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[21]  Chih-Jen Lin,et al.  A tutorial on?-support vector machines , 2005 .

[22]  Masashi Yasuda,et al.  Development of a skin temperature measuring system for non-contact stress evaluation , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[23]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[24]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[25]  Wendy S. Ark,et al.  The Emotion Mouse , 1999, HCI.

[26]  P. Broersen,et al.  Facts and fiction in spectral analysis , 1998, IMTC/98 Conference Proceedings. IEEE Instrumentation and Measurement Technology Conference. Where Instrumentation is Going (Cat. No.98CH36222).

[27]  J. A. Bushman,et al.  Medical & biological engineering & computing , 2006, Medical and Biological Engineering and Computing.

[28]  Masahiro Fujita,et al.  Ethological modeling and architecture for an entertainment robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[29]  Jennifer Healey,et al.  Digital processing of affective signals , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[30]  J. Lagopoulos.  Electrodermal activity , 2007, Acta Neuropsychiatrica.

[31]  Haym Hirsh,et al.  Room service, AI-style , 1999, IEEE Intell. Syst..

[32]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[33]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[34]  Rosalind W. Picard,et al.  Signal processing for recognition of human frustration , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[35]  Koichi Sagawa,et al.  Time domain heart rate variability index for assessment of dynamic stress , 1998, Computers in Cardiology 1998. Vol. 25 (Cat. No.98CH36292).

[36]  J F Thayer,et al.  Autonomic balance revisited: panic anxiety and heart rate variability. , 1998, Journal of psychosomatic research.

[37]  Ramon Pallàs-Areny,et al.  A novel robust index to assess beat-to-beat variability in heart rate time-series analysis , 2001, IEEE Transactions on Biomedical Engineering.

[38]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Piet M. T. Broersen,et al.  Finite sample criteria for autoregressive order selection , 2000, IEEE Trans. Signal Process..