Emotion Recognition System by a Neural Network Based Facial Expression Analysis

Human-computer interfaces are getting more complex every day with the purpose of easing the use of computers and enhancing the overall user experience. Since research has shown that a majority of human interaction comes from non-verbal communication, user emotion detection is one of the directions that can be taken to enhance the overall user experience. This paper proposes a system for human emotion recognition by analyzing key facial regions using principal component analysis and neural networks. The proposed system has been trained and tested on the FEEDTUM database where it achieved a relatively high average score of correct recognition and therefore showed promise for future development.

[1]  H. Critchley,et al.  Neural correlates of processing valence and arousal in affective words. , 2006, Cerebral cortex.

[2]  Hatice Gunes,et al.  Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal Space , 2011, IEEE Transactions on Affective Computing.

[3]  Christine L. Lisetti,et al.  Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals , 2004, EURASIP J. Adv. Signal Process..

[4]  Margaret Lech,et al.  Facial Expression Recognition Using Neural Networks and Log-Gabor Filters , 2008, 2008 Digital Image Computing: Techniques and Applications.

[5]  S. Demleitner.  [Communication without words]. , 1997, Pflege aktuell.

[6]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Sazali Yaacob,et al.  Genetic Algorithm and Neural Network for Face Emotion Recognition , 2008 .

[8]  Eric Patterson,et al.  Emotion recognition using facial expressions with active appearance models , 2008 .

[9]  R. Gunderman,et al.  Emotional intelligence. , 2011, Journal of the American College of Radiology : JACR.

[10]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.

[11]  Frank Dellaert,et al.  Recognizing emotion in speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[12]  L. F. Barrett,et al.  Knowing what you're feeling and knowing what to do about it: Mapping the relation between emotion differentiation and emotion regulation , 2001 .

[13]  H. Li.  Computer recognition of human emotions , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[14]  Sazali Yaacob,et al.  Development of a personified face emotion recognition technique using fitness function , 2007, Artificial Life and Robotics.

[15]  Stefanos D. Kollias,et al.  An intelligent system for facial emotion recognition , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[16]  Nectarios Rose,et al.  Facial Expression Classification using Gabor and Log-Gabor Filters , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[17]  P. Lang,et al.  Affective judgment and psychophysiological response: Dimensional covariation in the evaluation of pictorial stimuli. , 1989 .

[18]  Roberto Valenti,et al.  Automatic facial emotion recognition , 2005 .

[19]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[20]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.