Dynamic Model of Facial Expression Recognition based on Eigen-face Approach

Abstract —Emotions are best way of communicating information; and sometimes it carry more information than words. Recently, there has been a huge interest in automatic recognition of human emotion because of its wide spread application in security, surveillance, marketing, advertisement, and human-computer interaction. To communicate with a computer in a natural way, it will be desirable to use more natural modes of human communication based on voice, gestures and facial expressions. In this paper, a holistic approach for facial expression recognition is proposed which captures the variation in facial features in temporal domain and classifies the sequence of images in different emotions. The proposed method uses Haar-like features to detect face in an image. The dimensionality of the eigenspace is reduced using Principal Component Analysis (PCA). By projecting the subsequent face images into principal eigen directions, the variation pattern of the obtained weight vector is modeled to classify it into different emotions. Owing to the variations of expressions for different people and its intensity, a person specific method for emotion recognition is followed. Using the gray scale images of the frontal face, the system is able to classify four basic emotions such as happiness, sadness, surprise, and anger.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[3]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[4]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Aurobinda Routray,et al.  A real time facial expression classification system using Local Binary Patterns , 2015, 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI).

[6]  Sungsoo Park,et al.  Spontaneous facial expression classification with facial motion vectors , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[7]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[8]  Bo Wu,et al.  Real time facial expression recognition with AdaBoost , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Mehmet Celenk,et al.  Spatio-temporal modeling of facial expressions using Gabor-wavelets and hierarchical hidden Markov models , 2005, IEEE International Conference on Image Processing 2005.

[10]  Thomas S. Huang,et al.  Emotion Recognition from Facial Expressions using Multilevel HMM , 2000 .

[11]  Maja Pantic,et al.  Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics , 2007, ICCV-HCI.

[12]  Zhao Zheng,et al.  Facial expression recognition based on PCA reconstruction , 2010, 2010 5th International Conference on Computer Science & Education.

[13]  Siu-Yeung Cho,et al.  Expression recognition using fuzzy spatio-temporal modeling , 2008, Pattern Recognit..

[14]  Prashant Lahane,et al.  Emotion Recognition from Facial Expressions using Multilevel HMM ( , 2014 .