Recognition of Facial Emotion through Face Analysis based on Quadratic Bezier Curves

Emotion recognition is a challenging task of human-computer interface in wireless communication. Emotion recognition from speech has a problem with the quality of the input voice, which is difficult to ensure in the mobile environment. On the contrary, facial emotion recognition is one of the interesting subjects due to the relevance of the expressions on human emotions. This paper proposes an automatic extraction and interpretation method of facial expression using extraction of feature points and variation of the Bezier curve from still image. The proposed algorithm has three steps to recognize the facial emotion: (1) Detecting facial regions with feature map, (2) Drawing the Bezier curve on eye and mouth, and (3) Classifying the emotion of characteristic with Hausdorff distance. To evaluate the proposed recognition scheme, we estimate a success-ratio with emotionally expressive facial image repository. Experimental results show average 76.1% of success to interpret and classify the facial expression and emotion.

[1]  Hatice Gunes,et al.  Automatic Temporal Segment Detection and Affect Recognition From Face and Body Display , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Montse Pardàs,et al.  Emotion recognition based on MPEG-4 Facial Animation Parameters , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Golam Sorwar,et al.  Finding significant points for parametric curve generation techniques , 2008 .

[4]  Yasunari Yoshitomi,et al.  Facial expression recognition for speaker using thermal image processing and speech recognition system , 2010 .

[5]  C. Maaoui,et al.  Emotion Recognition through Physiological Signals for Human-Machine Communication , 2010 .

[6]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[7]  Stefanos D. Kollias,et al.  An intelligent system for facial emotion recognition , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Abdul Wahab,et al.  Driver behavior analysis through speech emotion understanding , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[9]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[10]  Samuel R. Buss,et al.  3D Computer Graphics: A Mathematical Introduction with OpenGL , 2003 .

[11]  Kostas Karpouzis,et al.  Emotion recognition through facial expression analysis based on a neurofuzzy network , 2005, Neural Networks.

[12]  Jong Hyuk Park,et al.  Energy Efficient Distributed Face Recognition in Wireless Sensor Network , 2011, Wirel. Pers. Commun..

[13]  Maja Pantic,et al.  Spontaneous vs. posed facial behavior: automatic analysis of brow actions , 2006, ICMI '06.

[14]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[15]  Manuel Graña,et al.  EMOTION RECOGNITION BASED ON THE ANALYSIS OF FACIAL EXPRESIONS: A SURVEY , 2009 .

[16]  Anis Yazidi,et al.  A User-Centric Approach for Personalized Service Provisioning in Pervasive Environments , 2011, Wirel. Pers. Commun..

[17]  Nicu Sebe,et al.  Multimodal approaches for emotion recognition: a survey , 2005, IS&T/SPIE Electronic Imaging.

[18]  Thomas S. Huang,et al.  Emotion Recognition from Facial Expressions using Multilevel HMM , 2000 .

[19]  Hiroshi Sasaki,et al.  Wireless User Perspectives in Europe: HandSmart Mediaphone Interface , 2002, Wirel. Pers. Commun..

[20]  Ryoichi Komiya,et al.  Comparison between fuzzy and NN method for speech emotion recognition , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[21]  Tsang-Long Pao,et al.  Recognition and analysis of emotion transition in mandarin speech signal , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[22]  Young Joon Ahn,et al.  An approximation of circular arcs by quartic Bézier curves , 2007, Comput. Aided Des..

[23]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Myung Jin Bae,et al.  On a Speech Multiple System Implementation for Speech Synthesis , 2009, Wirel. Pers. Commun..

[25]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[26]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[27]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Rui Xia,et al.  Sentence level emotion recognition based on decisions from subsentence segments , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).