Automatic Facial Expression Recognition by Facial Parts Location with Boosted-LBP

This paper proposes an automatic facial expression recognition system, which uses new methods in both face detection and feature extraction. In this system, considering that facial expressions are related to a small set of muscles and limited ranges of motions, the facial expressions are recognized by these changes in video sequences. First, the differences between neutral and emotional states are detected. Faces can be automatically located from changing facial organs. Then, LBP features are applied and AdaBoost is used to find the most important features for each expression on essential facial parts. At last, SVM with polynomial kernel is used to classify expressions. The method is evaluated on JAFFE and MMI databases. The performances are better than other automatic or manual annotated systems.

[1]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[2]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[3]  Richard Bowden,et al.  Automatic Facial Expression Recognition Using Boosted Discriminatory Classifiers , 2007, AMFG.

[4]  Tarek M. Mahmoud,et al.  A Highly Efficient Content Based Approach to Filter Pornography Websites , 2012, Int. J. Comput. Vis. Image Process..

[5]  M. Pietikäinen,et al.  A discriminative feature space for detecting and recognizing faces , 2004, CVPR 2004.

[6]  Bruce A. Draper,et al.  The CSU Face Identification Evaluation System , 2005, Machine Vision and Applications.

[7]  Domenec Puig.  Collaborative Exploration Based on Simultaneous Localization and Mapping , 2013 .

[8]  Dimitrios I. Fotiadis,et al.  A Region Based Methodology for Facial Expression Recognition , 2008, BIOSIGNALS.

[9]  Shu Liao,et al.  Facial Expression Recognition using Advanced Local Binary Patterns, Tsallis Entropies and Global Appearance Features , 2006, 2006 International Conference on Image Processing.

[10]  Gwen Littlewort,et al.  Fully Automatic Facial Action Recognition in Spontaneous Behavior , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[11]  Shaogang Gong,et al.  A Comprehensive Empirical Study on Linear Subspace Methods for Facial Expression Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[12]  Toufik Taibi.  Design Pattern Formalization Techniques , 2007 .

[13]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[15]  Guodong Guo,et al.  Learning from examples in the small sample case: face expression recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Marimuthu Palaniswami,et al.  A Unified Approach to Support Vector Machines , 2008 .

[17]  M. Pietikäinen,et al.  Facial Expression Recognition with Local Binary Patterns and Linear Programming 1 , 2005 .

[18]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[19]  Bruce A. Draper,et al.  The CSU Face Identification Evaluation System: Its Purpose, Features, and Structure , 2003, ICVS.

[20]  Upendra Kumar,et al.  Significant Enhancement of Object Recognition Efficiency Using Human Cognition based Decision Clustering , 2013, Int. J. Comput. Vis. Image Process..

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Maja Pantic,et al.  Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[23]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[24]  Brijesh Verma,et al.  Pattern Recognition Technologies and Applications: Recent Advances , 2008 .

[25]  Rakesh Tripathi,et al.  Recognizing Facial Expression Using Particle Filter Based Feature Points Tracker , 2007, PReMI.

[26]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[27]  Enrique Muñoz,et al.  Recognising facial expressions in video sequences , 2007, Pattern Analysis and Applications.

[28]  Mohamed Fakir,et al.  Recognition of Color Objects Using Hybrids Descriptors , 2013, Int. J. Comput. Vis. Image Process..

[29]  Yll Haxhimusa,et al.  Artificial Visual Attention Using Combinatorial Pyramids , 2013 .

[30]  Bernd Radig,et al.  A real time system for model-based interpretation of the dynamics of facial expressions , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[31]  Ian R. Fasel,et al.  A generative framework for real time object detection and classification , 2005, Comput. Vis. Image Underst..

[32]  Svitlana Zinger,et al.  Multi-view autostereoscopic visualization using bandwidth-limited channels , 2012 .

[33]  Jose Garcia-Rodriguez,et al.  Robotic Vision: Technologies for Machine Learning and Vision Applications , 2013 .

[34]  Aboul Ella Hassanien,et al.  A Feature Selection Approach for Network Intrusion Classification: The Bi-Layer Behavioral-Based , 2013, Int. J. Comput. Vis. Image Process..

[35]  Jason Smith,et al.  Intent-Oriented Design Pattern Formalization Using SPQR , 2007 .

[36]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..