Edge based mean LBP for valence facial expression detection

Recognition of spontaneous emotion would significantly influence human-computer interaction and emotion-related studies in many related fields. This paper endeavors to explore a holistic method for detecting emotional facial expressions by examining local features. In recent years examining local features has gained traction for nuanced expression detection. The local binary pattern is one such technique. Using the mu LBP, this modified mean LBP adds a discriminating factor to the examined feature via the addition of an edge detector. Hence, the Sobel based μ local binary pattern for the extraction of features in the human face. Using this method, the extracted feature is classified into its valence classes (positive and negative) using an SVM classifier.

[1]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Oksam Chae,et al.  Robust Facial Expression Recognition Based on Local Directional Pattern , 2010 .

[3]  Hai Tran,et al.  Facial Expression Classification Based on Multi Artificial Neural Network and Two Dimensional Principal Component Analysis , 2011, ArXiv.

[4]  Mohammed Yeasin,et al.  Recognition of facial expressions and measurement of levels of interest from video , 2006, IEEE Transactions on Multimedia.

[5]  Matti Pietikäinen,et al.  A discriminative feature space for detecting and recognizing faces , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Emam Hossain,et al.  Person-independent facial expression recognition based on compound local binary pattern (CLBP) , 2014, Int. Arab J. Inf. Technol..

[7]  Xudong Jiang,et al.  Relaxed local ternary pattern for face recognition , 2013, 2013 IEEE International Conference on Image Processing.

[8]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[9]  Ewa Piatkowska.  Facial Expression Recognition System , 2010 .

[10]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Zhiwei Zhu,et al.  Dynamic Facial Expression Analysis and Synthesis With MPEG-4 Facial Animation Parameters , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Oksam Chae,et al.  Recognition of face expressions using Local Principal Texture Pattern , 2012, 2012 19th IEEE International Conference on Image Processing.

[14]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[15]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Zi-lu Ying,et al.  Support Vector Discriminant Analysis on Local Binary Patterns for Facial Expression Recognition , 2009, 2009 2nd International Congress on Image and Signal Processing.

[17]  Zhao Zheng,et al.  Facial expression recognition based on PCA reconstruction , 2010, 2010 5th International Conference on Computer Science & Education.

[18]  Vaishnavi Govindarajan,et al.  Face Recognition using Block-Based DCT Feature Extraction , 2012 .

[19]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[20]  Amir Jamshidnezhad,et al.  Challenging of Facial Expressions Classification Systems: Survey, Critical Considerations and Direction of Future Work , 2012 .

[21]  Shuji Hashimoto,et al.  A similarity-based neural network for facial expression analysis , 2007, Pattern Recognit. Lett..

[22]  Khaled S. Ahmed,et al.  Estimating Protein Functions Correlation Based on Overlapping Proteins and Cluster Interactions , 2012 .

[23]  Maja Pantic,et al.  Facial Action Unit Detection using Probabilistic Actively Learned Support Vector Machines on Tracked Facial Point Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  Ayyaz Hussain,et al.  Survey of various feature extraction and classification techniques for facial expression recognition , 2012 .

[25]  Liming Chen,et al.  Facial Image Analysis Based on Local Binary Patterns: A Survey , 2011 .

[26]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[27]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[28]  Shiqing Zhang,et al.  Facial Expression Recognition Based on Local Binary Patterns and Kernel Discriminant Isomap , 2011, Sensors.

[29]  Takeo Kanade,et al.  Facial Expression Recognition , 2011, Handbook of Face Recognition.

[30]  Marly Guimarães Fernandes Costa,et al.  Evaluation of Haar Cascade Classifiers Designed for Face Detection , 2012 .

[31]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[32]  Devi Arumugam,et al.  Emotion Classification Using Facial Expression , 2011 .

[33]  Alireza Tofighi,et al.  Face Detection and Recognition Using Skin Color and AdaBoost Algorithm Combined with Gabor Features and SVM Classifier , 2011, 2011 International Conference on Multimedia and Signal Processing.

[34]  Peter Robinson,et al.  Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[35]  Ravindra C. Thool,et al.  Automatic facial feature extraction and expression recognition based on neural network , 2012, ArXiv.

[36]  Stefanos Zafeiriou,et al.  Recognition of 3D facial expression dynamics , 2012, Image Vis. Comput..

[37]  Shiqing Zhang,et al.  Facial expression recognition based on local binary patterns and local fisher discriminant analysis , 2012 .

[38]  Thomas S. Huang,et al.  Facial Expression Recognition from Video Sequences : Temporal and Static Modelling , 2002 .

[39]  Michael J. Black,et al.  Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion , 1997, International Journal of Computer Vision.

[40]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[41]  Wang Yanli,et al.  Face recognition method by using large and representative datasets , 2009, 2009 Chinese Control and Decision Conference.

[42]  Mrunal S. Bewoor,et al.  Real Time Face Detection and Recognition using Haar - Based Cascade Classifier and Principal Component Analysis , 2012 .

[43]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[44]  M. Turk,et al.  Probabilistic expression analysis on manifolds , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[45]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[46]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[48]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Lijun Yin,et al.  Static and dynamic 3D facial expression recognition: A comprehensive survey , 2012, Image Vis. Comput..

[50]  L. Rothkrantz,et al.  Toward an affect-sensitive multimodal human-computer interaction , 2003, Proc. IEEE.

[51]  Maja Pantic,et al.  Detecting facial actions and their temporal segments in nearly frontal-view face image sequences , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[52]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[53]  Maja Pantic,et al.  Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics , 2007, ICCV-HCI.

[54]  Joachim M. Buhmann,et al.  Pairwise Data Clustering by Deterministic Annealing , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Ana Belén Moreno,et al.  Differential optical flow applied to automatic facial expression recognition , 2011, Neurocomputing.

[56]  Archana Verma,et al.  A Comprehensive Survey on Human Facial Expression Detection , 2013 .

[57]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[59]  Ahmed M. Elgammal,et al.  Facial Expression Analysis Using Nonlinear Decomposable Generative Models , 2005, AMFG.

[60]  Oksam Chae,et al.  Gender Classification Using Local Directional Pattern (LDP) , 2010, 2010 20th International Conference on Pattern Recognition.

[61]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[62]  Jesse Hoey,et al.  Value directed learning of gestures and facial displays , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[63]  Aleix M. Martínez,et al.  A Model of the Perception of Facial Expressions of Emotion by Humans: Research Overview and Perspectives , 2012, J. Mach. Learn. Res..

[64]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .