Clustering Based Reference Normal Pose for Improved Expression Recognition

In this paper the theme of automatic face expression identification is approached. We propose a robust method to identify the neutral face of a person while showing various expressions. The method consists in separating various images of faces based on expressions with a clustering method and retrieving the neutral face as being in the image closest to the centroid of the dominant cluster. The so found neutral face is used in conjunction with an expression detection method. We tested the method on the Extended Cohn-Kanade database where we identify correctly the neutral face with 100% accuracy and on the UNBC McMaster Pain Shoulder database where the use of the neutral pose leads to an increase of 10% in accuracy thus entering in the range of state of the art in pain detection.

[1]  Anukriti Dureha,et al.  An Accurate Algorithm for Generating a Music Playlist based on Facial Expressions , 2014 .

[2]  Nicu Sebe,et al.  Unsupervised Domain Adaptation for Personalized Facial Emotion Recognition , 2014, ICMI.

[3]  Jeffrey F. Cohn,et al.  Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database , 2012, Image Vis. Comput..

[4]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[6]  Limin Wang,et al.  A Comparative Study of Encoding, Pooling and Normalization Methods for Action Recognition , 2012, ACCV.

[7]  Corneliu Florea,et al.  Pain intensity estimation by a self-taught selection of histograms of topographical features , 2015, Image Vis. Comput..

[8]  Zhenjun Li,et al.  Application of FTGSVM Algorithm in Expression Recognition of Fatigue Driving , 2014, J. Multim..

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Peter H. Tu,et al.  Learning person-specific models for facial expression and action unit recognition , 2013, Pattern Recognit. Lett..

[11]  Rastislav Lukac,et al.  A Taxonomy of Color Image Filtering and Enhancement Solutions , 2006 .

[12]  Matti Pietikäinen,et al.  Facial Micro-Expression Recognition Using Spatiotemporal Local Binary Pattern with Integral Projection , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[13]  Ioannis Patras,et al.  Fusing Multilabel Deep Networks for Facial Action Unit Detection , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[14]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[15]  M. Mandal,et al.  Facial expressions of emotions and schizophrenia: a review. , 1998, Schizophrenia bulletin.

[16]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[17]  Fernando De la Torre,et al.  Learning Spatial and Temporal Cues for Multi-Label Facial Action Unit Detection , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[18]  Henrik Pedersen,et al.  Learning Appearance Features for Pain Detection Using the UNBC-McMaster Shoulder Pain Expression Archive Database , 2015, ICVS.

[19]  Xuezhi Chi,et al.  An improved fuzzy C-means clustering algorithm based on simulated annealing , 2013, 2013 10th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[20]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[21]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[22]  Jeffrey F. Cohn,et al.  Automatic detection of pain intensity , 2012, ICMI '12.

[23]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[24]  Matti Pietikäinen,et al.  Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns , 2016, Neurocomputing.

[25]  Thomas B. Moeslund,et al.  Pain recognition using spatiotemporal oriented energy of facial muscles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[26]  Eva Krumhuber,et al.  Effects of Dynamic Attributes of Smiles in Human and Synthetic Faces: A Simulated Job Interview Setting , 2009 .

[27]  Peter Robinson,et al.  Cross-dataset learning and person-specific normalisation for automatic Action Unit detection , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[28]  Sridha Sridharan,et al.  Automatically detecting action units from faces of pain: Comparing shape and appearance features , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Louis-Philippe Morency,et al.  A multi-label convolutional neural network approach to cross-domain action unit detection , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[30]  F. Fernández-Aranda,et al.  Facial expression to emotional stimuli in non-psychotic disorders: A systematic review and meta-analysis , 2016, Neuroscience & Biobehavioral Reviews.

[31]  Nicu Sebe,et al.  We are not All Equal: Personalizing Models for Facial Expression Analysis with Transductive Parameter Transfer , 2014, ACM Multimedia.

[32]  LinLin Shen,et al.  Facial expression synthesis with direction field preservation based mesh deformation and lighting fitting based wrinkle mapping , 2018, Multimedia Tools and Applications.