Facial expression recognition using distance and shape signature features

Abstract Distance and Shape signature features in human faces offer formidable significance in recognizing facial expressions. Identifying appropriate landmarks is a crucial as well as challenging issue in the field of expression recognition of human faces. Appearance model has been found useful to detect the salient landmarks on human faces. These salient landmarks induce a grid on the human face along with the formation of possible triangles joining the grid. Normalized distance and shape signatures are determined from the grid. Distance signature as well as shape signature find respective stability indices which play important role to recognize the facial expressions. Statistical measures such as range, moment, skewness, kurtosis and entropy are calculated from normalized distance and shape signature pair to supplement the feature set. This enhanced feature set is fed into a Multilayer Perceptron (MLP) to arrive at different expression categories encompassing anger, sadness, fear, disgust, surprise and happy. We investigated our proposed system on Cohn-Kanade (CK+), JAFFE, MMI and MUG databases to conduct and validate our experiment and establish its performance superiority over other existing competitors.

[1]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[2]  Pablo Martínez-Cañada,et al.  Real-time tone mapping on GPU and FPGA , 2012, EURASIP J. Image Video Process..

[3]  Beat Fasel,et al.  Head-pose invariant facial expression recognition using convolutional neural networks , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[4]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Qingshan Liu,et al.  Learning Multiscale Active Facial Patches for Expression Analysis , 2015, IEEE Transactions on Cybernetics.

[6]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Dian Tjondronegoro,et al.  Facial Expression Recognition Using Facial Movement Features , 2011, IEEE Transactions on Affective Computing.

[9]  Qingshan Liu,et al.  Learning active facial patches for expression analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[11]  Khashayar Khorasani,et al.  Facial expression recognition using constructive feedforward neural networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[13]  Marina L. Gavrilova,et al.  Gauss–Laguerre wavelet textural feature fusion with geometrical information for facial expression identification , 2012, EURASIP J. Image Video Process..

[14]  Tzay Y. Young Handbook of pattern recognition and image processing (vol. 2): computer vision , 1994 .

[15]  Yang Wang,et al.  Robust facial feature tracking under varying face pose and facial expression , 2007, Pattern Recognit..

[16]  P. Ekman Emotion in the human face , 1982 .

[17]  Debasmita Chakrabarti,et al.  Facial Expression Recognition Using Eigenspaces , 2013 .

[18]  Lianwen Jin,et al.  A New Facial Expression Recognition Method Based on Local Gabor Filter Bank and PCA plus LDA , 2006 .

[19]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[20]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[21]  Ling Guan,et al.  Automatic landmark point detection and tracking for human facial expressions , 2013, EURASIP J. Image Video Process..

[22]  Maja Pantic,et al.  Optimization Problems for Fast AAM Fitting in-the-Wild , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Anastasios Delopoulos,et al.  The MUG facial expression database , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[24]  Aurobinda Routray,et al.  Automatic facial expression recognition using features of salient facial patches , 2015, IEEE Transactions on Affective Computing.

[25]  M. Pantic,et al.  Induced Disgust , Happiness and Surprise : an Addition to the MMI Facial Expression Database , 2010 .

[26]  Yegui Xiao,et al.  A New Facial Expression Recognition Technique using 2-D DCT and Neural Networks Based Decision Tree , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[27]  Rosalind W. Picard Affective Computing , 1997 .