Fuzzy Nearest Feature Line-based Manifold Embedding for Facial Expression Recognition

Traditional nearest feature line (NFL) based subspace learning (NFLS) has been successfully applied in face recognition by capturing more variations of face images than original data set. However, it is suboptimal for pattern recognition due to that it only focuses on the within-class information while neglects the interaction between different classes. Besides, NFLS fails to detect the underlying manifold embedded in image space. In this paper, a novel manifold embedded extension of NFLS named fuzzy local nearest feature line (FLNFL) is developed for facial expression recognition. FLNFL achieves its high classification performance by combining graph embedded projection with fuzzy set theory in a Fisher type of learning manner. It not only considers the intrinsic similarity between data points, but also exploits fuzzy assignment technique to investigate inherent uncertainties in expression images arise from variety of illumination, posture, and viewing directions. After this mapping, therefore, the transformed features can reflect both local geometry and intrinsic class assignment of the data set. Experimental results on two widely used facial expression databases suggest that the proposed method provides a better representation of expression features and yields promising performance in facial expression recognition.

[1]  Dao-Qing Dai,et al.  Improved discriminate analysis for high-dimensional data and its application to face recognition , 2007, Pattern Recognit..

[2]  F. N. David,et al.  LINEAR STATISTICAL INFERENCE AND ITS APPLICATION , 1967 .

[3]  Limei Zhang,et al.  Graph-optimized locality preserving projections , 2010, Pattern Recognit..

[4]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Dacheng Tao,et al.  Harmonic mean for subspace selection , 2008, 2008 19th International Conference on Pattern Recognition.

[6]  Nenghai Yu,et al.  Neighborhood Preserving Projections (NPP): A Novel Linear Dimension Reduction Method , 2005, ICIC.

[7]  Ravi Kothari,et al.  Fractional-Step Dimensionality Reduction , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[9]  Xuelong Li,et al.  Discriminative Orthogonal Neighborhood-Preserving Projections for Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Honggang Zhang,et al.  Comments on "Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Application to Face and Palm Biometrics" , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Witold Pedrycz,et al.  Face recognition using a fuzzy fisherface classifier , 2005, Pattern Recognit..

[12]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[13]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[14]  Stan Z. Li,et al.  Performance Evaluation of the Nearest Feature Line Method in Image Classification and Retrieval , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  J. Friedman Regularized Discriminant Analysis , 1989 .

[17]  Xuelong Li,et al.  Geometric Mean for Subspace Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[19]  Rogério Schmidt Feris,et al.  Manifold Based Analysis of Facial Expression , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  Jiwen Lu,et al.  Uncorrelated Discriminant Nearest Feature Line Analysis for Face Recognition , 2010, IEEE Signal Processing Letters.

[21]  M. Omair Ahmad,et al.  Two-dimensional FLD for face recognition , 2005, Pattern Recognit..

[22]  Changbo Hu,et al.  Manifold of facial expression , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[23]  Jian Yang,et al.  Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[25]  Xiaojun Wu,et al.  Fuzzy Kernel Fisher Discriminant Algorithm with Application to Face Recognition , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[26]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  P. Ekman Emotion in the human face , 1982 .

[28]  Nectarios Rose,et al.  Facial Expression Classification using Gabor and Log-Gabor Filters , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[29]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[30]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[31]  Jieping Ye,et al.  Two-Dimensional Linear Discriminant Analysis , 2004, NIPS.

[32]  Richard Bellman,et al.  Adaptive Control Processes - A Guided Tour (Reprint from 1961) , 2015, Princeton Legacy Library.

[33]  Fernando De la Torre,et al.  Facial Expression Analysis , 2011, Visual Analysis of Humans.

[34]  Dacheng Tao,et al.  Max-Min Distance Analysis by Using Sequential SDP Relaxation for Dimension Reduction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[36]  Xuelong Li,et al.  Generalised nearest feature line for subspace learning , 2007 .

[37]  Xuelong Li,et al.  General Averaged Divergence Analysis , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[38]  Robert P. W. Duin,et al.  Multiclass Linear Dimension Reduction by Weighted Pairwise Fisher Criteria , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[40]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[41]  Takeo Kanade,et al.  Facial Expression Analysis , 2011, AMFG.

[42]  Zhenjiang Miao,et al.  Fuzzy discriminant projections for facial expression recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[43]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[44]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .