Discriminative cost sensitive Laplacian score for face recognition

In recent years, face recognition is being recognized as a cost sensitive learning problem. For example, in a door-locker based on the face recognition system, it may make a gallery person inconvenient, who is misrecognized as an impostor and not allowed to enter the room, but it could result in a serious loss or damage if an imposter is misrecognized as a gallery person and allowed to enter the room. To deal with the cost sensitive problem in face recognition, many cost sensitive classifiers have been proposed. However, face recognition is a high dimensional problem, no sufficient attention is paid to the research on cost sensitive feature selection. In this paper, we propose a cost sensitive feature selection method called Discriminative Cost Sensitive Laplacian Score (DCSLS) for face recognition. The main contributions of DCSLS are as follows: (1) DCSLS incorporates the idea of local discriminant analysis into Laplacian Score, which prefers the features that can minimize the local neighborhood relationship of within-class and maximize the local neighborhood relationship of between-class, simultaneously; (2) DCSLS embeds the misclassification cost in Laplacian Score, which satisfies the minimal misclassification loss criterion. Extensive experimental results on six face data sets: ORL, Extended Yale B, PIE, AR, FERET and FRGC-204 show the superiority of DCSLS.

[1]  David Zhang,et al.  Sparse cost-sensitive classifier with application to face recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[2]  Ming Yang,et al.  Pairwise Costs in Semisupervised Discriminant Analysis for Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[3]  Zhi-Hua Zhou,et al.  Cost-Sensitive Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[5]  Jiwen Lu,et al.  Cost-sensitive subspace learning for face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[7]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Daoqiang Zhang,et al.  Two-Stage Cost-Sensitive Learning for Software Defect Prediction , 2014, IEEE Transactions on Reliability.

[9]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[10]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[11]  PietikainenMatti,et al.  Face Description with Local Binary Patterns , 2006 .

[12]  Chengjun Liu,et al.  Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Kai Ming Ting,et al.  An Instance-weighting Method to Induce Cost-sensitive Trees , 2001 .

[14]  Rong Jin,et al.  Online Feature Selection and Its Applications , 2014, IEEE Transactions on Knowledge and Data Engineering.

[15]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Zhi-Hua Zhou,et al.  Cost-Sensitive Semi-Supervised Support Vector Machine , 2010, AAAI.

[18]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[19]  Antônio de Pádua Braga,et al.  Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[23]  Daoqiang Zhang,et al.  Cost-sensitive feature selection with application in software defect prediction , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[24]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Jiwen Lu,et al.  Cost-Sensitive Semi-Supervised Discriminant Analysis for Face Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[26]  Zenglin Xu,et al.  Discriminative Semi-Supervised Feature Selection Via Manifold Regularization , 2009, IEEE Transactions on Neural Networks.

[27]  Gabriel J. Brostow,et al.  Revisiting Example Dependent Cost-Sensitive Learning with Decision Trees , 2013, 2013 IEEE International Conference on Computer Vision.

[28]  Shou-De Lin,et al.  Generalized k-Labelsets Ensemble for Multi-Label and Cost-Sensitive Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[29]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Ming Yang,et al.  A novel hypothesis-margin based approach for feature selection with side pairwise constraints , 2010, Neurocomputing.

[31]  Jiwen Lu,et al.  Cost-Sensitive Subspace Analysis and Extensions for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[32]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[33]  Harry Wechsler,et al.  Open set face recognition using transduction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[35]  Jiwen Lu,et al.  Cost-sensitive subspace learning for human age estimation , 2010, 2010 IEEE International Conference on Image Processing.

[36]  Vitomir Struc,et al.  Face Recognition Using Simplified Probabilistic Linear Discriminant Analysis , 2012 .

[37]  Ming Yang,et al.  Weighted Cost Sensitive Locality Preserving Projection for Face Recognition: Weighted Cost Sensitive Locality Preserving Projection for Face Recognition , 2013 .

[38]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[39]  A. Martínez,et al.  The AR face databasae , 1998 .

[40]  Chengyu Peng,et al.  Complete local Fisher discriminant analysis with Laplacian score ranking for face recognition , 2012, Neurocomputing.

[41]  Zhi-Hua Zhou,et al.  Sequence-Based Prediction of microRNA-Binding Residues in Proteins Using Cost-Sensitive Laplacian Support Vector Machines , 2013, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[42]  Daoqiang Zhang,et al.  Constraint Score: A new filter method for feature selection with pairwise constraints , 2008, Pattern Recognit..

[43]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[44]  Zhi-Hua Zhou,et al.  Learning with cost intervals , 2010, KDD '10.

[45]  Zhi-Hua Zhou,et al.  The Influence of Class Imbalance on Cost-Sensitive Learning: An Empirical Study , 2006, Sixth International Conference on Data Mining (ICDM'06).

[46]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[47]  Steven C. H. Hoi,et al.  Cost-Sensitive Online Classification , 2012, 2012 IEEE 12th International Conference on Data Mining.

[48]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).