Cost-Sensitive Label Propagation for Semi-Supervised Face Recognition

In real-world applications, different kinds of learning and prediction errors are likely to incur different costs for the same system. Moreover, in practice, the cost label information is often available only for a few training samples. In a semi-supervised setting, label propagation is critical to infer the cost information for unlabeled training data. The existing methods typically conduct label propagation independently ahead of supervised cost-sensitive learning. The precomputed label information is kept fixed, which may become suboptimal in the subsequent learning process and hence degrade the overall system performance. In this paper, we develop a unified cost-sensitive framework for semi-supervised face recognition that can jointly optimize the inferred label information and the classifier in an iterative manner. Our experiments on face benchmark datasets demonstrate that in comparison with the state-of-the-art methods for label propagation and cost-sensitive learning, the proposed approach can significantly improve the overall system performance, especially in terms of classification errors associated with high costs.

[1]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[2]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ming Yang,et al.  Pairwise Costs in Semisupervised Discriminant Analysis for Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[4]  Jiwen Lu,et al.  Cost-Sensitive Semi-Supervised Discriminant Analysis for Face Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[5]  Ivor W. Tsang,et al.  Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction , 2010, IEEE Transactions on Image Processing.

[6]  J. Rice Mathematical Statistics and Data Analysis , 1988 .

[7]  Pascal Frossard,et al.  Video face recognition with graph-based semi-supervised learning , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[8]  Shou-De Lin,et al.  Cost-Sensitive Multi-Label Learning for Audio Tag Annotation and Retrieval , 2011, IEEE Transactions on Multimedia.

[9]  Bin Gu,et al.  Cross Validation Through Two-Dimensional Solution Surface for Cost-Sensitive SVM , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Gang Hua,et al.  Labeled Faces in the Wild: A Survey , 2016 .

[11]  Bhiksha Raj,et al.  SphereFace: Deep Hypersphere Embedding for Face Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Shou-De Lin,et al.  Generalized k-Labelsets Ensemble for Multi-Label and Cost-Sensitive Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[13]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.

[14]  Anders P. Eriksson,et al.  Is face recognition really a Compressive Sensing problem? , 2011, CVPR 2011.

[15]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[16]  Jiwen Lu,et al.  Cost-Sensitive Subspace Analysis and Extensions for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[17]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[18]  Jiwen Lu,et al.  Cost-sensitive subspace learning for face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Zhi-Hua Zhou,et al.  Cost-sensitive face recognition , 2008, CVPR.

[20]  Ulf Brefeld,et al.  Support Vector Machines with Example Dependent Costs , 2003, ECML.

[21]  Zhi-Hua Zhou,et al.  Cost-Sensitive Semi-Supervised Support Vector Machine , 2010, AAAI.

[22]  Marie-Francine Moens,et al.  Naming People in News Videos with Label Propagation , 2011, IEEE MultiMedia.

[23]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[24]  Feiping Nie,et al.  Unsupervised and semi-supervised learning via ℓ1-norm graph , 2011, 2011 International Conference on Computer Vision.

[25]  Quan-Sen Sun,et al.  Multiple Kernel Sparse Representation-Based Orthogonal Discriminative Projection and Its Cost-Sensitive Extension , 2016, IEEE Transactions on Image Processing.

[26]  Xuran Zhao,et al.  Semi-supervised face recognition with LDA self-training , 2011, 2011 18th IEEE International Conference on Image Processing.

[27]  Ming Yang,et al.  Cost Sensitive Semi-Supervised Canonical Correlation Analysis for Multi-view Dimensionality Reduction , 2016, Neural Processing Letters.

[28]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[29]  Daoqiang Zhang,et al.  Cost-sensitive feature selection with application in software defect prediction , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[30]  Zhi-Hua Zhou,et al.  Sequence-Based Prediction of microRNA-Binding Residues in Proteins Using Cost-Sensitive Laplacian Support Vector Machines , 2013, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[31]  Zexuan Ji,et al.  Cost-sensitive dictionary learning for face recognition , 2016, Pattern Recognit..

[32]  Steven C. H. Hoi,et al.  Cost-Sensitive Online Classification , 2012, 2012 IEEE 12th International Conference on Data Mining.

[33]  Feiping Nie,et al.  Semi-supervised orthogonal discriminant analysis via label propagation , 2009, Pattern Recognit..

[34]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Baowen Xu,et al.  Cost-Sensitive Local Collaborative Representation for Software Defect Prediction , 2016, 2016 International Conference on Software Analysis, Testing and Evolution (SATE).

[36]  Feiping Nie,et al.  A general graph-based semi-supervised learning with novel class discovery , 2010, Neural Computing and Applications.

[37]  David Zhang,et al.  Sparse cost-sensitive classifier with application to face recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[38]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[39]  Gabriel J. Brostow,et al.  Revisiting Example Dependent Cost-Sensitive Learning with Decision Trees , 2013, 2013 IEEE International Conference on Computer Vision.

[40]  C. V. Jawahar,et al.  Face Recognition in Videos by Label Propagation , 2014, 2014 22nd International Conference on Pattern Recognition.

[41]  Gian Luca Marcialis,et al.  Semi-supervised PCA-Based Face Recognition Using Self-training , 2006, SSPR/SPR.

[42]  Daoqiang Zhang,et al.  Two-Stage Cost-Sensitive Learning for Software Defect Prediction , 2014, IEEE Transactions on Reliability.

[43]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Kai Ming Ting,et al.  An Instance-weighting Method to Induce Cost-sensitive Trees , 2001 .

[45]  Guiguang Ding,et al.  Collective Matrix Factorization Hashing for Multimodal Data , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Tieniu Tan,et al.  A Light CNN for Deep Face Representation With Noisy Labels , 2015, IEEE Transactions on Information Forensics and Security.

[47]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[48]  Tal Hassner,et al.  Effective Unconstrained Face Recognition by Combining Multiple Descriptors and Learned Background Statistics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Shuicheng Yan,et al.  Semi-supervised Learning by Sparse Representation , 2009, SDM.

[50]  Sabine Süsstrunk,et al.  Face recognition in real-world images , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[51]  Yi Lin Multicategory Support Vector Machines, Theory, and Application to the Classification of . . . , 2003 .

[52]  Ming Yang,et al.  Discriminative cost sensitive Laplacian score for face recognition , 2015, Neurocomputing.