Label propagation based on collaborative representation for face recognition

Recently, collaborative representation (CR) has been shown to produce impressive performance on face recognition. However, the performances of CR depend on the number of labeled training samples for each class. When the labeled training samples per class are insufficient, CR would perform inaccurately and correspondingly degrades the final recognition performance. To solve this problem, in this paper, we introduce the CR into semi-supervised learning and propose a novel semi-supervised label propagation approach based on collaborative representation. Based on the subspace assumption that samples of the same class lie in the same subspace, each labeled sample can be well represented by the unlabeled samples of the same class. Our algorithm exploits a large amount of unlabeled samples which contain much more useful information as a dictionary to represent labeled samples, and propagates the label information from labeled data to unlabeled data. Thus, the information of unlabeled data can be effectively explored in our method, which can further improve the performance of collaborative representation with limited labeled training samples. Furthermore, we introduce our label propagation into other semi-supervised learning algorithm to further improve its, recognition performance. Experimental results are presented to demonstrate the efficacy of the proposed method.

[1]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Larry S. Davis,et al.  Online Semi-Supervised Discriminative Dictionary Learning for Sparse Representation , 2012, ACCV.

[3]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[6]  Zihan Zhou,et al.  Towards a practical face recognition system: Robust registration and illumination by sparse representation , 2009, CVPR.

[7]  Shuicheng Yan,et al.  Semi-supervised Learning by Sparse Representation , 2009, SDM.

[8]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[9]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[10]  Stefanos Zafeiriou,et al.  Subspace Learning from Image Gradient Orientations , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[12]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[13]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[14]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hyun-Chul Kim,et al.  Face recognition using LDA mixture model , 2003, Pattern Recognit. Lett..

[16]  Jiwen Lu,et al.  Cost-Sensitive Semi-Supervised Discriminant Analysis for Face Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[17]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[19]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[20]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[21]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[22]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[25]  Michael Elad,et al.  Compression of facial images using the K-SVD algorithm , 2008, J. Vis. Commun. Image Represent..

[26]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[27]  Yan Liu,et al.  Joint discriminative dimensionality reduction and dictionary learning for face recognition , 2013, Pattern Recognit..

[28]  David Zhang,et al.  Collaborative Representation based Classification for Face Recognition , 2012, ArXiv.

[29]  Feiping Nie,et al.  Semi-supervised feature selection based on label propagation and subset selection , 2010, 2010 International Conference on Computer and Information Application.

[30]  M. Elad,et al.  Improving the k-svd facial image compression using a linear deblocking method , 2008, 2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel.

[31]  Feiping Nie,et al.  Semi-supervised orthogonal discriminant analysis via label propagation , 2009, Pattern Recognit..

[32]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[33]  Zhao Zhang,et al.  A soft label based linear discriminant analysis for semi-supervised dimensionality reduction , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[34]  Anders P. Eriksson,et al.  Is face recognition really a Compressive Sensing problem? , 2011, CVPR 2011.

[35]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[37]  A. Martínez,et al.  The AR face databasae , 1998 .

[38]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[39]  Jiang-She Zhang,et al.  Label propagation through sparse neighborhood and its applications , 2012, Neurocomputing.

[40]  Yang Gao,et al.  Bilinear discriminative dictionary learning for face recognition , 2014, Pattern Recognit..

[41]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[42]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.