Weighted group sparse representation for undersampled face recognition

Abstract Recently, sparse representation has become a popular data representation method and sparse representation based classification (SRC) has been proposed. However, the l 1 -norm regularized sparse representation is not stable and fails to incorporate the label information of training samples. On the other hand, the training samples are grouped into a column-based matrix, which has a group structure. In this paper, we propose a new classification method called weighted group sparse representation classification (WGSRC) to classify a query image by minimizing the weighted mixed-norm (l 2,1 -norm) regularized reconstruction error with respect to training images. Unlike SRC, the group sparse regularization is utilized to incorporate the label information and it promotes sparsity at the group level. According to the similarity between a test sample and training samples of each group, WGSRC gives each group a weight. Our method integrates the locality structure of the data and similarity information between the query sample and distinct classes into l 2,1 -norm regularization to form a unified formulation. We try to represent a test sample by training samples not only from the neighbors of it, but also from the highly relevant classes. The sparse solution of WGSRC encodes more structure information and discriminative information than other sparse representation methods. Experimental results on five face data sets have shown that the proposed method outperforms state-of-the-art sparse representation based classification methods, especially when we have relatively small number of training data for each class. We also explore the reasons why the proposed approach can improve face recognition.

[1]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[4]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Rabab Kreidieh Ward,et al.  Classification via group sparsity promoting regularization , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[7]  Jian Yang,et al.  Robust sparse coding for face recognition , 2011, CVPR 2011.

[8]  Zhong Jin,et al.  Face recognition using discriminant locality preserving projections based on maximum margin criterion , 2010, Pattern Recognit..

[9]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[10]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[12]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[13]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[14]  René Vidal,et al.  Robust classification using structured sparse representation , 2011, CVPR 2011.

[15]  Wotao Yin,et al.  Group sparse optimization by alternating direction method , 2013, Optics & Photonics - Optical Engineering + Applications.

[16]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[17]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[18]  Jiang Li,et al.  A new decision rule for sparse representation based classification for face recognition , 2013, Neurocomputing.

[19]  Biao Wang,et al.  Adaptive linear regression for single-sample face recognition , 2013, Neurocomputing.

[20]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Hossein Mobahi,et al.  Face recognition with contiguous occlusion using markov random fields , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[23]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[24]  J KriegmanDavid,et al.  Eigenfaces vs. Fisherfaces , 1997 .

[25]  Franz Hlawatsch,et al.  Group sparsity methods for compressive channel estimation in doubly dispersive multicarrier systems , 2010, 2010 IEEE 11th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[26]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[27]  Ying-Ke Lei,et al.  Face recognition via Weighted Sparse Representation , 2013, J. Vis. Commun. Image Represent..

[28]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[29]  Yongzhou Li,et al.  Orthogonal discriminant linear local tangent space alignment for face recognition , 2009, Neurocomputing.

[30]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[31]  Shuicheng Yan,et al.  Visual classification with multi-task joint sparse representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[33]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Yuh-Jye Lee,et al.  Locality-constrained group sparse representation for robust face recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[35]  Richard G. Baraniuk,et al.  Random Projections of Smooth Manifolds , 2009, Found. Comput. Math..

[36]  D. B. Graham,et al.  Characterising Virtual Eigensignatures for General Purpose Face Recognition , 1998 .