Virtual dictionary based kernel sparse representation for face recognition

Abstract Kernel sparse representation for classification (KSRC) has attracted much attention in pattern recognition community in recent years. Although it has been widely used in many applications such as face recognition, KSRC still has some open problems needed to be addressed. One is that if the training set is of a small scale, KSRC may potentially suffer from lack of training samples when a nonlinear mapping is used to transform the original input data into a high dimensional feature space, which is often accomplished using a kernel-based method. In order to address this problem, this work proposes a scheme that automatically yields a number of new training samples, termed virtual dictionary, from the original training set. We then use the yielded virtual dictionary and the original training set to build the KSRC model. To improve the computational efficiency of KSRC, we exploit the coordinate descend algorithm to solve the KSRC model. Our approach is referred to as kernel coordinate descent based on virtual dictionary (KCDVD). KCDVD is easy to implement and is computationally efficient. Experiments on many face databases show that the proposed algorithm is effective at remedying the problem with small training samples.

[1]  Yanfeng Gu,et al.  Multiple Kernel Sparse Representation for Airborne LiDAR Data Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[4]  Chunhong Pan,et al.  Visual Tracking Via Kernel Sparse Representation With Multikernel Fusion , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Zhong Jin,et al.  Kernel sparse representation based classification , 2012, Neurocomputing.

[6]  Jue Wang,et al.  A general soft method for learning SVM classifiers with L1-norm penalty , 2008, Pattern Recognit..

[7]  Yicong Zhou,et al.  Kernel Combined Sparse Representation for Disease Recognition , 2016, IEEE Transactions on Multimedia.

[8]  Rama Chellappa,et al.  Joint Sparse Representation for Robust Multimodal Biometrics Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yunde Jia,et al.  Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications , 2015, IEEE Transactions on Image Processing.

[10]  Hui Li,et al.  KCRC-LCD: Discriminative kernel collaborative representation with locality constrained dictionary for visual categorization , 2014, Pattern Recognit..

[11]  Hong Yan,et al.  Robust classification using ℓ2, 1-norm based regression model , 2012, Pattern Recognit..

[12]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  ShekharSumit,et al.  Joint Sparse Representation for Robust Multimodal Biometrics Recognition , 2014 .

[14]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[15]  Yang Wan A Dictionary Learning Based Kernel Sparse Representation Method for Face Recognition , 2012 .

[16]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Qiang Wang,et al.  Kernel Sparse Multitask Learning for Hyperspectral Image Classification With Empirical Mode Decomposition and Morphological Wavelet-Based Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Qi Zhu,et al.  L0-norm sparse representation based on modified genetic algorithm for face recognition , 2015, J. Vis. Commun. Image Represent..

[19]  沈毅,et al.  Kernel sparse multitask learning for hyperspectral image classification with empirical mode decomposition and morphological wavelet-based features , 2014 .

[20]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[21]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Dao-Qing Dai,et al.  Learning Kernel Extended Dictionary for Face Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010, 1007.3753.

[24]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[25]  Qi Zhu,et al.  Kernel based sparse representation for face recognition , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[26]  Jian Yang,et al.  Beyond sparsity: The role of L1-optimizer in pattern classification , 2012, Pattern Recognit..

[27]  Zhenhua Guo,et al.  Face recognition by sparse discriminant analysis via joint L2, 1-norm minimization , 2014, Pattern Recognit..

[28]  Jian Yang,et al.  Sparse Tensor Discriminant Color Space for Face Verification , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Bruce A. Draper,et al.  Principal Angles Separate Subject Illumination Spaces in YDB and CMU-PIE , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Xiao-Li Meng,et al.  The Art of Data Augmentation , 2001 .

[31]  Jian Yang,et al.  Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification , 2016, Pattern Recognit..

[32]  Guoqing Zhang,et al.  Multiple Kernel Sparse Representation-Based Orthogonal Discriminative Projection and Its Cost-Sensitive Extension. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[33]  Rama Chellappa,et al.  Multiple Kernel Learning for Sparse Representation-Based Classification , 2014, IEEE Transactions on Image Processing.

[34]  Gunnar Rätsch,et al.  Input space versus feature space in kernel-based methods , 1999, IEEE Trans. Neural Networks.

[35]  Liang-Tien Chia,et al.  Kernel Sparse Representation for Image Classification and Face Recognition , 2010, ECCV.

[36]  Ting Wang,et al.  Kernel Sparse Representation-Based Classifier , 2012, IEEE Transactions on Signal Processing.

[37]  Nojun Kwak,et al.  Nonlinear Projection Trick in Kernel Methods: An Alternative to the Kernel Trick , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Wei Chen,et al.  A novel sparse representation method based on virtual samples for face recognition , 2012, Neural Computing and Applications.

[39]  Quan-Sen Sun,et al.  Multiple Kernel Sparse Representation-Based Orthogonal Discriminative Projection and Its Cost-Sensitive Extension , 2016, IEEE Transactions on Image Processing.

[40]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[41]  Kai Liu,et al.  Kernel-based sparse representation for gesture recognition , 2013, Pattern Recognit..

[42]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, 2011 International Conference on Computer Vision.

[43]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  David Zhang,et al.  Local Linear Discriminant Analysis Framework Using Sample Neighbors , 2011, IEEE Transactions on Neural Networks.

[45]  Yunde Jia,et al.  Orthonormal dictionary learning and its application to face recognition , 2016, Image Vis. Comput..

[46]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[47]  Bernhard Schölkopf,et al.  A Primer on Kernel Methods , 2004 .

[48]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[49]  Julio López,et al.  A multi-class SVM approach based on the l1-norm minimization of the distances between the reduced convex hulls , 2015, Pattern Recognit..

[50]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[51]  Liang-Tien Chia,et al.  Sparse Representation With Kernels , 2013, IEEE Transactions on Image Processing.

[52]  Meng Jian,et al.  Class-Discriminative Kernel Sparse Representation-Based Classification Using Multi-Objective Optimization , 2013, IEEE Transactions on Signal Processing.