Class specific centralized dictionary learning for face recognition

Sparse representation based classification (SRC) and collaborative representation based classification (CRC) have demonstrated impressive performance for visual recognition. SRC and CRC assume that the training samples in each class contribute equally to the dictionary and thus generate the dictionary that consists of the training samples in the corresponding class. This may lead to high residual error and instability, to the detriment of recognition performance. One solution is to use the class specific dictionary learning (CSDL) algorithm, which has greatly improved the classification accuracy. However, the CSDL algorithm fails to consider the constraints to sparse codes. In particular, it cannot guarantee that the sparse codes in the same class will be concentrated based on the learned dictionary for each class. Such concentration is actually beneficial to classification. To address these limitations, in this paper, we propose a class specific centralized dictionary learning (CSCDL) algorithm to simultaneously consider the desired characteristics for both dictionary and sparse codes. The blockwise coordinate descent algorithm and Lagrange multipliers are used to optimize the corresponding objective function. Extensive experimental results on face recognition benchmark datasets demonstrate the superior performance of our CSCDL algorithm compared with conventional approaches.

[1]  Changyin Sun,et al.  Supervised class-specific dictionary learning for sparse modeling in action recognition , 2012, Pattern Recognit..

[2]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[3]  Martial Hebert,et al.  Model recommendation: Generating object detectors from few samples , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[5]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[6]  Guillermo Sapiro,et al.  Sparse Modeling of Human Actions from Motion Imagery , 2012, International Journal of Computer Vision.

[7]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[8]  Lei Zhang,et al.  Metaface learning for sparse representation based face recognition , 2010, 2010 IEEE International Conference on Image Processing.

[9]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[10]  Bin Shen,et al.  Learning dictionary on manifolds for image classification , 2013, Pattern Recognit..

[11]  Martial Hebert,et al.  Learning by Transferring from Unsupervised Universal Sources , 2016, AAAI.

[12]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[13]  Xue Li,et al.  Face recognition using class specific dictionary learning for sparse representation and collaborative representation , 2016, Neurocomputing.

[14]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[15]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[16]  David J. Kriegman,et al.  Clustering appearances of objects under varying illumination conditions , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  Yu-Jin Zhang,et al.  Nonnegative Matrix Factorization: A Comprehensive Review , 2013, IEEE Transactions on Knowledge and Data Engineering.

[18]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[19]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[20]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[21]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Lei Zhang,et al.  Multi-label sparse coding for automatic image annotation , 2009, CVPR.

[23]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[24]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[27]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[28]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[29]  Yu-Jin Zhang,et al.  Discriminant sparse coding for image classification , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Yan Yan,et al.  Multi-Subregion Based Correlation Filter Bank for Robust Face Recognition , 2014, Pattern Recognit..

[32]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[34]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[35]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[36]  刘宝弟 Class Specific Centralized Dictionary Learning for Face Recognition , 2016 .

[37]  Xue Li,et al.  Locality sensitive dictionary learning for image classification , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[38]  Martial Hebert,et al.  Self-explanatory Sparse Representation for Image Classification , 2014, ECCV.

[39]  Bin Shen,et al.  Class specific dictionary learning for face recognition , 2014, Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[40]  Yi Ma,et al.  Learning Category-Specific Dictionary and Shared Dictionary for Fine-Grained Image Categorization , 2014, IEEE Transactions on Image Processing.

[41]  Yanjiang Wang,et al.  Blockwise coordinate descent schemes for sparse representation , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  Yu-Jin Zhang,et al.  Neighborhood Preserving Non-negative Tensor Factorization for image representation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[43]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[44]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[45]  A. Martínez,et al.  The AR face databasae , 1998 .

[46]  Ting Wang,et al.  Kernel Sparse Representation-Based Classifier , 2012, IEEE Transactions on Signal Processing.

[47]  Jianping Fan,et al.  Learning inter-related visual dictionary for object recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Xue Li,et al.  Blockwise coordinate descent schemes for efficient and effective dictionary learning , 2016, Neurocomputing.

[49]  David G. Stork,et al.  Pattern Classification , 1973 .

[50]  Yu-Jin Zhang,et al.  Image inpainting via Weighted Sparse Non-negative Matrix Factorization , 2011, 2011 18th IEEE International Conference on Image Processing.

[51]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[52]  Michael Elad,et al.  Analysis K-SVD: A Dictionary-Learning Algorithm for the Analysis Sparse Model , 2013, IEEE Transactions on Signal Processing.

[53]  Xuelong Li,et al.  Geometric Mean for Subspace Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[55]  Guillermo Sapiro,et al.  Dictionary learning and sparse coding for unsupervised clustering , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[56]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[57]  Yang Wan A Dictionary Learning Based Kernel Sparse Representation Method for Face Recognition , 2012 .