Robust collaborative representation-based classification via regularization of truncated total least squares

Collaborative representation-based classification has shown promising results on cognitive vision tasks like face recognition. It solves a linear problem with $$l_1$$l1 or $$l_2$$l2 norm regularization to obtain a stable sparse representation. Previous studies showed that the collaboration representation assisted the output of optimum sparsity constraint, but the choice of regularization also played a crucial role in stable representation. In this paper, we proposed a novel discriminative collaborative representation-based classification method via regularization implemented by truncated total least squares algorithm. The key idea of the proposed method is combining two coefficients obtained by $$l_2$$l2 regularization and truncated TLS-based regularization. After evaluated by extensive experiments conducted on several benchmark facial databases, the proposed method is demonstrated to outperform the naive collaborative representation-based method, as well as some other state-of-the-art methods for face recognition. The regularization by truncation effectively and dramatically enhances sparsity constraint on coding coefficients in collaborative representation and increases robustness for face recognition.

[1]  Guojin He,et al.  RPC Estimation via $\ell_1$-Norm-Regularized Least Squares (L1LS) , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  David Zhang,et al.  Individualized learning for improving kernel Fisher discriminant analysis , 2016, Pattern Recognit..

[3]  Zheng Cao,et al.  Robust support vector machines based on the rescaled hinge loss function , 2017, Pattern Recognition.

[4]  Qian Du,et al.  Combined sparse and collaborative representation for hyperspectral target detection , 2015, Pattern Recognit..

[5]  Andrew Chi-Sing Leung,et al.  Sparse and Truncated Nuclear Norm Based Tensor Completion , 2017, Neural Processing Letters.

[6]  Han Cao,et al.  Virtual images inspired consolidate collaborative representation-based classification method for face recognition , 2016 .

[7]  Guang Yang,et al.  Sparse-Representation-Based Classification with Structure-Preserving Dimension Reduction , 2014, Cognitive Computation.

[8]  Xu Chen,et al.  Collaborative representation, sparsity or nonlinearity: What is key to dictionary based classification? , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Jianping Gou,et al.  Sparse Coefficient-Based ${k}$ -Nearest Neighbor Classification , 2017, IEEE Access.

[10]  Ziyu Wang,et al.  Joint sparse model-based discriminative K-SVD for hyperspectral image classification , 2017, Signal Process..

[11]  Yang Gao,et al.  A Comparative Study on Parallel LDA Algorithms in MapReduce Framework , 2015, PAKDD.

[12]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yanjiang Wang,et al.  Kernel collaborative representation for face recognition , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[15]  Jicong Fan,et al.  Matrix completion by least-square, low-rank, and sparse self-representations , 2017, Pattern Recognit..

[16]  Xuelong Li,et al.  Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Qi Zhu,et al.  Multi-directional two-dimensional PCA with matching score level fusion for face recognition , 2012, Neural Computing and Applications.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  James Baglama,et al.  Efficient Thresholded Correlation using Truncated Singular Value Decomposition , 2015, 1512.07246.

[20]  Jeng-Shyang Pan,et al.  AN IMPROVEMENT TO THE NEAREST NEIGHBOR CLASSIFIER AND F ACE RECOGNITION EXPERIMENTS , 2013 .

[21]  Jian Yang,et al.  Sparse Tensor Discriminant Color Space for Face Verification , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Gene H. Golub,et al.  Regularization by Truncated Total Least Squares , 1997, SIAM J. Sci. Comput..

[23]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[24]  Jianping Gou,et al.  An antinoise sparse representation method for robust face recognition via joint l1 and l2 regularization , 2017, Expert Syst. Appl..

[25]  Jian Yang,et al.  Weighted sparse coding regularized nonconvex matrix regression for robust face recognition , 2017, Inf. Sci..

[26]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[27]  G. Landi,et al.  A stopping criterion for iterative regularization methods , 2016 .

[28]  Hong Liu,et al.  Using the original and 'symmetrical face' training samples to perform representation based two-step face recognition , 2013, Pattern Recognit..

[29]  Andrew Beng Jin Teoh,et al.  Kernel PCA enabled bit-string representation for minutiae-based cancellable fingerprint template , 2016, Pattern Recognit..

[30]  Erik Learned-Miller,et al.  Labeled Faces in the Wild : Updates and New Reporting Procedures , 2014 .

[31]  Gang Hua,et al.  Labeled Faces in the Wild: A Survey , 2016 .

[32]  Tommy W. S. Chow,et al.  Object-Level Video Advertising: An Optimization Framework , 2017, IEEE Transactions on Industrial Informatics.

[33]  Yu Cheng,et al.  An improved collaborative representation based classification with regularized least square (CRC-RLS) method for robust face recognition , 2016, Neurocomputing.

[34]  Jianping Gou,et al.  Multiplication fusion of sparse and collaborative representation for robust face recognition , 2016, Multimedia Tools and Applications.

[35]  Peng Ren,et al.  Target Tracking Based on Biological-Like Vision Identity via Improved Sparse Representation and Particle Filtering , 2016, Cognitive Computation.

[36]  Serge Gratton,et al.  Sensitivity and Conditioning of the Truncated Total Least Squares Solution , 2013, SIAM J. Matrix Anal. Appl..

[37]  Zhenyu Wang,et al.  Kernel Collaborative Representation with Regularized Least Square for Face Recognition , 2013, CCBR.

[38]  Jian Yang,et al.  A New Discriminative Sparse Representation Method for Robust Face Recognition via $l_{2}$ Regularization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Lai Wei,et al.  Optimized projection for Collaborative Representation based Classification and its applications to face recognition , 2016, Pattern Recognit. Lett..

[40]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[41]  Qing Liu,et al.  A Truncated Nuclear Norm Regularization Method Based on Weighted Residual Error for Matrix Completion , 2016, IEEE Transactions on Image Processing.

[42]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Yuan Yan Tang,et al.  Multiview Hessian discriminative sparse coding for image annotation , 2013, Comput. Vis. Image Underst..

[44]  Ping Guo,et al.  Image Fusion by Hierarchical Joint Sparse Representation , 2013, Cognitive Computation.

[45]  J. H. Na,et al.  Blockwise collaborative representation-based classification via L 2-norm of query data for accurate face recognition , 2016 .

[46]  Jicong Fan,et al.  Sparse subspace clustering for data with missing entries and high-rank matrix completion , 2017, Neural Networks.

[47]  P. Girdinio,et al.  Regularization techniques for the high-frequency electromagnetic field coupling problem with terminated lines , 2016 .

[48]  Bob Zhang,et al.  Multiple representations and sparse representation for image classification , 2015, Pattern Recognit. Lett..

[49]  Jianzhong Li,et al.  Penalized collaborative representation based classification for face recognition , 2015, Applied Intelligence.

[50]  Shijun Liao,et al.  On the homotopy analysis method for nonlinear problems , 2004, Appl. Math. Comput..

[51]  Jianping Gou,et al.  Improving sparsity of coefficients for robust sparse and collaborative representation-based image classification , 2017, Neural Computing and Applications.

[52]  Luc Van Gool,et al.  Weighted collaborative representation and classification of images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).