Kernel group sparse representation classifier via structural and non-convex constraints

Abstract In this paper, we propose a new classifier named kernel group sparse representation via structural and non-convex constraints (KGSRSN) for image recognition. The new approach integrates both group sparsity and structure locality in the kernel feature space and then penalties a non-convex function to the representation coefficients. On the one hand, by mapping the training samples into the kernel space, the so-called norm normalization problem will be naturally alleviated. On the other hand, an interval for the parameter of penalty function is provided to promote more sparsity without sacrificing the uniqueness of the solution and robustness of convex optimization. Our method is computationally efficient due to the utilization of the Alternating Direction Method of Multipliers (ADMM) and Majorization-Minimization (MM). Experimental results on three real-world benchmark datasets, i.e., AR face database, PIE face database and MNIST handwritten digits database, demonstrate that KGSRSN can achieve more discriminative sparse coefficients, and it outperforms many state-of-the-art approaches for classification with respect to both recognition rates and running time.

[1]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[2]  Zhenyu Wang,et al.  A collaborative representation based projections method for feature extraction , 2015, Pattern Recognit..

[3]  Laurent Jacques,et al.  On the Noise Robustness of Simultaneous Orthogonal Matching Pursuit , 2016, IEEE Transactions on Signal Processing.

[4]  Changyin Sun,et al.  A regularized least square based discriminative projections for feature extraction , 2016, Neurocomputing.

[5]  Wen Gao,et al.  Entropy of Primitive: From Sparse Representation to Visual Information Evaluation , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Luc Van Gool,et al.  Learned Collaborative Representations for Image Classification , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[7]  Huawen Liu,et al.  Regression analysis of locality preserving projections via sparse penalty , 2015, Inf. Sci..

[8]  Shuicheng Yan,et al.  Nonconvex Nonsmooth Low Rank Minimization via Iteratively Reweighted Nuclear Norm , 2015, IEEE Transactions on Image Processing.

[9]  Xuelong Li,et al.  A Biologically Inspired Appearance Model for Robust Visual Tracking , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Jian Yang,et al.  Sparse discriminative feature selection , 2015, Pattern Recognit..

[11]  Luc Van Gool,et al.  Adaptive and Weighted Collaborative Representations for image classification , 2014, Pattern Recognit. Lett..

[12]  Zizhu Fan,et al.  Weighted sparse representation for face recognition , 2015, Neurocomputing.

[13]  Shengping Zhang,et al.  Robust visual tracking based on online learning sparse representation , 2013, Neurocomputing.

[14]  Julien Mairal,et al.  Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning , 2014, SIAM J. Optim..

[15]  Ying Tai,et al.  Nuclear Norm Based Matrix Regression with Applications to Face Recognition with Occlusion and Illumination Changes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xudong Jiang,et al.  Classwise Sparse and Collaborative Patch Representation for Face Recognition , 2016, IEEE Trans. Image Process..

[17]  Luc Van Gool,et al.  Iterative Nearest Neighbors , 2015, Pattern Recognit..

[18]  René Vidal,et al.  Robust classification using structured sparse representation , 2011, CVPR 2011.

[19]  Yong Zhang,et al.  Sparse signal recovery by accelerated ℓq (0 , 2017, Int. J. Comput. Math..

[20]  Lei Zhang,et al.  Fast Compressive Tracking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yuh-Jye Lee,et al.  Locality-constrained group sparse representation for robust face recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[22]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[23]  Wei Zhang,et al.  A parallel alternating direction method with application to compound l1-regularized imaging inverse problems , 2016, Inf. Sci..

[24]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Wanliang Wang,et al.  Iterative Re-Constrained Group Sparse Face Recognition With Adaptive Weights Learning , 2017, IEEE Transactions on Image Processing.

[26]  Ivan W. Selesnick,et al.  Nonconvex nonsmooth optimization via convex–nonconvex majorization–minimization , 2017, Numerische Mathematik.

[27]  刘青山,et al.  Learning Discriminative Dictionary for Group Sparse Representation , 2014 .

[28]  Simon Foucart,et al.  Hard Thresholding Pursuit: An Algorithm for Compressive Sensing , 2011, SIAM J. Numer. Anal..

[29]  Hui Li,et al.  KCRC-LCD: Discriminative kernel collaborative representation with locality constrained dictionary for visual categorization , 2014, Pattern Recognit..

[30]  Shengyong Chen,et al.  Incremental min-max projection analysis for classification , 2014, Neurocomputing.

[31]  Ying-Ke Lei,et al.  Face recognition via Weighted Sparse Representation , 2013, J. Vis. Commun. Image Represent..

[32]  Devendra Kumar,et al.  Numerical solution of time- and space-fractional coupled Burgers’ equations via homotopy algorithm , 2016 .

[33]  Guo-Can Feng,et al.  Weighted group sparse representation for undersampled face recognition , 2014, Neurocomputing.

[34]  Ting Wang,et al.  Kernel Sparse Representation-Based Classifier , 2012, IEEE Transactions on Signal Processing.

[35]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Ling Shao,et al.  Robust Face Recognition With Kernelized Locality-Sensitive Group Sparsity Representation , 2017, IEEE Transactions on Image Processing.

[37]  Feiping Nie,et al.  Supervised and Projected Sparse Coding for Image Classification , 2013, AAAI.

[38]  Yan Zhang,et al.  Hierarchical feature concatenation-based kernel sparse representations for image categorization , 2016, The Visual Computer.