Discriminative, Competitive, and Collaborative Representation-Based Classification with l2-Norm Regularizations

Recently, collaborative representation-based classification (CRC) and its many variations have been widely applied for various classification tasks in pattern recognition. To further enhance the pattern discrimination of CRC, in this article we propose a novel extension of CRC, entitled discriminative, competitive, and collaborative representation-based classification (DCCRC). In the proposed DCCRC, the class discrimination information is fully utilized for promoting the true class of each testing sample to dominantly represent the testing sample during collaborative representation. The class discrimination information is well considered in the newly designed discriminative - norm regularization that can decrease the ability of representation from the interclasses of each testing sample. Simultaneously, a competitive - norm regularization is introduced to the DCCRC model with the class discrimination information with the aim of enhancing the competitive ability of representation from the true class of each testing sample. The effectiveness of the proposed DCCRC is explored by extensive experiments on the several public face databases and some real numerical UCI data sets. The experimental results demonstrate that the proposed DCCRC achieves the superior performance over the state-of-the-art representation-based classification methods.

[1]  Jiwen Lu,et al.  Automatic Subspace Learning via Principal Coefficients Embedding , 2014, IEEE Transactions on Cybernetics.

[2]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[4]  Jinping Wang,et al.  Hyperspectral Image Classification via Weighted Joint Nearest Neighbor and Sparse Representation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Jiancheng Lv,et al.  Two-phase probabilistic collaborative representation-based classification , 2019, Expert Syst. Appl..

[6]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Zhen Liu,et al.  Sparsity augmented discriminative sparse representation for face recognition , 2019, Pattern Analysis and Applications.

[8]  Jian Yang,et al.  A Survey of Dictionary Learning Algorithms for Face Recognition , 2017, IEEE Access.

[9]  Yicong Zhou,et al.  An extended probabilistic collaborative representation based classifier for image classification , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[10]  Yongzhao Zhan,et al.  Two-phase linear reconstruction measure-based classification for face recognition , 2018, Inf. Sci..

[11]  Yuan Yan Tang,et al.  A collaborative-competitive representation based classifier model , 2018, Neurocomputing.

[12]  Fadi Dornaika,et al.  Semi-supervised two phase test sample sparse representation classifier , 2018, Knowl. Based Syst..

[13]  Yongzhao Zhan,et al.  A Local Mean Representation-based K-Nearest Neighbor Classifier , 2019, ACM Trans. Intell. Syst. Technol..

[14]  Jianping Gou,et al.  Multiplication fusion of sparse and collaborative representation for robust face recognition , 2016, Multimedia Tools and Applications.

[15]  Ajmal S. Mian,et al.  Efficient classification with sparsity augmented collaborative representation , 2017, Pattern Recognit..

[16]  Jiehua Zhu,et al.  Novel orthogonal based collaborative dictionary learning for efficient face recognition , 2019, Knowl. Based Syst..

[17]  Lei Zhu,et al.  Weighted locality collaborative representation based on sparse subspace , 2019, J. Vis. Commun. Image Represent..

[18]  Lei Zhang,et al.  A Probabilistic Collaborative Representation Based Approach for Pattern Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jianping Gou,et al.  A New Discriminative Collaborative Neighbor Representation Method for Robust Face Recognition , 2018, IEEE Access.

[20]  Zhang Yi,et al.  Learning locality-constrained collaborative representation for robust face recognition , 2012, Pattern Recognit..

[21]  Jiangtao Peng,et al.  Nearest Regularized Joint Sparse Representation for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[22]  Jiexin Pu,et al.  Face Recognition Via Weighted Two Phase Test Sample Sparse Representation , 2013, Neural Processing Letters.

[23]  Yuan Yan Tang,et al.  Sparse Supervised Representation-Based Classifier for Uncontrolled and Imbalanced Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Lin Zhang,et al.  Fusion linear representation-based classification , 2019, Soft Comput..

[26]  Jian Yang,et al.  A New Discriminative Sparse Representation Method for Robust Face Recognition via $l_{2}$ Regularization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[29]  Jie Wu,et al.  A New Virtual Samples-Based CRC Method for Face Recognition , 2018, Neural Processing Letters.

[30]  Jianping Gou,et al.  An antinoise sparse representation method for robust face recognition via joint l1 and l2 regularization , 2017, Expert Syst. Appl..

[31]  Bing Hou,et al.  A new discriminative collaborative representation-based classification method via l2 regularizations , 2019, Neural Computing and Applications.

[32]  Lorenzo Bruzzone,et al.  Class-wise dictionary learning for hyperspectral image classification , 2017, Neurocomputing.

[33]  Yicong Zhou,et al.  Prior Knowledge-Based Probabilistic Collaborative Representation for Visual Recognition , 2020, IEEE Transactions on Cybernetics.

[34]  Luc Van Gool,et al.  Adaptive and Weighted Collaborative Representations for image classification , 2014, Pattern Recognit. Lett..

[35]  Wei Li,et al.  Laplacian Regularized Collaborative Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Jianping Gou,et al.  Sparse Coefficient-Based ${k}$ -Nearest Neighbor Classification , 2017, IEEE Access.

[37]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[38]  Jun Guo,et al.  Face Recognition via Collaborative Representation: Its Discriminant Nature and Superposed Representation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Hongmei Chi,et al.  Competitive and collaborative representation for classification , 2020, Pattern Recognit. Lett..

[40]  Fatih Murat Porikli,et al.  Classification and Boosting with Multiple Collaborative Representations , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Yongzhao Zhan,et al.  Locality constrained representation-based K-nearest neighbor classification , 2019, Knowl. Based Syst..

[42]  Jianping Gou,et al.  Several robust extensions of collaborative representation for image classification , 2019, Neurocomputing.

[43]  David Zhang,et al.  Sparse, Collaborative, or Nonnegative Representation: Which Helps Pattern Classification? , 2018, Pattern Recognition.

[44]  Jianping Gou,et al.  Improving sparsity of coefficients for robust sparse and collaborative representation-based image classification , 2017, Neural Computing and Applications.

[45]  PuJiexin,et al.  Face Recognition Via Weighted Two Phase Test Sample Sparse Representation , 2015 .

[46]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[47]  Zhang Yi,et al.  Connections Between Nuclear-Norm and Frobenius-Norm-Based Representations , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.