Linear Representation-Based Methods for Image Classification: A Survey

In recent years, linear representation-based methods have been widely researched and applied in the image classification field. Generally speaking, there are three steps within linear representation-based classification (LRC) algorithms. The first step is coding, which uses all training samples to represent the test sample in a linear combination. The second step is subspace approximation, where residuals between the test sample and the linear combination of each class are calculated. The third step is classification, which assigns the class label to the minimum class-specific residual. We classify the LRC methods into six categories: 1) linear representation-based classification methods with norm minimizations, 2) linear representation-based classification methods with constraints, 3) linear representation-based classification methods with feature spaces, 4) linear representation-based classification methods with structural information, 5) linear representation with subspace learning, and 6) linear representation in semi-supervised learning and unsupervised learning. The purpose of this paper is to: 1) make an accurate and clear definition of the linear representation-based method, 2) provide a categorization and a comprehensive survey of the existing linear representation-based classification methods for image classification, 3) Summarize the main applications of linear representation-based methods, 4) provide extensive classification results and a discussion of the linear representation-based methods. Furthermore, this paper summarizes specific applications of the linear representation-based methods. Particularly, we performed extensive experiments to compare thirteen linear representation-based classification methods on seven image classification datasets.

[1]  Shuping Zhao,et al.  Joint deep convolutional feature representation for hyperspectral palmprint recognition , 2019, Inf. Sci..

[2]  Guan-Ju Peng,et al.  Joint and Direct Optimization for Dictionary Learning in Convolutional Sparse Representation , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Thomas S. Huang,et al.  Joint dynamic sparse representation for multi-view face recognition , 2012, Pattern Recognit..

[4]  Lei Huang,et al.  Patch Based Collaborative Representation with Gabor Feature and Measurement Matrix for Face Recognition , 2018 .

[5]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[6]  Jian Yang,et al.  Sparse Representation Classifier Steered Discriminative Projection With Applications to Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[8]  Jian Yang,et al.  Matrix Variate Distribution-Induced Sparse Representation for Robust Image Classification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[9]  J. Ferwerda Charting the quality of forage : measuring and mapping the variation of chemical components in foliage with hyperspectral remote sensing , 2005 .

[10]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[11]  Rick L. Lawrence,et al.  Mapping invasive plants using hyperspectral imagery and Breiman Cutler classifications (RandomForest) , 2006 .

[12]  Lena Vogler,et al.  Computer Processing Of Remotely Sensed Images An Introduction , 2016 .

[13]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jing Wang,et al.  Robust Face Recognition via Adaptive Sparse Representation , 2014, IEEE Transactions on Cybernetics.

[15]  Kelly Gates,et al.  Our Biometric Future: Facial Recognition Technology and the Culture of Surveillance , 2011 .

[16]  Fatih Murat Porikli,et al.  Classification and Boosting with Multiple Collaborative Representations , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[18]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[19]  Liangpei Zhang,et al.  Hyperspectral Image Classification by Nonlocal Joint Collaborative Representation With a Locally Adaptive Dictionary , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Lei Zhang,et al.  Sparse Representation Classifier for microaneurysm detection and retinal blood vessel extraction , 2012, Inf. Sci..

[21]  Shiguang Shan,et al.  Self-Paced Curriculum Learning , 2015, AAAI.

[22]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Biao Wang,et al.  Kernel collaborative representation-based classifier for face recognition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[25]  Ting Wang,et al.  Kernel Sparse Representation-Based Classifier , 2012, IEEE Transactions on Signal Processing.

[26]  Larry S. Davis,et al.  Learning Structured Low-Rank Representations for Image Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Ajmal S. Mian,et al.  Efficient classification with sparsity augmented collaborative representation , 2017, Pattern Recognit..

[28]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[29]  Jian Yang,et al.  Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification , 2016, Pattern Recognit..

[30]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[31]  Zhong Jin,et al.  Kernel sparse representation based classification , 2012, Neurocomputing.

[32]  Yu-Chiang Frank Wang,et al.  Locality-sensitive dictionary learning for sparse representation based classification , 2013, Pattern Recognit..

[33]  Zizhu Fan,et al.  Weighted sparse representation for face recognition , 2015, Neurocomputing.

[34]  Shuicheng Yan,et al.  Latent Low-Rank Representation for subspace segmentation and feature extraction , 2011, 2011 International Conference on Computer Vision.

[35]  Thomas S. Huang,et al.  Pose-robust face recognition via sparse representation , 2013, Pattern Recognit..

[36]  David Zhang,et al.  Sparse, Collaborative, or Nonnegative Representation: Which Helps Pattern Classification? , 2018, Pattern Recognition.

[37]  Chin-Teng Lin,et al.  Deep Sparse Representation Classifier for facial recognition and detection system , 2019, Pattern Recognit. Lett..

[38]  Luc Van Gool,et al.  Adaptive and Weighted Collaborative Representations for image classification , 2014, Pattern Recognit. Lett..

[39]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[40]  Ran He,et al.  Two-Stage Nonnegative Sparse Representation for Large-Scale Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Yuan Yan Tang,et al.  Sparse Supervised Representation-Based Classifier for Uncontrolled and Imbalanced Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Honggang Zhang,et al.  Local Sparse Representation Based Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[43]  Bob Zhang,et al.  Dual sparse learning via data augmentation for robust facial image classification , 2020, Int. J. Mach. Learn. Cybern..

[44]  David Zhang,et al.  Noninvasive Diabetes Mellitus Detection Using Facial Block Color With a Sparse Representation Classifier , 2014, IEEE Transactions on Biomedical Engineering.

[45]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[46]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[47]  Yicong Zhou,et al.  Discriminant Projection Representation-based Classification for Vision Recognition , 2018, AAAI.

[48]  William J. Christmas,et al.  Fast robust correlation , 2005, IEEE Transactions on Image Processing.

[49]  Qi Zhang,et al.  FFT Consolidated Sparse and Collaborative Representation for Image Classification , 2018 .

[50]  Wangmeng Zuo,et al.  Deep Learning on Image Denoising: An overview , 2019, Neural Networks.

[51]  Lunke Fei,et al.  Low-Rank Preserving Projection Via Graph Regularized Reconstruction , 2019, IEEE Transactions on Cybernetics.

[52]  Richa Singh,et al.  Kernel group sparse representation based classifier for multimodal biometrics , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[53]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[54]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[55]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Wangmeng Zuo,et al.  Attention-guided CNN for image denoising , 2020, Neural Networks.

[57]  Wenzhun Huang,et al.  Two-stage plant species recognition by local mean clustering and Weighted sparse representation classification , 2017, Cluster Computing.

[58]  Hongwei Sun,et al.  Sparse Representation in Kernel Machines , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[59]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Rama Chellappa,et al.  Joint Sparse Representation for Robust Multimodal Biometrics Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Rama Chellappa,et al.  Discriminative Log-Euclidean Feature Learning for Sparse Representation-Based Recognition of Faces from Videos , 2016, IJCAI.

[62]  R. Bro,et al.  A fast non‐negativity‐constrained least squares algorithm , 1997 .

[63]  Weihua Ou,et al.  Discriminative feature extraction based on sparse and low-rank representation , 2019, Neurocomputing.

[64]  Paul Geladi,et al.  Techniques and applications of hyperspectral image analysis , 2007 .

[65]  David Zhang,et al.  Using the idea of the sparse representation to perform coarse-to-fine face recognition , 2013, Inf. Sci..

[66]  Arnold W. M. Smeulders,et al.  Sparse representation for coarse and fine object recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Qingquan Li,et al.  Gabor Cube Selection Based Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[69]  Fadi Dornaika Active Two Phase Collaborative Representation Classifier , 2019, ACM Trans. Knowl. Discov. Data.

[70]  Bob Zhang,et al.  Learning double weights via data augmentation for robust sparse and collaborative representation-based classification , 2020, Multimedia Tools and Applications.

[71]  Xudong Jiang,et al.  Classwise Sparse and Collaborative Patch Representation for Face Recognition , 2016, IEEE Trans. Image Process..

[72]  Chunwei Tian,et al.  Weighted Feature Space Representation with Kernel for Image Classification , 2018 .

[73]  Qi Li,et al.  Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network Features , 2016, Remote. Sens..

[74]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[75]  Yuanyan Tang,et al.  Effective Heart Disease Detection Based on Quantitative Computerized Traditional Chinese Medicine Using Representation Based Classifiers , 2017, Evidence-based complementary and alternative medicine : eCAM.

[76]  Lin Wang,et al.  Discriminative sparse embedding based on adaptive graph for dimension reduction , 2020, Eng. Appl. Artif. Intell..

[77]  C. Bonwell,et al.  Active learning : creating excitement in the classroom , 1991 .

[78]  Yang Liu,et al.  Euler Sparse Representation for Image Classification , 2018, AAAI.

[79]  Anuj Srivastava,et al.  Optimal linear representations of images for object recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Wangmeng Zuo,et al.  Supervised sparse representation method with a heuristic strategy and face recognition experiments , 2012, Neurocomputing.

[81]  Shenghua Gao,et al.  Neither Global Nor Local: Regularized Patch-Based Representation for Single Sample Per Person Face Recognition , 2014, International Journal of Computer Vision.

[82]  Jianping Gou,et al.  Multiplication fusion of sparse and collaborative representation for robust face recognition , 2016, Multimedia Tools and Applications.

[83]  Lei Zhang,et al.  A Probabilistic Collaborative Representation Based Approach for Pattern Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[84]  Ying-Ke Lei,et al.  Face recognition via Weighted Sparse Representation , 2013, J. Vis. Commun. Image Represent..

[85]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[86]  Richa Singh,et al.  Group sparse representation based classification for multi-feature multimodal biometrics , 2016, Inf. Fusion.

[87]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[88]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[89]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[90]  Yuan Yan Tang,et al.  An improved noninvasive method to detect Diabetes Mellitus using the Probabilistic Collaborative Representation based Classifier , 2018, Inf. Sci..

[91]  Yicong Zhou,et al.  Pairwise Linear Regression Classification for Image Set Retrieval , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[92]  Qian Du,et al.  Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[93]  Yueting Zhuang,et al.  Sparse representation using nonnegative curds and whey , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[94]  Junbin Gao,et al.  Robust face recognition via double low-rank matrix recovery for feature extraction , 2013, 2013 IEEE International Conference on Image Processing.

[95]  Qian Du,et al.  Multifeature Dictionary Learning for Collaborative Representation Classification of Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[96]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[97]  Qi Wang,et al.  Hyperspectral Image Classification via Multitask Joint Sparse Representation and Stepwise MRF Optimization , 2016, IEEE Transactions on Cybernetics.

[98]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[99]  Yuan Yan Tang,et al.  Manifold-Based Sparse Representation for Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[100]  Bob Zhang,et al.  Two-stage knowledge transfer framework for image classification , 2020, Pattern Recognit..

[101]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[102]  Brendt Wohlberg,et al.  Efficient Algorithms for Convolutional Sparse Representations , 2016, IEEE Transactions on Image Processing.

[103]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[104]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[105]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[106]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[107]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[108]  Jianping Gou,et al.  Collaboratively Weighting Deep and Classic Representation via $l_2$ Regularization for Image Classification , 2018, ACML.

[109]  Sen Jia,et al.  Gabor Feature-Based Collaborative Representation for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[110]  Fatih Murat Porikli,et al.  Connecting the dots in multi-class classification: From nearest subspace to collaborative representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[111]  Simon C. K. Shiu,et al.  Multi-scale Patch Based Collaborative Representation for Face Recognition with Margin Distribution Optimization , 2012, ECCV.

[112]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[113]  Jianping Gou,et al.  A New Discriminative Collaborative Neighbor Representation Method for Robust Face Recognition , 2018, IEEE Access.

[114]  Zhang Yi,et al.  Learning locality-constrained collaborative representation for robust face recognition , 2012, Pattern Recognit..

[115]  Jian Yang,et al.  Adaptive weighted nonnegative low-rank representation , 2018, Pattern Recognit..

[116]  Hong Man,et al.  Face recognition based on multi-class mapping of Fisher scores , 2005, Pattern Recognit..

[117]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[118]  Luc Van Gool,et al.  Weighted collaborative representation and classification of images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[119]  Rabab Kreidieh Ward,et al.  Classification via group sparsity promoting regularization , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[120]  Lei Zhang,et al.  Microaneurysm (MA) Detection via Sparse Representation Classifier with MA and Non-MA Dictionary Learning , 2010, 2010 20th International Conference on Pattern Recognition.

[121]  David Zhang,et al.  Joint discriminative and collaborative representation for fatty liver disease diagnosis , 2017, Expert Syst. Appl..

[122]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[123]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[124]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[125]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[126]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.