Learning efficient structured dictionary for image classification

Abstract. Recent years have witnessed the success of dictionary learning (DL)-based approaches in the domain of pattern classification. We present an efficient structured dictionary learning (ESDL) method that takes both the diversity and label information of training samples into account. Specifically, ESDL introduces alternative training samples into the process of DL. To increase the discriminative capability of representation coefficients for classification, an ideal regularization term is incorporated into the objective function of ESDL. Moreover, in contrast with conventional DL approaches, which impose a computationally expensive ℓ1-norm constraint on the coefficient matrix, ESDL employs an ℓ2-norm regularization term. Experimental results on benchmark databases (including four face databases and one scene dataset) demonstrate that ESDL outperforms previous DL approaches. More importantly, ESDL can be applied in a wide range of pattern classification tasks.

[1]  Ehud Rivlin,et al.  On the Equivalence of the LC-KSVD and the D-KSVD Algorithms , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jian Yang,et al.  Sample diversity, representation effectiveness and robust dictionary learning for face recognition , 2017, Inf. Sci..

[4]  Zhong Zhao,et al.  Efficient algorithm for sparse coding and dictionary learning with applications to face recognition , 2015, J. Electronic Imaging.

[5]  Lei Zhang,et al.  Support Vector Guided Dictionary Learning , 2014, ECCV.

[6]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[7]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[8]  Feiping Nie,et al.  Euler Label Consistent K-SVD for image classification and action recognition , 2018, Neurocomputing.

[9]  Larry S. Davis,et al.  Learning Structured Low-Rank Representations for Image Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jyoti Maggu,et al.  Label-Consistent Transform Learning for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[11]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[12]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[14]  Zhe Chen,et al.  Noise-robust dictionary learning with slack block-Diagonal structure for face recognition , 2020, Pattern Recognit..

[15]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[16]  He-Feng Yin,et al.  Locality Constraint Dictionary Learning With Support Vector for Pattern Classification , 2019, IEEE Access.

[17]  Liyi Dai,et al.  Analysis Dictionary Learning Based Classification: Structure for Robustness , 2018, IEEE Transactions on Image Processing.

[18]  Yoram Bresler,et al.  Online Sparsifying Transform Learning— Part I: Algorithms , 2015, IEEE Journal of Selected Topics in Signal Processing.

[19]  Jian Yang,et al.  A Survey of Dictionary Learning Algorithms for Face Recognition , 2017, IEEE Access.

[20]  Man Zhang,et al.  Discriminative Analysis Dictionary Learning , 2016, AAAI.

[21]  Li Yao,et al.  Supervised within-class-similar discriminative dictionary learning for face recognition , 2016, J. Vis. Commun. Image Represent..

[22]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[23]  He-Feng Yin,et al.  Label consistent transform learning for pattern classification , 2019 .

[24]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Hui Li,et al.  Multi-focus Image Fusion Using Dictionary Learning and Low-Rank Representation , 2017, ICIG.

[27]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[28]  Yanqing Guo,et al.  Synthesis linear classifier based analysis dictionary learning for pattern classification , 2017, Neurocomputing.

[29]  Dapeng Tao,et al.  Discriminative dictionary learning via Fisher discrimination K-SVD algorithm , 2015, Neurocomputing.

[30]  Michael Elad,et al.  Analysis K-SVD: A Dictionary-Learning Algorithm for the Analysis Sparse Model , 2013, IEEE Transactions on Signal Processing.

[31]  Xiao-Yuan Jing,et al.  Semi-Supervised Cross-View Projection-Based Dictionary Learning for Video-Based Person Re-Identification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Tao Lei,et al.  ☆ - Discriminative dictionary learning algorithm based on sample diversity and locality of atoms for face recognition , 2020, J. Vis. Commun. Image Represent..