LDA based compact and discriminative dictionary learning for sparse coding

The dictionary response usually affects the recognition results directly as it represents the original data and usually serves as the input of the classifier. However, the over-complete dictionary usually results in high dimensional response and redundancy. The application of the linear discriminant analysis (LDA)-based mapping method transforms the original dictionary response to be more discriminative for compact dictionary learning, resulting in high intra-class similarity and high inter-class dissimilarity in the response domain for better classification. By analyzing the recognition rate, the compactness and the purity, the proposed method can learn a small size of compact and discriminative dictionary with global optimization, and it can get a comparable or even better performance than the over-complete dictionary with much less computation cost. Experimental results demonstrate that the proposed approach also outperforms several recently proposed compact dictionary learning methods on human action recognition and object classification.

[1]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[2]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[3]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Jiawei Han,et al.  SRDA: An Efficient Algorithm for Large-Scale Discriminant Analysis , 2008, IEEE Transactions on Knowledge and Data Engineering.

[5]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[6]  Andreas Krause,et al.  Submodular Dictionary Selection for Sparse Representation , 2010, ICML.

[7]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[9]  Larry S. Davis,et al.  Recognizing actions by shape-motion prototype trees , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[11]  Michael Elad,et al.  K-SVD : DESIGN OF DICTIONARIES FOR SPARSE REPRESENTATION , 2005 .

[12]  Svetlana Lazebnik,et al.  Supervised Learning of Quantizer Codebooks by Information Loss Minimization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Robert P. W. Duin,et al.  Linear dimensionality reduction via a heteroscedastic extension of LDA: the Chernoff criterion , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[15]  Rama Chellappa,et al.  Sparse dictionary-based representation and recognition of action attributes , 2011, 2011 International Conference on Computer Vision.

[16]  Mubarak Shah,et al.  Learning human actions via information maximization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Qian Du,et al.  Semisupervised Discriminant Analysis for Hyperspectral Imagery With Block-Sparse Graph , 2015, IEEE Geoscience and Remote Sensing Letters.

[18]  Andreas Krause,et al.  Near-optimal sensor placements in Gaussian processes , 2005, ICML.

[19]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Meng Joo Er,et al.  PCA and LDA in DCT domain , 2005, Pattern Recognit. Lett..

[21]  Larry S. Davis,et al.  Submodular dictionary learning for sparse coding , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.