Analysis Dictionary Learning Based Classification: Structure for Robustness

A discriminative structured analysis dictionary is proposed for the classification task. A structure of the union of subspaces (UoS) is integrated into the conventional analysis dictionary learning to enhance the capability of discrimination. A simple classifier is also simultaneously included into the formulated function to ensure a more complete consistent classification. The solution of the algorithm is efficiently obtained by the linearized alternating direction method of multipliers. Moreover, a distributed structured analysis dictionary learning is also presented to address large-scale datasets. It can group-(class-) independently train the structured analysis dictionaries by different machines/cores/threads, and therefore avoid a high computational cost. A consensus structured analysis dictionary and a global classifier are jointly learned in the distributed approach to safeguard the discriminative power and the efficiency of classification. Experiments demonstrate that our method achieves a comparable or better performance than the state-of-the-art algorithms in a variety of visual classification tasks. In addition, the training and testing computational complexity are also greatly reduced.

[1]  Liyi Dai,et al.  Deep Dictionary Learning: A PARametric NETwork Approach , 2018, IEEE Transactions on Image Processing.

[2]  Xiangyang Luo,et al.  Multi-View Analysis Dictionary Learning for Image Classification , 2018, IEEE Access.

[3]  Xiaoqin Zhang,et al.  Semi-Supervised Dictionary Learning via Structural Sparse Preserving , 2016, AAAI.

[4]  Alec Koppel,et al.  Task-driven dictionary learning in distributed online settings , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[5]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[6]  Shengli Xie,et al.  Proximal Alternating Minimization for Analysis Dictionary Learning and Convergence Analysis , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[7]  Liyi Dai,et al.  Analysis dictionary learning for scene classification , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[8]  Xiao-Yuan Jing,et al.  Uncorrelated Multi-View Discrimination Dictionary Learning for Recognition , 2014, AAAI.

[9]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[10]  Yujie Li,et al.  A dictionary-learning algorithm for the analysis sparse model with a determinant-type of sparsity measure , 2014, 2014 19th International Conference on Digital Signal Processing.

[11]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[12]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[13]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Jun Guo,et al.  Synthesis K-SVD based analysis dictionary learning for pattern classification , 2018, Multimedia Tools and Applications.

[15]  Wei Dai,et al.  Analysis SimCO Algorithms for Sparse Analysis Model Based Dictionary Learning , 2016, IEEE Transactions on Signal Processing.

[16]  Guillermo Sapiro,et al.  Classification and clustering via dictionary learning with structured incoherence and shared features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[19]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[20]  Jun Guo,et al.  Class-Aware Analysis Dictionary Learning for Pattern Classification , 2017, IEEE Signal Processing Letters.

[21]  A. Martínez,et al.  The AR face databasae , 1998 .

[22]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[23]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Michael Elad,et al.  The Cosparse Analysis Model and Algorithms , 2011, ArXiv.

[25]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[28]  Michael Elad,et al.  Analysis versus synthesis in signal priors , 2006, 2006 14th European Signal Processing Conference.

[29]  Gabriel Peyré,et al.  Learning Analysis Sparsity Priors , 2011 .

[30]  Xiang Li,et al.  Constrained analysis dictionary learning with the ℓ1/2-norm regularizer , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[31]  Shuicheng Yan,et al.  Jointly Learning Structured Analysis Discriminative Dictionary and Analysis Multiclass Classifier , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[33]  Yujie Li,et al.  Analysis dictionary learning based on summation of blocked determinants measure of sparseness , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[34]  Rama Chellappa,et al.  Analysis sparse coding models for image-based classification , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[35]  Ye Zhang,et al.  An analysis dictionary learning algorithm based on recursive least squares , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[36]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[37]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Liyi Dai,et al.  Sparse null space basis pursuit and analysis dictionary learning for high-dimensional data analysis , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Liyi Dai,et al.  Sparsity and Nullity: Paradigms for Analysis Dictionary Learning , 2016, SIAM J. Imaging Sci..

[40]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[41]  Thomas S. Huang,et al.  A Max-Margin Perspective on Sparse Representation-Based Classification , 2013, 2013 IEEE International Conference on Computer Vision.

[42]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[43]  Man Zhang,et al.  Discriminative Analysis Dictionary Learning , 2016, AAAI.

[44]  Michael Elad,et al.  Analysis K-SVD: A Dictionary-Learning Algorithm for the Analysis Sparse Model , 2013, IEEE Transactions on Signal Processing.

[45]  Asok Ray,et al.  Multimodal Task-Driven Dictionary Learning for Image Classification , 2015, IEEE Transactions on Image Processing.

[46]  Lei Zhang,et al.  Projective dictionary pair learning for pattern classification , 2014, NIPS.

[47]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[48]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Liyi Dai,et al.  Structured Analysis Dictionary Learning for Image Classification , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  Meng Liu,et al.  Online Data Organizer: Micro-Video Categorization by Structure-Guided Multimodal Dictionary Learning , 2019, IEEE Transactions on Image Processing.

[51]  Mohammed Bennamoun,et al.  Resfeats: Residual network based features for image classification , 2016, 2017 IEEE International Conference on Image Processing (ICIP).