Discriminative Fisher Embedding Dictionary Learning Algorithm for Object Recognition

Both interclass variances and intraclass similarities are crucial for improving the classification performance of discriminative dictionary learning (DDL) algorithms. However, existing DDL methods often ignore the combination between the interclass and intraclass properties of dictionary atoms and coding coefficients. To address this problem, in this paper, we propose a discriminative Fisher embedding dictionary learning (DFEDL) algorithm that simultaneously establishes Fisher embedding models on learned atoms and coefficients. Specifically, we first construct a discriminative Fisher atom embedding model by exploring the Fisher criterion of the atoms, which encourages the atoms of the same class to reconstruct the corresponding training samples as much as possible. At the same time, a discriminative Fisher coefficient embedding model is formulated by imposing the Fisher criterion on the profiles (row vectors of the coding coefficient matrix) and coding coefficients, which forces the coding coefficient matrix to become a block-diagonal matrix. Since the profiles can indicate which training samples are represented by the corresponding atoms, the proposed two discriminative Fisher embedding models can alternatively and interactively promote the discriminative capabilities of the learned dictionary and coding coefficients. The extensive experimental results demonstrate that the proposed DFEDL algorithm achieves superior performance in comparison with some state-of-the-art dictionary learning algorithms on both hand-crafted and deep learning-based features.

[1]  Xiaochun Cao,et al.  SLED: Semantic Label Embedding Dictionary Representation for Multilabel Image Annotation , 2015, IEEE Transactions on Image Processing.

[2]  Kathrin Klamroth,et al.  Biconvex sets and optimization with biconvex functions: a survey and extensions , 2007, Math. Methods Oper. Res..

[3]  Shuicheng Yan,et al.  Jointly Learning Structured Analysis Discriminative Dictionary and Analysis Multiclass Classifier , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[6]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jianbo Su,et al.  Sparse embedded dictionary learning on face recognition , 2017, Pattern Recognit..

[8]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Pingkun Yan,et al.  Alternatively Constrained Dictionary Learning For Image Superresolution , 2014, IEEE Transactions on Cybernetics.

[10]  Li Yao,et al.  Multi-feature kernel discriminant dictionary learning for face recognition , 2017, Pattern Recognit..

[11]  Věra Kůrková,et al.  Classification by Sparse Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Ming Shao,et al.  Deep Robust Encoder Through Locality Preserving Low-Rank Dictionary , 2016, ECCV.

[13]  Wei Liu,et al.  Learning Distance Metrics with Contextual Constraints for Image Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Richard E. Wendell,et al.  Minimization of a Non-Separable Objective Function Subject to Disjoint Constraints , 1976, Oper. Res..

[15]  Wei Liu,et al.  Discriminative Dictionary Learning With Common Label Alignment for Cross-Modal Retrieval , 2016, IEEE Transactions on Multimedia.

[16]  Jian Yang,et al.  Discriminative Block-Diagonal Representation Learning for Image Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Ajmal Mian,et al.  Nonparametric Coupled Bayesian Dictionary and Classifier Learning for Hyperspectral Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Jian Dong,et al.  A supervised dictionary learning and discriminative weighting model for action recognition , 2015, Neurocomputing.

[19]  Chengjun Liu,et al.  A Novel Locally Linear KNN Method With Applications to Visual Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Xinbo Gao,et al.  Dimensionality Reduction by Integrating Sparse Representation and Fisher Criterion and its Applications , 2015, IEEE Transactions on Image Processing.

[21]  Yongsheng Gao,et al.  Low-rank double dictionary learning from corrupted data for robust image classification , 2017, Pattern Recognit..

[22]  Chengjun Liu,et al.  A Sparse Representation Model Using the Complete Marginal Fisher Analysis Framework and Its Applications to Visual Recognition , 2017, IEEE Transactions on Multimedia.

[23]  David Malah,et al.  Local-to-Global Point Cloud Registration Using a Dictionary of Viewpoint Descriptors , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[24]  Yuan Yan Tang,et al.  Efficient Human Motion Retrieval via Temporal Adjacent Bag of Words and Discriminative Neighborhood Preserving Dictionary Learning , 2017, IEEE Transactions on Human-Machine Systems.

[25]  Vishal Monga,et al.  Fast Low-Rank Shared Dictionary Learning for Image Classification , 2016, IEEE Transactions on Image Processing.

[26]  Lei Zhang,et al.  Dictionary Pair Classifier Driven Convolutional Neural Networks for Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Xinbo Gao,et al.  Triplet-Based Deep Hashing Network for Cross-Modal Retrieval , 2018, IEEE Transactions on Image Processing.

[28]  Zexuan Ji,et al.  Cost-sensitive dictionary learning for face recognition , 2016, Pattern Recognit..

[29]  Cewu Lu,et al.  Scale Adaptive Dictionary Learning , 2014, IEEE Transactions on Image Processing.

[30]  Yun Fu,et al.  Temporal Subspace Clustering for Human Motion Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Xuan Tang,et al.  Reconstructible Nonlinear Dimensionality Reduction via Joint Dictionary Learning , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Jian Yang,et al.  Marginal Representation Learning With Graph Structure Self-Adaptation , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[33]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[34]  Xianglong Liu,et al.  Dictionary Learning in Optimal Metric Space , 2018, AAAI.

[35]  Yang Li,et al.  Non-negative dictionary based sparse representation classification for ear recognition with occlusion , 2016, Neurocomputing.

[36]  Anastasios Tefas,et al.  Dimensionality Reduction Using Similarity-Induced Embeddings , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Peng Tang,et al.  Learning Multi-Instance Deep Discriminative Patterns for Image Classification , 2017, IEEE Transactions on Image Processing.

[39]  Rama Chellappa,et al.  Non-linear dictionary learning with partially labeled data , 2015, Pattern Recognit..

[40]  Xiaoyan Sun,et al.  Multi-Dimensional Sparse Models , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  Dapeng Tao,et al.  Discriminative dictionary learning via Fisher discrimination K-SVD algorithm , 2015, Neurocomputing.

[43]  Christian Jutten,et al.  Learning Overcomplete Dictionaries Based on Atom-by-Atom Updating , 2014, IEEE Transactions on Signal Processing.

[44]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Dao-Qing Dai,et al.  Learning Kernel Extended Dictionary for Face Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Anoop Cherian,et al.  Riemannian Dictionary Learning and Sparse Coding for Positive Definite Matrices , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Angshul Majumdar,et al.  Discriminative Robust Deep Dictionary Learning for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Yap-Peng Tan,et al.  Nonlinear dictionary learning with application to image classification , 2018, Pattern Recognit..

[49]  Zuowei Shen,et al.  Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[51]  Lei Zhang,et al.  Support Vector Guided Dictionary Learning , 2014, ECCV.

[52]  Zhongliang Jing,et al.  Discriminative Structured Dictionary Learning on Grassmann Manifolds and Its Application on Image Restoration , 2018, IEEE Transactions on Cybernetics.

[53]  Gang Wang,et al.  Simultaneous Feature and Dictionary Learning for Image Set Based Face Recognition , 2014, ECCV.

[54]  Yun Fu,et al.  Learning low-rank and discriminative dictionary for image classification , 2014, Image Vis. Comput..

[55]  Michael Elad,et al.  Convolutional Dictionary Learning via Local Processing , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[56]  Ajmal S. Mian,et al.  Efficient classification with sparsity augmented collaborative representation , 2017, Pattern Recognit..

[57]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[58]  Hongwei Liu,et al.  Structured Kernel Dictionary Learning With Correlation Constraint for Object Recognition , 2017, IEEE Transactions on Image Processing.

[59]  Zheng Zhang,et al.  An interactively constrained discriminative dictionary learning algorithm for image classification , 2018, Eng. Appl. Artif. Intell..

[60]  Jian Yang,et al.  A Survey of Dictionary Learning Algorithms for Face Recognition , 2017, IEEE Access.

[61]  Yun Fu,et al.  Toward Resolution-Invariant Person Reidentification via Projective Dictionary Learning , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[63]  Ming Shao,et al.  Person Re-Identification by Cross-View Multi-Level Dictionary Learning , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[65]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[66]  Licheng Jiao,et al.  Discriminative Dictionary Learning With Two-Level Low Rank and Group Sparse Decomposition for Image Classification , 2017, IEEE Transactions on Cybernetics.

[67]  Yi Ma,et al.  Learning Category-Specific Dictionary and Shared Dictionary for Fine-Grained Image Categorization , 2014, IEEE Transactions on Image Processing.

[68]  Yuantao Gu,et al.  Cross-Label Suppression: A Discriminative and Fast Dictionary Learning With Group Regularization , 2017, IEEE Transactions on Image Processing.

[69]  Yiu-ming Cheung,et al.  Toward Efficient Image Representation: Sparse Concept Discriminant Matrix Factorization , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[70]  Tommy W. S. Chow,et al.  Sparse Codes Auto-Extractor for Classification: A Joint Embedding and Dictionary Learning Framework for Representation , 2016, IEEE Transactions on Signal Processing.

[71]  Jian Yang,et al.  Fisher discrimination dictionary pair learning for image classification , 2017, Neurocomputing.

[72]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[73]  Nilanjan Ray,et al.  Object Classification With Joint Projection and Low-Rank Dictionary Learning , 2016, IEEE Transactions on Image Processing.

[74]  Jean Ponce,et al.  Learning Dictionary of Discriminative Part Detectors for Image Categorization and Cosegmentation , 2016, International Journal of Computer Vision.

[75]  Rong Jin,et al.  Online Multiple Kernel Similarity Learning for Visual Search , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[76]  Yun Fu,et al.  Discriminative dictionary learning with low-rank regularization for face recognition , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[77]  Xiaoqing Ding,et al.  Discriminative Dimensionality Reduction for Multi-Dimensional Sequences , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Rongrong Ji,et al.  Query-dependent visual dictionary adaptation for image reranking , 2013, ACM Multimedia.

[79]  Jianping Fan,et al.  Jointly Learning Visually Correlated Dictionaries for Large-Scale Visual Recognition Applications , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Tinne Tuytelaars,et al.  A Testbed for Cross-Dataset Analysis , 2014, ECCV Workshops.

[81]  Ajmal S. Mian,et al.  Joint Discriminative Bayesian Dictionary and Classifier Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[82]  Jan P. Allebach,et al.  Model-Based Iterative Restoration for Binary Document Image Compression with Dictionary Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[83]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[84]  Yang Song,et al.  Dictionary Reduction: Automatic Compact Dictionary Learning for Classification , 2016, ACCV.

[85]  Jian Yang,et al.  A Locality-Constrained and Label Embedding Dictionary Learning Algorithm for Image Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[86]  Larry S. Davis,et al.  Learning Structured Low-Rank Representations for Image Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[87]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[88]  Brian C. Lovell,et al.  Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference , 2009, ICB.