Joint local constraint and fisher discrimination based dictionary learning for image classification

Abstract Dictionary learning has achieved outstanding results in the field of pattern recognition. The locality as an important structure characteristic of the data has been widely used in various learning task including dictionary learning, and Fisher discriminant has also been widely used. In this paper, to improve the performance of dictionary learning, we propose a joint local-constraint and fisher discrimination based dictionary learning method (JLCFDDL) for image classification. Our method uses the Laplacian regularized constraint of atoms rather than that of training samples to preserve the local information of the data. Meanwhile, fisher discriminative constraint is imposed on the atoms to maintain the differences between the atoms of different classes and to reduce the differences of atoms of the same class. The joint constraints make the obtained dictionary with powerful image classification performance. We also provide mathematical analysis of the proposed objective function. A large number of experiments prove that our method achieves better performance than existing state-of-the-art dictionary learning method.

[1]  Christian Jutten,et al.  Learning Overcomplete Dictionaries Based on Atom-by-Atom Updating , 2014, IEEE Transactions on Signal Processing.

[2]  Xiaohong Jia,et al.  Adaptive Morphological Reconstruction for Seeded Image Segmentation , 2019, IEEE Transactions on Image Processing.

[3]  Chen Gong,et al.  Multi-Manifold Positive and Unlabeled Learning for Visual Analysis , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[5]  Jian Yang,et al.  Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification , 2016, Pattern Recognit..

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Jun Yu,et al.  Multitask Autoencoder Model for Recovering Human Poses , 2018, IEEE Transactions on Industrial Electronics.

[8]  Liping Li,et al.  Space-frequency domain based joint dictionary learning and collaborative representation for face recognition , 2018, Signal Process..

[9]  Hujun Bao,et al.  Understanding the Power of Clause Learning , 2009, IJCAI.

[10]  Hong Liu,et al.  Using the original and 'symmetrical face' training samples to perform representation based two-step face recognition , 2013, Pattern Recognit..

[11]  Leida Li,et al.  No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation , 2018, IEEE Transactions on Image Processing.

[12]  Yang Wang,et al.  Locality constrained Graph Optimization for Dimensionality Reduction , 2017, Neurocomputing.

[13]  Yuli Fu,et al.  Efficient locality-constrained occlusion coding for face recognition , 2017, Neurocomputing.

[14]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jun Li,et al.  Weighted constraint based dictionary learning for image classification , 2020, Pattern Recognit. Lett..

[16]  Yu Zhang,et al.  Dilated Residual Networks with Symmetric Skip Connection for image denoising , 2019, Neurocomputing.

[17]  Jian Yang,et al.  A Locality-Constrained and Label Embedding Dictionary Learning Algorithm for Image Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[19]  Lei Zhang,et al.  Support Vector Guided Dictionary Learning , 2014, ECCV.

[20]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jian Yang,et al.  Ensemble Teaching for Hybrid Label Propagation , 2019, IEEE Transactions on Cybernetics.

[22]  Svetha Venkatesh,et al.  Joint learning and dictionary construction for pattern recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Jianping Fan,et al.  Leveraging Content Sensitiveness and User Trustworthiness to Recommend Fine-Grained Privacy Settings for Social Image Sharing , 2018, IEEE Transactions on Information Forensics and Security.

[24]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[25]  Bo Du,et al.  Robust Graph-Based Semisupervised Learning for Noisy Labeled Data via Maximum Correntropy Criterion , 2019, IEEE Transactions on Cybernetics.

[26]  Brian C. Lovell,et al.  Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference , 2009, ICB.

[27]  Zihan Zhou,et al.  Demo: Robust face recognition via sparse representation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[28]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[29]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[30]  Jian Yang,et al.  Sample diversity, representation effectiveness and robust dictionary learning for face recognition , 2017, Inf. Sci..

[31]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[32]  Guoqing Zhang,et al.  Multiple kernel locality-constrained collaborative representation-based discriminant projection for face recognition , 2018, Neurocomputing.

[33]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Liang-Tien Chia,et al.  Laplacian Sparse Coding, Hypergraph Laplacian Sparse Coding, and Applications , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Xuelong Li,et al.  Discriminative Transfer Subspace Learning via Low-Rank and Sparse Representation , 2016, IEEE Transactions on Image Processing.

[36]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[37]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[39]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Shigang Liu,et al.  A local region-based Chan-Vese model for image segmentation , 2012, Pattern Recognit..

[41]  David Zhang,et al.  Using the idea of the sparse representation to perform coarse-to-fine face recognition , 2013, Inf. Sci..

[42]  Qiang Wu,et al.  Coupled Bilinear Discriminant Projection for Cross-View Gait Recognition , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Jianping Fan,et al.  iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning , 2017, IEEE Transactions on Information Forensics and Security.

[44]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[45]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..