Low-Rank Linear Embedding for Image Recognition

Locality preserving projections (LPP) has been widely studied and extended in recent years, because of its promising performance in feature extraction. In this paper, we propose a modified version of the LPP by constructing a novel regression model. To improve the performance of the model, we impose a low-rank constraint on the regression matrix to discover the latent relations between different neighbors. By using the <inline-formula><tex-math notation="LaTeX"> $L_{2,1}$</tex-math></inline-formula>-norm as a metric for the loss function, we can further minimize the reconstruction error and derive a robust model. Furthermore, the <inline-formula><tex-math notation="LaTeX">$L_{2,1}$ </tex-math></inline-formula>-norm regularization term is added to obtain a jointly sparse regression matrix for feature selection. An iterative algorithm with guaranteed convergence is designed to solve the optimization problem. To validate the recognition efficiency, we apply the algorithm to a series of benchmark datasets containing face and character images for feature extraction. The experimental results show that the proposed method is better than some existing methods. The code of this paper can be downloaded from <uri>http://www.scholat.com/laizhihui</uri>.

[1]  C. Ding,et al.  On the equivalent of low-rank linear regressions and linear discriminant analysis based regressions , 2013, KDD.

[2]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[3]  Jian Yang,et al.  Rotational Invariant Dimensionality Reduction Algorithms , 2017, IEEE Transactions on Cybernetics.

[4]  Jian Yang,et al.  Approximate Orthogonal Sparse Embedding for Dimensionality Reduction , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Zhenyu He,et al.  Joint sparse principal component analysis , 2017, Pattern Recognit..

[7]  Jian Yang,et al.  Nuclear Norm-Based 2-DPCA for Extracting Features From Images , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Feiping Nie,et al.  Fast and Orthogonal Locality Preserving Projections for Dimensionality Reduction. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[9]  Shuicheng Yan,et al.  Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[10]  Norbert Schuff,et al.  Locally linear embedding (LLE) for MRI based Alzheimer's disease classification , 2013, NeuroImage.

[11]  Shuicheng Yan,et al.  Pairwise Sparsity Preserving Embedding for Unsupervised Subspace Learning and Classification , 2013, IEEE Transactions on Image Processing.

[12]  Chris H. Q. Ding,et al.  R1-PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization , 2006, ICML.

[13]  Jieping Ye,et al.  Optimal exact least squares rank minimization , 2012, KDD.

[14]  Qi Tian,et al.  Discriminant Subspace Analysis: An Adaptive Approach for Image Classification , 2009, IEEE Transactions on Multimedia.

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[17]  Qiuqi Ruan,et al.  Tensor Rank One Discriminant Locally Linear Embedding for facial expression classification , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[18]  Jian Yang,et al.  Robust nuclear norm regularized regression for face recognition with occlusion , 2015, Pattern Recognit..

[19]  Qingyao Wu,et al.  Supervised Feature Selection With a Stratified Feature Weighting Method , 2018, IEEE Access.

[20]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[21]  A. Martínez,et al.  The AR face databasae , 1998 .

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Feiping Nie,et al.  Semi-supervised Feature Selection via Rescaled Linear Regression , 2017, IJCAI.

[24]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[25]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[26]  Zi Huang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence ℓ2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning , 2022 .

[27]  S. Li,et al.  1 D-LDA versus 2 D-LDA : When Is Vector-based Linear Discriminant Analysis Better than Matrix-based ? , 2008 .

[28]  Xiaoming Zhang,et al.  Feature Fusion Using Locally Linear Embedding for Classification , 2010, IEEE Transactions on Neural Networks.

[29]  Shang-Hong Lai,et al.  Reconstructing 3D Face Model with Associated Expression Deformation from a Single Face Image via Constructing a Low-Dimensional Expression Deformation Manifold , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[31]  Changsheng Xu,et al.  Inductive Robust Principal Component Analysis , 2012, IEEE Transactions on Image Processing.

[32]  Nicu Sebe,et al.  Classifier-specific intermediate representation for multimedia tasks , 2012, ICMR '12.

[33]  W. Wong,et al.  Supervised optimal locality preserving projection , 2012, Pattern Recognit..

[34]  Jian Yang,et al.  LPP solution schemes for use with face recognition , 2010, Pattern Recognit..

[35]  Wei Jia,et al.  Discriminant sparse neighborhood preserving embedding for face recognition , 2012, Pattern Recognit..

[36]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Ling Shao,et al.  Discriminative Elastic-Net Regularized Linear Regression , 2017, IEEE Transactions on Image Processing.

[38]  Bin Luo,et al.  2D-LPP: A two-dimensional extension of locality preserving projections , 2007, Neurocomputing.

[39]  Xuelong Li,et al.  Nuclear Norm-Based 2DLPP for Image Classification , 2017, IEEE Transactions on Multimedia.

[40]  Zhihui Lai,et al.  The L2, 1-norm-based unsupervised optimal feature selection with applications to action recognition , 2016, Pattern Recognit..

[41]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[42]  Jian Yang,et al.  Sparse Representation Classifier Steered Discriminative Projection With Applications to Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Li Zhang,et al.  Joint Low-Rank and Sparse Principal Feature Coding for Enhanced Robust Representation and Visual Classification , 2016, IEEE Transactions on Image Processing.

[44]  Xuelong Li,et al.  Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection , 2014, IEEE Transactions on Cybernetics.

[45]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[46]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.