Nonnegative low-rank representation based manifold embedding for semi-supervised learning

The low-rank representation (LRR) can get essential row-representation of data and it is robust to illumination variation, occlusions and other types of noise. This paper presents a novel manifold embedding classification algorithm based on nonnegative low-rank representation for semi-supervised learning (MEC-NNLRR). In the proposed algorithm, label fitness, manifold smoothness and low-rank representation are integrated, and the label information from the labeled data and the manifold structure from all data are fully and effectively utilized. Based on LRR and manifold learning, the proposed MEC-NNLRR can capture the global and local structure information of the observed data. The obtained nonnegative low-rank representation coefficients can be used as a graph similarity matrix. Considering the physical interpretation of the graph matrix, we impose the non-negativity constraint on the coefficients. In addition, no matter whether the training samples or test samples are corrupted, the proposed MEC-NNLRR is little affected by noise. Extensive experiments on public image databases demonstrate that the proposed MEC-NNLRR is an excellent algorithm and achieves satisfactory results.

[1]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[2]  Zhihua Cai,et al.  Boosting for Multi-Graph Classification , 2015, IEEE Transactions on Cybernetics.

[3]  Xuelong Li,et al.  Learning a Nonnegative Sparse Graph for Linear Regression , 2015, IEEE Transactions on Image Processing.

[4]  Shuicheng Yan,et al.  Similarity preserving low-rank representation for enhanced data representation and effective subspace learning , 2014, Neural Networks.

[5]  Xuelong Li,et al.  Robust Semi-Supervised Subspace Clustering via Non-Negative Low-Rank Representation , 2016, IEEE Transactions on Cybernetics.

[6]  Yong Peng,et al.  Enhanced low-rank representation via sparse manifold adaption for semi-supervised learning , 2015, Neural Networks.

[7]  Choujun Zhan,et al.  Semi-Supervised Image Classification Based on Local and Global Regression , 2015, IEEE Signal Processing Letters.

[8]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[9]  Peng Zhang,et al.  SODE: Self-Adaptive One-Dependence Estimators for classification , 2016, Pattern Recognit..

[10]  Jian Yang,et al.  Integrating Conventional and Inverse Representation for Face Recognition , 2014, IEEE Transactions on Cybernetics.

[11]  Yu Chen,et al.  Supervised orthogonal discriminant subspace projects learning for face recognition , 2014, Neural Networks.

[12]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[13]  Jian Yang,et al.  Low-rank representation based discriminative projection for robust feature extraction , 2013, Neurocomputing.

[14]  Yulong Wang,et al.  Graph-Regularized Low-Rank Representation for Destriping of Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Chun Qi,et al.  From Local Geometry to Global Structure: Learning Latent Subspace for Low-resolution Face Image Recognition , 2015, IEEE Signal Processing Letters.

[16]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[17]  Jane You,et al.  Semi-supervised classification based on random subspace dimensionality reduction , 2012, Pattern Recognit..

[18]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Dacheng Tao,et al.  Classification with Noisy Labels by Importance Reweighting , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[22]  Xuelong Li,et al.  Discriminative Transfer Subspace Learning via Low-Rank and Sparse Representation , 2016, IEEE Transactions on Image Processing.

[23]  Xinbo Gao,et al.  A novel semi-supervised learning for face recognition , 2015, Neurocomputing.

[24]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[25]  Philip S. Yu,et al.  Bag Constrained Structure Pattern Mining for Multi-Graph Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[26]  Chunhong Pan,et al.  Manifold Regularized Local Sparse Representation for Face Recognition , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Jinhui Tang,et al.  Constructing a Nonnegative Low-Rank and Sparse Graph With Data-Adaptive Features , 2014, IEEE Transactions on Image Processing.

[28]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xuelong Li,et al.  Bayesian Tensor Approach for 3-D Face Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Shuyuan Yang,et al.  Semi-supervised classification via kernel low-rank representation graph , 2014, Knowl. Based Syst..

[31]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[32]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[33]  Xindong Wu,et al.  Positive and Unlabeled Multi-Graph Learning , 2017, IEEE Transactions on Cybernetics.

[34]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[35]  Jian Yang,et al.  LPP solution schemes for use with face recognition , 2010, Pattern Recognit..

[36]  Xuelong Li,et al.  Patch Alignment for Dimensionality Reduction , 2009, IEEE Transactions on Knowledge and Data Engineering.

[37]  Xiaojin Zhu,et al.  Semi-Supervised Learning Literature Survey , 2005 .

[38]  Ivor W. Tsang,et al.  Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction , 2010, IEEE Transactions on Image Processing.

[39]  Tommy W. S. Chow,et al.  Graph Based Constrained Semi-Supervised Learning Framework via Label Propagation over Adaptive Neighborhood , 2015, IEEE Transactions on Knowledge and Data Engineering.