Semi-supervised Classification by Nuclear-Norm Based Transductive Label Propagation

In this paper, we propose a new transductive label propagation method, Nuclear-norm based Transductive Label Propagation (N-TLP). To encode the neighborhood reconstruction error more accurately and reliably, we use the nuclear norm that has been proved to be more robust to noise and more suitable to model the reconstruction error than both L1-norm or Frobenius norm for characterizing the manifold smoothing degree. During the optimizations, the Nuclear-norm based reconstruction error term is transformed into the Frobenius norm based one for pursuing the solution. To enhance the robustness in the process of encoding the difference between initial labels and predicted ones, we propose to use a weighted L2,1-norm regularization on the label fitness error so that the resulted measurement would be more accurate. Promising results on several benchmark datasets are delivered by our N-TLP compared with several other related methods.

[1]  Li Zhang,et al.  Semi-Supervised Image Classification by Nonnegative Sparse Neighborhood Propagation , 2015, ICMR.

[2]  Feiping Nie,et al.  Unsupervised maximum margin feature selection via L2,1-norm minimization , 2012, Neural Computing and Applications.

[3]  Feiping Nie,et al.  A general graph-based semi-supervised learning with novel class discovery , 2010, Neural Computing and Applications.

[4]  Hao Chen,et al.  Prior class dissimilarity based linear neighborhood propagation , 2015, Knowl. Based Syst..

[5]  Yan Zhang,et al.  Discriminative sparse flexible manifold embedding with novel graph for robust visual representation and label propagation , 2017, Pattern Recognit..

[6]  Xuelong Li,et al.  Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection , 2014, IEEE Transactions on Cybernetics.

[7]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[8]  Zi Huang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence ℓ2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning , 2022 .

[9]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[10]  Jianzhong Wang,et al.  Locally Linear Embedding , 2021, Unsupervised Learning Approaches for Dimensionality Reduction and Data Visualization.

[11]  Hamid R. Rabiee,et al.  Supervised neighborhood graph construction for semi-supervised classification , 2012, Pattern Recognit..

[12]  Jian Yang,et al.  Nuclear Norm-Based 2-DPCA for Extracting Features From Images , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Bernhard Schölkopf,et al.  Cluster Kernels for Semi-Supervised Learning , 2002, NIPS.

[14]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2006, IEEE Transactions on Knowledge and Data Engineering.