Label-expanded manifold regularization for semi-supervised classification

Manifold regularization (MR) provides a powerful framework for semi-supervised classification, which propagates labels from the labeled instances to unlabeled ones so that similar instances over the manifold have similar classification outputs. However, labeled instances are randomly located. Label propagation from those instances to their neighbors may mislead the classification of MR. To address this issue, in this paper we develop a novel label-expanded MR framework (LE_MR for short) for semi-supervised classification. In LE_MR, a clustering strategy such as KFCM is first adopted to discover the high-confidence instances, i.e., instances in the central region of clusters. Then those instances along with the cluster indices are adopted to expand the labeled instances set. Experiments show that LE_MR obtains encouraging results compared to state-of-the-art semi-supervised classification methods.

[1]  Wen Gao,et al.  Semi-supervised Learning of Caricature Pattern from Manifold Regularization , 2009, MMM.

[2]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[3]  Pandian Vasant,et al.  Fuzzy decision making of profit function in production planning using S-curve membership function , 2006, Comput. Ind. Eng..

[4]  Shiliang Sun,et al.  Manifold-preserving graph reduction for sparse semi-supervised learning , 2014, Neurocomputing.

[5]  Hui Xue,et al.  Semi-supervised classification learning by discrimination-aware manifold regularization , 2015, Neurocomputing.

[6]  Yong Luo,et al.  Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification , 2013, IEEE Transactions on Image Processing.

[7]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[8]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[9]  Partha Niyogi,et al.  Manifold regularization and semi-supervised learning: some theoretical analyses , 2013, J. Mach. Learn. Res..

[10]  Zhi-Hua Zhou,et al.  New Semi-Supervised Classification Method Based on Modified Cluster Assumption , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Nicolas Le Roux,et al.  Label Propagation and Quadratic Criterion , 2006, Semi-Supervised Learning.

[12]  Mohamed Cheriet,et al.  A modified Kernelized Fuzzy C-Means algorithm for noisy images segmentation: Application to MRI images , 2012 .

[13]  Joachim M. Buhmann,et al.  Manifold regularization for semi-supervised sequential learning , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.