Manifold Correlation Graph for Semi-Supervised Learning

Due to the growing availability of unlabeled data and the difficulties in obtaining labeled data, the use of semi-supervised learning approaches becomes even more promising. The capacity of taking into account the dataset structure is of crucial relevance for effectively considering the unlabeled data. In this paper, a novel classifier is proposed through a manifold learning approach. The graph is constructed based on a new hybrid similarity measure which encodes both supervised and unsupervised information. Next, strongly connected components are computed and used to analyze the dataset manifold. The classification is performed through a voting scheme based on primary (labeled) and secondary (unlabeled) voters. An experimental evaluation is conducted, considering various datasets, diverse situations of training/test dataset sizes and comparison with baselines. The proposed method achieved positive results in most of situations.

[1]  Fabricio A. Breve,et al.  Combined unsupervised and semi-supervised learning for data classification , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[2]  Fabricio A. Breve,et al.  Particle Competition and Cooperation in Networks for Semi-Supervised Learning , 2012, IEEE Transactions on Knowledge and Data Engineering.

[3]  Ricardo da Silva Torres,et al.  A correlation graph approach for unsupervised manifold learning in image retrieval tasks , 2016, Neurocomputing.

[4]  Stephen P. Boyd,et al.  The Fastest Mixing Markov Process on a Graph and a Connection to a Maximum Variance Unfolding Problem , 2006, SIAM Rev..

[5]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[6]  Qingbo Wu,et al.  Manifold-ranking embedded order preserving hashing for image semantic retrieval , 2017, J. Vis. Commun. Image Represent..

[7]  Xiaojin Zhu,et al.  Semi-Supervised Learning , 2010, Encyclopedia of Machine Learning.

[8]  Song Bai,et al.  Beyond diffusion process: Neighbor set similarity for fast re-ranking , 2015, Inf. Sci..

[9]  Nicolas Le Roux,et al.  Efficient Non-Parametric Function Induction in Semi-Supervised Learning , 2004, AISTATS.

[10]  Bernhard Schölkopf,et al.  Cluster Kernels for Semi-Supervised Learning , 2002, NIPS.

[11]  Mikhail Belkin,et al.  Beyond the point cloud: from transductive to semi-supervised learning , 2005, ICML.

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, CVPR.

[14]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[15]  Ronald Rosenfeld,et al.  Semi-supervised learning with graphs , 2005 .

[16]  Yannis Avrithis,et al.  Efficient Diffusion on Region Manifolds: Recovering Small Objects with Compact CNN Representations , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Alexander Zien,et al.  Semi-Supervised Classification by Low Density Separation , 2005, AISTATS.

[18]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[19]  Zoubin Ghahramani,et al.  Learning from labeled and unlabeled data with label propagation , 2002 .

[20]  Mikhail Belkin,et al.  Regularization and Semi-supervised Learning on Large Graphs , 2004, COLT.

[21]  Daniel Carlos Guimarães Pedronette,et al.  Unsupervised manifold learning using Reciprocal kNN Graphs in image re-ranking and rank aggregation tasks , 2014, Image Vis. Comput..

[22]  Anderson Rocha,et al.  Rank Aggregation for Pattern Classifier Selection in Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[24]  João Paulo Papa,et al.  Improving semi-supervised learning through optimum connectivity , 2016, Pattern Recognit..

[25]  Thorsten Joachims,et al.  Transductive Learning via Spectral Graph Partitioning , 2003, ICML.

[26]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[27]  Song Bai,et al.  Sparse Contextual Activation for Efficient Visual Re-Ranking , 2016, IEEE Transactions on Image Processing.

[28]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[29]  Daniel Carlos Guimarães Pedronette,et al.  Unsupervised manifold learning through reciprocal kNN graph and Connected Components for image retrieval tasks , 2018, Pattern Recognit..

[30]  Zhuowen Tu,et al.  Improving Shape Retrieval by Learning Graph Transduction , 2008, ECCV.

[31]  Xiaohui Cheng,et al.  Feature self-representation based hypergraph unsupervised feature selection via low-rank representation , 2017, Neurocomputing.

[32]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[33]  Liang Zhao,et al.  Semi-Supervised Learning Using Random Walk Limiting Probabilities , 2013, ISNN.