Machine Learning with Labeled and Unlabeled Data

The field of semi-supervised learning has been expanding rapidly in the past few years, with a sheer increase in the number of related publications. In this paper we present the SSL problem in contrast with supervised and unsupervised learning. In addition, we propose a taxonomy with which we categorize many existing approaches described in the literature based on their underlying framework, data representation, and algorithmic class.

[1]  Jason Weston,et al.  Semi-supervised Protein Classification Using Cluster Kernels , 2003, NIPS.

[2]  Liva Ralaivola,et al.  Semi-supervised bipartite ranking with the normalized Rayleigh coefficient , 2009, ESANN.

[3]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[4]  Ayhan Demiriz,et al.  Constrained K-Means Clustering , 2000 .

[5]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[6]  Nello Cristianini,et al.  Efficiently Learning the Metric with Side-Information , 2003, ALT.

[7]  Thorsten Joachims,et al.  Transductive Learning via Spectral Graph Partitioning , 2003, ICML.

[8]  Arindam Banerjee,et al.  Semi-supervised Clustering by Seeding , 2002, ICML.

[9]  Nello Cristianini,et al.  Fast SDP Relaxations of Graph Cut Clustering, Transduction, and Other Combinatorial Problem , 2006, J. Mach. Learn. Res..

[10]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[11]  Nello Cristianini,et al.  Convex Methods for Transduction , 2003, NIPS.

[12]  Ayhan Demiriz,et al.  Semi-Supervised Support Vector Machines , 1998, NIPS.

[13]  Jason Weston,et al.  Trading convexity for scalability , 2006, ICML.

[14]  Thierry Denoeux,et al.  Partially-supervised learning in Independent Factor Analysis , 2009, ESANN.

[15]  Tijl De Bie,et al.  Semi-Supervised Learning Using Semi-Definite Programming , 2006, Semi-Supervised Learning.

[16]  Tijl De Bie,et al.  Deploying SDP for machine learning , 2007, ESANN.

[17]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[18]  Bernhard Schölkopf,et al.  Cluster Kernels for Semi-Supervised Learning , 2002, NIPS.

[19]  Ulf Brefeld,et al.  Semi-supervised learning for structured output variables , 2006, ICML.

[20]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[21]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[22]  Ran El-Yaniv,et al.  Explicit Learning Curves for Transduction and Application to Clustering and Compression Algorithms , 2004, J. Artif. Intell. Res..

[23]  Johan A. K. Suykens,et al.  Transductively Learning from Positive Examples Only , 2009, ESANN.

[24]  Massih-Reza Amini,et al.  A self-training method for learning to rank with unlabeled data , 2009, ESANN.

[25]  Tomer Hertz,et al.  Computing Gaussian Mixture Models with EM Using Equivalence Constraints , 2003, NIPS.

[26]  Johan A. K. Suykens,et al.  Learning from General Label Constraints , 2004, SSPR/SPR.

[27]  Ruy Luiz Milidiú,et al.  Improving BAS committee performance with a semi-supervised approach , 2009, ESANN.

[28]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[29]  Misha Pavel,et al.  Adjustment Learning and Relevant Component Analysis , 2002, ECCV.

[30]  Frank-Michael Schleif,et al.  Advances in computational intelligence and learning , 2010 .

[31]  Dale Schuurmans,et al.  Unsupervised and Semi-Supervised Multi-Class Support Vector Machines , 2005, AAAI.

[32]  Charles Bouveyron,et al.  Supervised classification of categorical data with uncertain labels for DNA barcoding , 2009, ESANN.

[33]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Peng Li,et al.  A Variational Approach to Semi-Supervised Clustering , 2009, ESANN.

[35]  Michel X. Goemans,et al.  Semideenite Programming in Combinatorial Optimization , 1999 .

[36]  Claudio Giuliano,et al.  A semi-supervised approach to question classification , 2009, ESANN.

[37]  Mehryar Mohri,et al.  On Transductive Regression , 2006, NIPS.

[38]  Jianbo Shi,et al.  Grouping with Bias , 2001, NIPS.