A Fast and Accurate Progressive Algorithm for Training Transductive SVMs

This paper develops a fast and accurate algorithm for training transductive SVMs classifiers, which utilizes the classification information of unlabeled data in a progressive way. For improving the generalization accuracy further, we employ three important criteria to enhance the algorithm, i.e. confidence evaluation, suppression of labeled data, stopping with stabilization. Experimental results on several real world datasets confirm the effectiveness of these criteria and show that the new algorithm can reach to comparable accuracy as several state-of-the-art approaches for training transductive SVMs in much less training time.

[1]  Ishwar K. Sethi,et al.  Confidence-based classifier design , 2006, Pattern Recognit..

[3]  Ye Wang,et al.  Training TSVM with the proper number of positive samples , 2005, Pattern Recognit. Lett..

[4]  Alexander Zien,et al.  Semi-Supervised Classification by Low Density Separation , 2005, AISTATS.

[5]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[6]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  S. Sathiya Keerthi,et al.  Deterministic annealing for semi-supervised kernel machines , 2006, ICML.

[8]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[9]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[10]  Hong Liu,et al.  Fuzzy Transductive Support Vector Machines For Hypertext Classification , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[11]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.