论文信息 - Query Learning with Large Margin Classi ersColin

Query Learning with Large Margin Classi ersColin

The active selection of instances can significantly improve the generalisation performance of a learning machine. Large margin classifiers such as support vector machines classify data using the most informative instances (the support vectors). This makes them natural candidates for instance selection strategies. In this paper we propose an algorithm for the training of support vector machines using instance selection. We give a theoretical justification for the strategy and experimental results on real and artificial data demonstrating its effectiveness. The technique is most efficient when the data set can be learnt using few support vectors.

[1] W. Hoeffding. Probability Inequalities for sums of Bounded Random Variables , 1963 .

[2] Lawrence D. Jackel,et al. Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[3] Geoffrey E. Hinton,et al. Simplifying Neural Networks by Soft Weight-Sharing , 1992, Neural Computation.

[4] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[5] Alexander J. Smola,et al. Regression estimation with support vector learning machines , 1996 .

[6] Bernhard Schölkopf,et al. On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion , 1998, Algorithmica.

[7] Vladimir Vapnik,et al. Statistical learning theory , 1998 .

[8] Bernhard Schölkopf,et al. Shrinking the Tube: A New Support Vector Regression Algorithm , 1998, NIPS.

[9] Alexander J. Smola,et al. Learning with kernels , 1998 .

[10] Catherine Blake,et al. UCI Repository of machine learning databases , 1998 .

[11] Bernhard Schölkopf,et al. Sparse Kernel Feature Analysis , 2002 .

[12] Dustin Boswell,et al. Introduction to Support Vector Machines , 2002 .

[13] H. Sebastian Seung,et al. Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.