Making large scale SVM learning practical

Training a support vector machine SVM leads to a quadratic optimization problem with bound constraints and one linear equality constraint. Despite the fact that this type of problem is well understood, there are many issues to be considered in designing an SVM learner. In particular, for large learning tasks with many training examples on the shelf optimization techniques for general quadratic programs quickly become intractable in their memory and time requirements. SVM light is an implementation of an SVM learner which addresses the problem of large tasks. This chapter presents algorithmic and computational results developed for SVM light V 2.0, which make large-scale SVM training more practical. The results give guidelines for the application of SVMs to large domains.

[1]  G. Zoutendijk,et al.  Methods of feasible directions : a study in linear and non-linear programming , 1960 .

[2]  Singiresu S. Rao,et al.  Optimization Theory and Applications , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Philip E. Gill,et al.  Practical optimization , 1981 .

[4]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[5]  Federico Girosi,et al.  Support Vector Machines: Training and Applications , 1997 .

[6]  Federico Girosi,et al.  An improved training algorithm for support vector machines , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[7]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[9]  Thorsten Joachims,et al.  Text categorization with support vector machines , 1999 .

[10]  B. Schölkopf,et al.  Advances in kernel methods: support vector learning , 1999 .

[11]  Linda Kaufman,et al.  Solving the quadratic programming problem arising in support vector classification , 1999 .

[12]  R. Vanderbei LOQO:an interior point code for quadratic programming , 1999 .

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.