Training nu-support vector regression: theory and algorithms.

We discuss the relation between epsilon-support vector regression (epsilon-SVR) and nu-support vector regression (nu-SVR). In particular, we focus on properties that are different from those of C-support vector classification (C-SVC) and nu-support vector classification (nu-SVC). We then discuss some issues that do not occur in the case of classification: the possible range of epsilon and the scaling of target values. A practical decomposition method for nu-SVR is implemented, and computational experiments are conducted. We show some interesting numerical observations specific to regression.

[1]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[2]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[4]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[5]  Bernhard Schölkopf,et al.  Shrinking the Tube: A New Support Vector Regression Algorithm , 1998, NIPS.

[6]  Pavel Laskov,et al.  An Improved Decomposition Algorithm for Regression Support Vector Machines , 1999, NIPS.

[7]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[8]  David J. Crisp,et al.  A Geometric Interpretation of ?-SVM Classifiers , 1999, NIPS 2000.

[9]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[10]  S. Sathiya Keerthi,et al.  Improvements to the SMO algorithm for SVM regression , 2000, IEEE Trans. Neural Networks Learn. Syst..

[11]  Chih-Jen Lin,et al.  On the convergence of the decomposition method for support vector machines , 2001, IEEE Trans. Neural Networks.

[12]  Gary William Flake,et al.  Efficient SVM Regression Training with SMO , 2002, Machine Learning.

[13]  Chih-Jen Lin,et al.  A Simple Decomposition Method for Support Vector Machines , 2002, Machine Learning.

[14]  S. Sathiya Keerthi,et al.  Convergence of a Generalized SMO Algorithm for SVM Classifier Design , 2002, Machine Learning.