From maxi-min margin machine classification to regression

The maxi-min margin machine (M4) algorithm, contrast to the traditional support vector machine (SVM) algorithm, gives a more robust solution and gets better generalization performance. In this paper we extend the M4 classification algorithm to deal with regression problem, and propose a novel regression method. This method inherits the characteristics of M4 such as good robustness and generalization performance. In this paper we discuss the linear and nonlinear case of the proposed method, and experimental results indicate its effectiveness and better robustness and generalization performance compared with the traditional SVR algorithm.

[1]  Gang Wang,et al.  A New Solution Path Algorithm in Support Vector Regression , 2008, IEEE Transactions on Neural Networks.

[2]  Koby Crammer,et al.  A Temporal Kernel-Based Model for Tracking Hand Movements from Neural Activities , 2004, NIPS.

[3]  Sun-Yuan Kung,et al.  Principal Component Neural Networks: Theory and Applications , 1996 .

[4]  Ingo Steinwart,et al.  Consistency of support vector machines and other regularized kernel classifiers , 2005, IEEE Transactions on Information Theory.

[5]  Michael R. Lyu,et al.  Localized support vector regression for time series prediction , 2009, Neurocomputing.

[6]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[7]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[8]  Gunnar Rätsch,et al.  Predicting Time Series with Support Vector Machines , 1997, ICANN.

[9]  Jinbo Bi,et al.  A geometric approach to support vector regression , 2003, Neurocomputing.

[10]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[13]  Michael R. Lyu,et al.  Robust Regularized Kernel Regression , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Michael R. Lyu,et al.  Maxi–Min Margin Machine: Learning Large Margin Classifiers Locally and Globally , 2008, IEEE Transactions on Neural Networks.