Support Vector Regression via a Combined Reward Cum Penalty Loss Function

In this paper, we introduce a novel combined reward cum penalty loss function to handle the regression problem. The proposed combined reward cum penalty loss function penalizes the data points which lie outside the $\epsilon$-tube of the regressor and also assigns reward for the data points which lie inside of the $\epsilon$-tube of the regressor. The combined reward cum penalty loss function based regression (RP-$\epsilon$-SVR) model has several interesting properties which are investigated in this paper and are also supported with the experimental results.

[1]  Sayan Mukherjee,et al.  Support Vector Method for Multivariate Density Estimation , 1999, NIPS.

[2]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[3]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[4]  Suresh Chandra,et al.  Large-margin Distribution Machine-based regression , 2018, Neural Computing and Applications.

[5]  Johan A. K. Suykens,et al.  Support Vector Machine Classifier With Pinball Loss , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  P. Zhong,et al.  Robust Support Vector Regression with Flexible Loss Function , 2014 .

[7]  Alexander J. Smola,et al.  Nonparametric Quantile Estimation , 2006, J. Mach. Learn. Res..

[8]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[9]  Omer Karal,et al.  Maximum likelihood optimal and robust Support Vector Regression with lncosh loss function , 2017, Neural Networks.

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[12]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[13]  Min Zhang,et al.  Robust regression framework with asymmetrically analogous to correntropy-induced loss , 2020, Knowl. Based Syst..

[14]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[15]  Ping Zhong,et al.  Robust Support Vector Regression with Generalized Loss Function and Applications , 2015, Neural Processing Letters.

[16]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[17]  Izhar Ahmad,et al.  One norm linear programming support vector regression , 2016, Neurocomputing.

[18]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[19]  Xinjun Peng,et al.  TSVR: An efficient Twin Support Vector Machine for regression , 2010, Neural Networks.

[20]  VectorRegressionAlex J. Smola.  A Tutorial on Support Vector Regression Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150 , 1998 .

[21]  Johan A. K. Suykens,et al.  Solution Path for Pin-SVM Classifiers With Positive and Negative $\tau $ Values , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[23]  Liming Yang,et al.  Robust support vector machine with generalized quantile loss for classification and regression , 2019, Appl. Soft Comput..

[24]  Jan-Ming Ho,et al.  Travel time prediction with support vector regression , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[25]  Mohamed Mohandes,et al.  Support vector machines for wind speed prediction , 2004 .

[26]  Ping Zhong,et al.  Robust non-convex least squares loss function for regression with outliers , 2014, Knowl. Based Syst..

[27]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[28]  D. T. Lee,et al.  Travel-time prediction with support vector regression , 2004, IEEE Transactions on Intelligent Transportation Systems.

[29]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Reshma Khemchandani,et al.  TWSVR: Regression via Twin Support Vector Machine , 2016, Neural Networks.