A new asymmetric ε-insensitive pinball loss function based support vector quantile regression model

Abstract In this paper, we propose a novel asymmetric ϵ -insensitive pinball loss function for quantile estimation. There exists some pinball loss functions which attempt to incorporate the ϵ -insensitive zone approach in it but, they fail to extend the ϵ -insensitive approach for quantile estimation in true sense. The proposed asymmetric ϵ -insensitive pinball loss function can make an asymmetric ϵ - insensitive zone of fixed width around the data and divide it using τ value for the estimation of the τ th quantile. The use of the proposed asymmetric ϵ -insensitive pinball loss function in Support Vector Quantile Regression (SVQR) model improves its prediction ability significantly. It also brings the sparsity back in SVQR model. Further, the numerical results obtained by several experiments carried on simulated and real world datasets empirically show the efficacy of the proposed ‘ ϵ -Support Vector Quantile Regression’ ( ϵ -SVQR) model over other existing SVQR models.

[1]  Keming Yu,et al.  Bayesian quantile regression , 2001 .

[2]  Jeankyung Kim,et al.  Quantile regression with an epsilon-insensitive loss in a reproducing kernel Hilbert space , 2011 .

[3]  Ding-Xuan Zhou,et al.  Online learning for quantile regression and support vector regression , 2012 .

[4]  Liming Yang,et al.  Robust support vector machine with generalized quantile loss for classification and regression , 2019, Appl. Soft Comput..

[5]  Alexander J. Smola,et al.  Nonparametric Quantile Estimation , 2006, J. Mach. Learn. Res..

[6]  Y. Ye,et al.  A convergent algorithm for quantile regression with smoothing splines , 1995 .

[7]  I. Takeuchi,et al.  Non-crossing quantile regressions by SVM , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[8]  Qifa Xu,et al.  Weighted quantile regression via support vector machine , 2015, Expert Syst. Appl..

[9]  Gordon H. Huang,et al.  Development of PCA-based cluster quantile regression (PCA-CQR) framework for streamflow prediction: Application to the Xiangxi river watershed, China , 2017, Appl. Soft Comput..

[10]  Changha Hwang,et al.  Support vector quantile regression using asymmetric e-insensitive loss function , 2010, 2010 2nd International Conference on Education Technology and Computer.

[11]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[12]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[13]  Jooyong Shim,et al.  Support vector quantile regression with varying coefficients , 2016, Comput. Stat..

[14]  Hyungtae Hwang,et al.  Support vector quantile regression for autoregressive data , 2014 .

[15]  M. C. Jones,et al.  Local Linear Quantile Regression , 1998 .

[16]  Xi Liu,et al.  Quantile autoregression neural network model with applications to evaluating value at risk , 2016, Appl. Soft Comput..

[17]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[18]  B. Narasimhan,et al.  Bone mineral acquisition in healthy Asian, Hispanic, black, and Caucasian youth: a longitudinal study. , 1999, The Journal of clinical endocrinology and metabolism.

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Yufeng Liu,et al.  On Quantile Regression in Reproducing Kernel Hilbert Spaces with the Data Sparsity Constraint , 2016, J. Mach. Learn. Res..