Twin support vector quantile regression

We propose a twin support vector quantile regression (TSVQR) to capture the heterogeneous and asymmetric information in modern data. Using a quantile parameter, TSVQR effectively depicts the heterogeneous distribution information with respect to all portions of data points. Correspondingly, TSVQR constructs two smaller sized quadratic programming problems (QPPs) to generate two nonparallel planes to measure the distributional asymmetry between the lower and upper bounds at each quantile level. The QPPs in TSVQR are smaller and easier to solve than those in previous quantile regression methods. Moreover, the dual coordinate descent algorithm for TSVQR also accelerates the training speed. Experimental results on six artiffcial data sets, ffve benchmark data sets, two large scale data sets, two time-series data sets, and two imbalanced data sets indicate that the TSVQR outperforms previous quantile regression methods in terms of the effectiveness of completely capturing the heterogeneous and asymmetric information and the efffciency of the learning process.

[1]  Jinran Wu,et al.  Iterative Learning in Support Vector Regression With Heterogeneous Variances , 2023, IEEE Transactions on Emerging Topics in Computational Intelligence.

[2]  Sugen Chen,et al.  Robust Twin Support Vector Regression with Smooth Truncated Hε Loss Function , 2023, Neural Processing Letters.

[3]  Weili Xiong,et al.  Incremental learning for Lagrangian ε-twin support vector regression , 2023, Soft Computing.

[4]  G. McLachlan,et al.  A new algorithm for support vector regression with automatic selection of hyperparameters , 2022, Pattern Recognit..

[5]  Chunna Li,et al.  Financial technology as a driver of poverty alleviation in China: Evidence from an innovative regression approach , 2022, Journal of Innovation & Knowledge.

[6]  Ya-Fen Ye,et al.  Online support vector quantile regression for the dynamic time series with heavy-tailed noise , 2021, Appl. Soft Comput..

[7]  Wanich Suksatan,et al.  Asymmetric impact of temperature on COVID-19 spread in India: Evidence from quantile-on-quantile regression approach , 2021, Journal of Thermal Biology.

[8]  Mohamed Ouhourane,et al.  Group penalized quantile regression , 2021, Statistical Methods & Applications.

[9]  N. Ferguson,et al.  Precision Medicine and Heterogeneity of Treatment Effect in Therapies for ARDS , 2021, Chest.

[10]  K. Cheong,et al.  Existence of asymmetry between wages and automatable jobs: a quantile regression approach , 2021, International Journal of Social Economics.

[11]  X. Zhuang,et al.  Characterizing spatial gene expression heterogeneity in spatially resolved single-cell transcriptomic data with nonuniform cellular densities , 2021, Genome research.

[12]  D. Gupta,et al.  On robust asymmetric Lagrangian ν-twin support vector regression using pinball loss function , 2021, Appl. Soft Comput..

[13]  Deepak Gupta,et al.  Least squares large margin distribution machine for regression , 2021, Applied Intelligence.

[14]  D. Gupta,et al.  On Regularization Based Twin Support Vector Regression with Huber Loss , 2021, Neural Process. Lett..

[15]  Bart Baesens,et al.  A hierarchical mixture cure model with unobserved heterogeneity for credit risk , 2021, Econometrics and Statistics.

[16]  Gretchen A. Stevens,et al.  Heterogeneous contributions of change in population distribution of body mass index to change in obesity and underweight , 2020, eLife.

[17]  Kangyin Dong,et al.  How does technological innovation mitigate CO2 emissions in OECD countries? Heterogeneous analysis using panel quantile regression. , 2020, Journal of environmental management.

[18]  Haitao Wu,et al.  Does the Development of the Internet Contribute to Air Pollution Control in China? Mechanism Discussion and Empirical Test , 2020, Structural Change and Economic Dynamics.

[19]  Reshma Rastogi,et al.  A new asymmetric ε-insensitive pinball loss function based support vector quantile regression model , 2020, Appl. Soft Comput..

[20]  Ya-Fen Ye,et al.  Robust support vector regression with generic quadratic nonconvex ε-insensitive loss , 2020 .

[21]  Huong Mai Nguyen,et al.  Local governance, education and occupation-education mismatch: Heterogeneous effects on wages in a lower middle income economy , 2019, International Journal of Educational Development.

[22]  Umesh Gupta,et al.  An improved regularization based Lagrangian asymmetric ν-twin support vector regression using pinball loss function , 2019, Applied Intelligence.

[23]  Liming Yang,et al.  Robust support vector machine with generalized quantile loss for classification and regression , 2019, Appl. Soft Comput..

[24]  Deepak Gupta,et al.  A fuzzy twin support vector machine based on information entropy for class imbalance learning , 2019, Neural Computing and Applications.

[25]  Zhenli Zhao,et al.  Empirics on linkages among industrialization, urbanization, energy consumption, CO2 emissions and economic growth: a heterogeneous panel study of China , 2018, Environmental Science and Pollution Research.

[26]  Furno Marilena,et al.  Quantile Regression , 2018, Wiley Series in Probability and Statistics.

[27]  Lidong Wang,et al.  Heterogeneous Data and Big Data Analytics , 2017 .

[28]  Luis M. Candanedo,et al.  Data driven prediction models of energy use of appliances in a low-energy house , 2017 .

[29]  Xuan Liang,et al.  Assessing Beijing's PM2.5 pollution: severity, weather impact, APEC and winter heating , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[30]  Qifa Xu,et al.  Weighted quantile regression via support vector machine , 2015, Expert Syst. Appl..

[31]  Ling Jing,et al.  An ε-twin support vector machine for regression , 2012, Neural computing & applications (Print).

[32]  Maxwell W. Libbrecht,et al.  Ubiquitous heterogeneity and asymmetry of the chromatin environment at regulatory elements , 2012, Genome research.

[33]  Xinjun Peng,et al.  TSVR: An efficient Twin Support Vector Machine for regression , 2010, Neural Networks.

[34]  P. Utgoff Incremental Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[35]  Chih-Jen Lin,et al.  A dual coordinate descent method for large-scale linear SVM , 2008, ICML '08.

[36]  Marcin Kolasa Structural Heterogeneity or Asymmetric Shocks? Poland and the Euro Area Through the Lens of a Two-Country DSGE Model , 2008 .

[37]  Ji Zhu,et al.  Quantile Regression in Reproducing Kernel Hilbert Spaces , 2007 .

[38]  R. Koenker,et al.  Regression Quantiles , 2007 .

[39]  Alexander J. Smola,et al.  Nonparametric Quantile Estimation , 2006, J. Mach. Learn. Res..

[40]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[41]  Ming Yuan,et al.  GACV for quantile smoothing splines , 2006, Comput. Stat. Data Anal..

[42]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[43]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[44]  B. Narasimhan,et al.  Bone mineral acquisition in healthy Asian, Hispanic, black, and Caucasian youth: a longitudinal study. , 1999, The Journal of clinical endocrinology and metabolism.

[45]  J. C. BurgesChristopher A Tutorial on Support Vector Machines for Pattern Recognition , 1998 .

[46]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[47]  W. Härdle Applied Nonparametric Regression , 1992 .

[48]  T. Cole Fitting Smoothed Centile Curves to Reference Data , 1988 .

[49]  H B Valman,et al.  Serum immunoglobulin concentrations in preschool children measured by laser nephelometry: reference ranges for IgG, IgA, IgM. , 1983, Journal of clinical pathology.

[50]  ScienceDirect Computational statistics & data analysis , 1983 .

[51]  R. Koenker,et al.  Robust Tests for Heteroscedasticity Based on Regression Quantiles , 1982 .

[52]  D. Rubinfeld,et al.  Hedonic housing prices and the demand for clean air , 1978 .

[53]  N. Wermuth,et al.  A Simulation Study of Alternatives to Ordinary Least Squares , 1977 .