Wavelet transform-based weighted $$\nu$$ν-twin support vector regression

In this paper, an efficient wavelet transform-based weighted $$\nu$$ν-twin support vector regression (WTWTSVR) is proposed, inspired by twin support vector regression (TSVR) and $$\nu$$ν-twin support vector machine-based regression. TSVR and its improved models work faster than support vector regression because they solve a pair of smaller-sized quadratic programming problems. However, they give the same emphasis to the training samples, i.e., all of the training samples share the same weights, and prior information is not used, which leads to the degradation of performance. Motivated by this, samples in different positions in the proposed WTWTSVR model are given different penalty weights determined by the wavelet transform. The weights are applied to both the quadratic empirical risk term and the first-degree empirical risk term to reduce the influence of outliers. The final regressor can avoid the overfitting problem to a certain extent and yield great generalization ability. Numerical experiments on artificial datasets and benchmark datasets demonstrate the feasibility and validity of our proposed algorithm.

[1]  Shahaboddin Shamshirband,et al.  Coupling a firefly algorithm with support vector regression to predict evaporation in northern Iran , 2018 .

[2]  Johan A. K. Suykens,et al.  Asymmetric v-tube support vector regression , 2014, Comput. Stat. Data Anal..

[3]  Deepak Gupta Training primal K-nearest neighbor based weighted twin support vector regression via unconstrained convex minimization , 2017, Applied Intelligence.

[4]  Chuntian Cheng,et al.  Multiple criteria rainfall–runoff model calibration using a parallel genetic algorithm in a cluster of computers / Calage multi-critères en modélisation pluie–débit par un algorithme génétique parallèle mis en œuvre par une grappe d'ordinateurs , 2005 .

[5]  Ichiro Takeuchi,et al.  Multi-directional search from the primitive initial point for Gaussian mixture estimation using variational Bayes method , 2010, Neural Networks.

[6]  Xinjun Peng,et al.  TSVR: An efficient Twin Support Vector Machine for regression , 2010, Neural Networks.

[7]  Wang Zhen,et al.  Weighted Lagrange .EPSILON.-twin support vector regression , 2016 .

[8]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[9]  Johan A. K. Suykens,et al.  Support Vector Machine Classifier With Pinball Loss , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Vojislav Kecman,et al.  Multi-target support vector regression via correlation regressor chains , 2017, Inf. Sci..

[11]  C. L. Wu,et al.  Rainfall–runoff modeling using artificial neural network coupled with singular spectrum analysis , 2011 .

[12]  Yitian Xu,et al.  K-nearest neighbor-based weighted twin support vector regression , 2014, Applied Intelligence.

[13]  K. Chau,et al.  Novel genetic-based negative correlation learning for estimating soil temperature , 2018 .

[14]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[15]  Johan A. K. Suykens,et al.  Least squares support vector machine classifiers: a large scale algorithm , 1999 .

[16]  S. Sathiya Keerthi,et al.  Improvements to the SMO algorithm for SVM regression , 2000, IEEE Trans. Neural Networks Learn. Syst..

[17]  Yuqun Zhang,et al.  A maximum margin and minimum volume hyper-spheres machine with pinball loss for imbalanced data classification , 2016, Knowl. Based Syst..

[18]  Bellie Sivakumar,et al.  Neural network river forecasting through baseflow separation and binary-coded swarm optimization , 2015 .

[19]  Li Ran,et al.  An Improved Data Fusion Method IICKPAD for Privacy Protection in Wireless Sensor Networks , 2017 .

[20]  Lan Bai,et al.  Weighted Lagrange ε-twin support vector regression , 2016, Neurocomputing.

[21]  Xianli Pan,et al.  A Novel Twin Support-Vector Machine With Pinball Loss , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Shahaboddin Shamshirband,et al.  Earthquake prediction with meteorological data by particle filter-based support vector regression , 2018 .

[23]  Yuh-Jye Lee,et al.  epsilon-SSVR: A Smooth Support Vector Machine for epsilon-Insensitive Regression , 2005, IEEE Trans. Knowl. Data Eng..

[24]  Yuan-Hai Shao,et al.  An ε-twin support vector machine for regression , 2012, Neural Computing and Applications.

[25]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[26]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Suresh Chandra,et al.  A ν-twin support vector machine based regression with automatic accuracy control , 2017, Applied Intelligence.