A novel parametric-insensitive nonparallel support vector machine for regression

In this paper, a novel parametric-insensitive nonparallel support vector regression (PINSVR) algorithm for data regression is proposed. PINSVR indirectly finds a pair of nonparallel proximal functions with a pair of different parametric-insensitive nonparallel proximal functions by solving two smaller sized quadratic programming problems (QPPs). By using new parametric-insensitive loss functions, the proposed PINSVR automatically adjusts a flexible parametric-insensitive zone of arbitrary shape and minimal size to include the given data to capture data structure and boundary information more accurately. The experiment results compared with the e-SVR, e-TSVR, and TPISVR indicate that our PINSVR not only obtains comparable regression performance, but also obtains better bound estimations.

[1]  Jian-Huang Lai,et al.  Face hallucination with imprecise-alignment using iterative sparse representation , 2014, Pattern Recognit..

[2]  Shun-Feng Su,et al.  Support vector interval regression networks for interval regression analysis , 2003, Fuzzy Sets Syst..

[3]  Dug Hun Hong,et al.  Support vector interval regression machine for crisp input and output data , 2006, Fuzzy Sets Syst..

[4]  Guo-Can Feng,et al.  Weighted group sparse representation for undersampled face recognition , 2014, Neurocomputing.

[5]  David M. Allen,et al.  The Relationship Between Variable Selection and Data Agumentation and a Method for Prediction , 1974 .

[6]  Wei‐Chiang Hong,et al.  Application of SVR with improved ant colony optimization algorithms in exchange rate forecasting , 2009 .

[7]  Yuan-Hai Shao,et al.  An ε-twin support vector machine for regression , 2012, Neural Computing and Applications.

[8]  Mingtian Zhou,et al.  Training sparse SVM on the core sets of fitting-planes , 2014, Neurocomputing.

[9]  Pei-Yi Hao,et al.  Interval regression analysis using support vector networks , 2009, Fuzzy Sets Syst..

[10]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[12]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[13]  Yuan-Hai Shao,et al.  Improvements on Twin Support Vector Machines , 2011, IEEE Transactions on Neural Networks.

[14]  Dong Xu,et al.  A twin projection support vector machine for data regression , 2014, Neurocomputing.

[15]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[16]  Zohreh Azimifar,et al.  Structured sparse representation for human action recognition , 2015, Neurocomputing.

[17]  Nikolas P. Galatsanos,et al.  A support vector machine approach for detection of microcalcifications , 2002, IEEE Transactions on Medical Imaging.

[18]  Xiaowei Yang,et al.  A heuristic weight-setting strategy and iteratively updating algorithm for weighted least-squares support vector regression , 2008, Neurocomputing.

[19]  Pei-Yi Hao,et al.  New support vector algorithms with parametric insensitive/margin model , 2010, Neural Networks.

[20]  Xinjun Peng,et al.  TSVR: An efficient Twin Support Vector Machine for regression , 2010, Neural Networks.

[21]  Xinjun Peng,et al.  Efficient twin parametric insensitive support vector regression model , 2012, Neurocomputing.

[22]  Jun Ma,et al.  A sparsity-based training algorithm for Least Squares SVM , 2014, 2014 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).

[23]  Reshma Khemchandani,et al.  Regularized least squares fuzzy support vector regression for financial time series forecasting , 2009, Expert Syst. Appl..

[24]  Yuan-Hai Shao,et al.  Combined outputs framework for twin support vector machines , 2015, Applied Intelligence.

[25]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[26]  N. Deng,et al.  Improved prediction of palmitoylation sites using PWMs and SVM. , 2011, Protein and peptide letters.

[27]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[28]  Hadi Fanaee-T,et al.  Event labeling combining ensemble detectors and background knowledge , 2014, Progress in Artificial Intelligence.

[29]  Su-Yun Huang,et al.  Reduced Support Vector Machines: A Statistical Theory , 2007, IEEE Transactions on Neural Networks.

[30]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[31]  Bingru Yang,et al.  Predicting protein secondary structure using a mixed-modal SVM method in a compound pyramid model , 2011, Knowl. Based Syst..

[32]  Yuan-Hai Shao,et al.  Weighted linear loss twin support vector machine for large-scale classification , 2015, Knowl. Based Syst..

[33]  Jinbo Bi,et al.  A geometric approach to support vector regression , 2003, Neurocomputing.

[34]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[35]  Licheng Jiao,et al.  Fast Sparse Approximation for Least Squares Support Vector Machine , 2007, IEEE Transactions on Neural Networks.

[36]  R. Dennis Cook,et al.  Cross-Validation of Regression Models , 1984 .

[37]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[38]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[39]  Yuan-Hai Shao,et al.  Nonparallel hyperplane support vector machine for binary classification problems , 2014, Inf. Sci..

[40]  Yifei Wang,et al.  The robust and efficient adaptive normal direction support vector regression , 2011, Expert Syst. Appl..