Comprehensive evaluation of twin SVM based classifiers on UCI datasets

Abstract In the past decade, twin support vector machine (TWSVM) based classifiers have received considerable attention from the research community. In this paper, we analyze the performance of 8 variants of TWSVM based classifiers along with 179 classifiers evaluated in Fernandez-Delgado et al. (2014) from 17 different families on 90 University of California Irvine (UCI) benchmark datasets from various domains. Results of these classifiers are exhaustively analyzed using various performance criteria. Statistical testing is performed using Friedman Rank (FRank). Our experiments show that two least square TWSVM based classifiers (ILSTSVM_m, and RELS-TSVM_m) are the top two ranked methods among 187 classifiers and they significantly outperform all other classifiers according to Friedman Rank. Overall, this paper bridges the evaluational benchmarking gap between various TWSVM variants and the classifiers from other families. Codes of this paper are provided on authors’ homepages to reproduce the presented results and figures in this paper.

[1]  Yongquan Zhou,et al.  Twin support vector machines: A survey , 2018, Neurocomputing.

[2]  Muhammad Tanveer,et al.  Robust energy-based least squares twin support vector machines , 2015, Applied Intelligence.

[3]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[4]  Reshma Rastogi,et al.  Fast Laplacian twin support vector machine with active learning for pattern classification , 2019, Appl. Soft Comput..

[5]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[6]  Yuan-Hai Shao,et al.  An efficient weighted Lagrangian twin support vector machine for imbalanced data classification , 2014, Pattern Recognit..

[7]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Olvi L. Mangasarian,et al.  Exact 1-Norm Support Vector Machines Via Unconstrained Convex Differentiable Minimization , 2006, J. Mach. Learn. Res..

[9]  Xinjun Peng,et al.  TPMSVM: A novel twin parametric-margin support vector machine for pattern recognition , 2011, Pattern Recognit..

[10]  Yuan-Hai Shao,et al.  Improvements on Twin Support Vector Machines , 2011, IEEE Transactions on Neural Networks.

[11]  Zhiquan Qi,et al.  Review on: Twin Support Vector Machines , 2014, Annals of Data Science.

[12]  Muhammad Tanveer.  Application of smoothing techniques for linear programming twin support vector machines , 2014, Knowledge and Information Systems.

[13]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  R. Iman,et al.  Approximations of the critical region of the fbietkan statistic , 1980 .

[16]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[18]  Muhammad Tanveer,et al.  Sparse pinball twin support vector machines , 2019, Appl. Soft Comput..

[19]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[20]  Geoff Holmes,et al.  Experiment databases , 2012, Machine Learning.

[21]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[22]  Ali Amiri,et al.  Modified twin support vector regression , 2016, Neurocomputing.

[23]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[24]  Muhammad Tanveer,et al.  EEG signal classification using universum support vector machine , 2018, Expert Syst. Appl..

[25]  Yuan-Hai Shao,et al.  A GA-based model selection for smooth twin parametric-margin support vector machine , 2013, Pattern Recognit..

[26]  P. N. Suganthan,et al.  Benchmarking Ensemble Classifiers with Novel Co-Trained Kernal Ridge Regression and Random Vector Functional Link Ensembles [Research Frontier] , 2017, IEEE Computational Intelligence Magazine.

[27]  Izhar Ahmad,et al.  One norm linear programming support vector regression , 2016, Neurocomputing.

[28]  Muhammad Tanveer,et al.  Newton method for implicit Lagrangian twin support vector machines , 2015, Int. J. Mach. Learn. Cybern..

[29]  Xianli Pan,et al.  A Novel Twin Support-Vector Machine With Pinball Loss , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Muhammad Tanveer.  Robust and Sparse Linear Programming Twin Support Vector Machines , 2014, Cognitive Computation.