A social-spider optimization approach for support vector machines parameters tuning

The choice of hyper-parameters in Support Vector Machines (SVM)-based learning is a crucial task, since different values may degrade its performance, as well as can increase the computational burden. In this paper, we introduce a recently developed nature-inspired optimization algorithm to find out suitable values for SVM kernel mapping named Social-Spider Optimization (SSO). We compare the results obtained by SSO against with a Grid-Search, Particle Swarm Optimization and Harmonic Search. Statistical evaluation has showed SSO can outperform the compared techniques for some sort of kernels and datasets.

[1]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[2]  Ahmed Al-Ani,et al.  Feature Subset Selection Using Ant Colony Optimization , 2008 .

[3]  Erik Valdemar Cuevas Jiménez,et al.  A swarm optimization algorithm inspired in the behavior of the social-spider , 2013, Expert Syst. Appl..

[4]  Karim Faez,et al.  Feature Selection Using Ant Colony Optimization (ACO): A New Method and Comparative Study in the Application of Face Recognition System , 2007, ICDM.

[5]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[6]  Ying Li,et al.  An Improved Particle Swarm Optimization for SVM Training , 2007, Third International Conference on Natural Computation (ICNC 2007).

[7]  João Paulo Papa,et al.  Harmony search applied for support vector machines training optimization , 2013, Eurocon 2013.

[8]  James W. Hardin,et al.  Exact Wilcoxon Signed-Rank and Wilcoxon Mann–Whitney Ranksum Tests , 2013 .

[9]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[10]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[11]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[12]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[13]  João Paulo Papa,et al.  Supervised pattern classification based on optimum‐path forest , 2009, Int. J. Imaging Syst. Technol..

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  Jianhua Wu,et al.  Novel global harmony search algorithm for unconstrained problems , 2010, Neurocomputing.

[16]  João Paulo Papa,et al.  Efficient supervised optimum-path forest classification for large datasets , 2012, Pattern Recognit..

[17]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .