A BA-based algorithm for parameter optimization of Support Vector Machine

Abstract Support Vector Machine (SVM) parameters such as kernel parameter and penalty parameter (C) have a great impact on the complexity and accuracy of predicting model. In this paper, Bat algorithm (BA) has been proposed to optimize the parameters of SVM, so that the classification error can be reduced. To evaluate the proposed model (BA-SVM), the experiment adopted nine standard datasets which are obtained from UCI machine learning data repository. For verification, the results of the BA-SVM algorithm are compared with grid search, which is a conventional method of searching parameter values, and two well-known optimization algorithms: Genetic Algorithm (GA) and Particle Swarm Optimization (PSO). The experimental results proved that the proposed model is capable to find the optimal values of the SVM parameters and avoids the local optima problem. The results also demonstrated lower classification error rates compared with PSO and GA algorithms.

[1]  Xiaoli Zhang,et al.  An ACO-based algorithm for parameter optimization of support vector machines , 2010, Expert Syst. Appl..

[2]  Gisbert Schneider,et al.  Support vector machine applications in bioinformatics. , 2003, Applied bioinformatics.

[3]  Abdulhamit Subasi,et al.  Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders , 2013, Comput. Biol. Medicine.

[4]  Chih-Hung Wu,et al.  A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression , 2009, Expert Syst. Appl..

[5]  Jean-Pierre Doucet,et al.  Nonlinear SVM Approaches to QSPR/QSAR Studies and Drug Design , 2007 .

[6]  Aboul Ella Hassanien,et al.  Automated zebrafish-based toxicity test using Bat optimization and AdaBoost classifier , 2015, 2015 11th International Computer Engineering Conference (ICENCO).

[7]  Vojislav Kecman,et al.  Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models , 2001 .

[8]  Richa Singh,et al.  Improving biometric recognition accuracy and robustness using DWT and SVM watermarking , 2005, IEICE Electron. Express.

[9]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[10]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[11]  Gaige Wang,et al.  A Novel Hybrid Bat Algorithm with Harmony Search for Global Numerical Optimization , 2013, J. Appl. Math..

[12]  Xin-She Yang,et al.  BBA: A Binary Bat Algorithm for Feature Selection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[13]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[14]  Kate Smith-Miles,et al.  Automatic parameter selection for polynomial kernel , 2003, Proceedings Fifth IEEE Workshop on Mobile Computing Systems and Applications.

[15]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[16]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[17]  Gunnar Rätsch,et al.  Support Vector Machines and Kernels for Computational Biology , 2008, PLoS Comput. Biol..

[18]  Harris Drucker,et al.  Support vector machines for spam categorization , 1999, IEEE Trans. Neural Networks.

[19]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[20]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[21]  Mingtian Zhou,et al.  Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes , 2011, Expert Syst. Appl..

[22]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.