Optimizing support vector machine parameters using cuckoo search algorithm via cross validation

Support vector machine is one of the most popular techniques for solving classification problems. It is known that the choice of parameters directly affects its performance. This problem can be solved using a search algorithm which is suitable optimization technique for the parameter optimization. In this research, we propose a method to determine the optimal parameters for support vector machines using the cuckoo search algorithm via maximization of the average accuracy from k-fold cross validation. Our experimental results show that the cuckoo search algorithm provides very good convergence rate and outcomes. The comparison between its performance and another population based optimization namely the particle swarm optimization is also performed. It shows that the cuckoo search algorithm yields better convergence rate and outcomes than the particle swarm optimization in most datasets. It implies that the mechanism of cuckoo search algorithm is efficient for this parameter optimization problem and is more effective than the particle swarm optimization in this particular problem.

[1]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[2]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[3]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[4]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[5]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[6]  Ning Lu,et al.  Particle Swarm Optimization for Parameter Optimization of Support Vector Machine Model , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[7]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[8]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010 .

[9]  Xiangtao Li,et al.  A particle swarm inspired cuckoo search algorithm for real parameter optimization , 2015, Soft Computing.

[10]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[11]  Raymond Chiong,et al.  Why Is Optimization Difficult? , 2009, Nature-Inspired Algorithms for Optimisation.