Parameters Optimization of Support Vector Machine Based on the Optimal Foraging Theory

Support Vector Machine (SVM) is one of popular supervised machine learning algorithms, which can be used for both regression or classification challenges. The operation of SVM algorithm is based on finding the optimal hyperplane to discriminate between different classes. This hyperplane is known as kernel. In SVM, penalty parameter C and \(\sigma \) parameter of Radial Basis Function (RBF) can have a significant impact on the complexity and performance of SVM. Usually these parameters are randomly chosen. However, SVM is highly needed to determine the optimal parameters values to obtain expected learning performance. In this chapter, an optimization method based on optimal foraging theory is proposed to adjust the two main parameters of gaussian kernel function of SVM to increase the classification accuracy. Six well-known benchmark datasets taken from UCI machine learning data repository were employed for evaluating the proposed (OFA-SVM). In addition, the performance of the proposed optimal foraging algorithm for SVM’s parameters optimization (OFA-SVM) is compared with five other well-known and recently meta-heuristic optimization algorithms. These algorithms are Bat Algorithm (BA), Genetic Algorithm (GA), Artificial Bee Colony (ABC), Chicken Swarm Optimization (CSO) and Particle Swarm Optimization (PSO). The experimental results show that the proposed OFA-SVM can achieve better results compared with the other algorithms. Moreover, the results demonstrate the capability of the proposed OFA-SVM in finding the optimal parameters values of RBF of SVM.

[1]  Aboul Ella Hassanien,et al.  Blind Watermark Approach for Map Authentication Using Support Vector Machine , 2013 .

[2]  Guang-Yu Zhu,et al.  Optimal foraging algorithm for global optimization , 2017, Appl. Soft Comput..

[3]  Aboul Ella Hassanien,et al.  Parameter Optimization of Support Vector Machine Using Dragonfly Algorithm , 2017, AISI.

[4]  Aboul Ella Hassanien,et al.  Interphase cells removal from metaphase chromosome images based on meta-heuristic Grey Wolf Optimizer , 2015, 2015 11th International Computer Engineering Conference (ICENCO).

[5]  Hongnian Yu,et al.  Parameters optimization of classifier and feature selection based on improved artificial bee colony algorithm , 2016, 2016 International Conference on Advanced Mechatronic Systems (ICAMechS).

[6]  Mohamed H. Haggag,et al.  A novel chaotic salp swarm algorithm for global optimization and feature selection , 2018, Applied Intelligence.

[7]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[8]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[9]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[10]  Milan Tuba,et al.  Adjusted bat algorithm for tuning of support vector machine parameters , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[11]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  Ashraf Darwish,et al.  Quantum multiverse optimization algorithm for optimization problems , 2017, Neural Computing and Applications.

[14]  J. T. Erichsen,et al.  Optimal prey selection in the great tit (Parus major) , 1977, Animal Behaviour.

[15]  H. Levine.  Medical Imaging , 2010, Annals of Biomedical Engineering.

[16]  Zhiyong Luo,et al.  SVM parameters tuning with quantum particles swarm optimization , 2008, 2008 IEEE Conference on Cybernetics and Intelligent Systems.

[17]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[18]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[19]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Evolutionary tuning of SVM parameter values in multiclass problems , 2008, Neurocomputing.

[20]  Stéphane Mallat,et al.  Introduction to the special issue on wavelet transforms and multiresolution signal analysis , 1992, IEEE Transactions on Information Theory.

[21]  Gehad Ismail Sayed,et al.  An Automated Computer-aided Diagnosis System for Abdominal CT Liver Images , 2016, MIUA.

[22]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[23]  Shereen A. Taie,et al.  Title CSO-based algorithm with support vector machine for brain tumor's disease diagnosis , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[24]  Jianhua Wang,et al.  Optimizing parameters of support vector machines using team-search-based particle swarm optimization , 2015 .

[25]  Aboul Ella Hassanien,et al.  Bio-inspired Swarm Techniques for Thermogram Breast Cancer Detection , 2016 .

[26]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[27]  Graham H. Pyke,et al.  Optimal Foraging: A Selective Review of Theory and Tests , 1977, The Quarterly Review of Biology.