Incremental continuous ant colony optimization for tuning support vector machine’s parameters

Support Vector Machines are considered to be excellent patterns classification techniques. The process of classifying a pattern with high classification accuracy counts mainly on tuning Support Vector Machine parameters which are the generalization error parameter and the kernel function parameter.Tuning these parameters is a complex process and Ant Colony Optimization can be used to overcome the difficulty. Ant Colony Optimization originally deals with discrete optimization problems. Hence, in applying Ant Colony Optimization for optimizing Support Vector Machine parameters, which are continuous in nature, the values wil have to be discretized.The discretization process will result in loss of some information and, hence, affects the classification accuracy and seeks time.This paper presents an algorithm to optimize Support Vector Machine parameters using Incremental continuous Ant Colony Optimization without the need to discretize continuous values.Eight datasets from UCI were used to evaluate the performance of the proposed algorithm.The proposed algorithm demonstrates the credibility in terms of classification accuracy when compared to grid search techniques, GA with feature chromosome-SVM, PSO-SVM, and GA-SVM.Experimental results of the proposed algorithm also show promising performance in terms of classification accuracy and size of features subset.

[1]  Xiaoli Zhang,et al.  A grid-based ACO algorithm for parameters optimization in support vector machines , 2008, 2008 IEEE International Conference on Granular Computing.

[2]  Bo Gu,et al.  Support vector machine with parameter optimization by bare bones differential evolution , 2011, 2011 Seventh International Conference on Natural Computation.

[3]  T. Barbu,et al.  SVM-based Human Cell Detection Technique using Histograms of Oriented Gradients , 2012 .

[4]  HAMADA R. H. AL-ABSI,et al.  A Comparison of wavelet and curvelet for lung cancer diagnosis with a new Cluster K-Nearest Neighbor classifier , 2012 .

[5]  Wei Li,et al.  Three-class classification models of logS and logP derived by using GA–CG–SVM approach , 2009, Molecular Diversity.

[6]  Cheng-Lung Huang,et al.  ACO-based hybrid classification system with feature subset selection and model parameters optimization , 2009, Neurocomputing.

[7]  Mingtian Zhou,et al.  Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes , 2011, Expert Syst. Appl..

[8]  Ku Ruhana Ku-Mahamud,et al.  Optimizing Support Vector Machine parameters using continuous Ant Colony Optimization , 2012, 2012 7th International Conference on Computing and Convergence Technology (ICCCT).

[9]  Ku Ruhana Ku-Mahamud,et al.  Incremental continuous ant colony optimization technique forsupport vector machine model selection problem , 2012 .

[10]  Ku Ruhana Ku-Mahamud,et al.  New heuristic function in ant colony system for job scheduling in grid computing , 2012 .

[11]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[12]  Tao Bai,et al.  Share Price Prediction Using Wavelet Transform and Ant Colony Algorithm for Parameters Optimization in SVM , 2009, 2009 WRI Global Congress on Intelligent Systems.

[13]  Ioannis B. Theocharis,et al.  SVM-FuzCoC: A novel SVM-based feature selection method using a fuzzy complementary criterion , 2010, Pattern Recognit..

[14]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[15]  Xiaoli Zhang,et al.  An ACO-based algorithm for parameter optimization of support vector machines , 2010, Expert Syst. Appl..

[16]  Kourosh Mozafari,et al.  Hepatitis disease diagnosis using a novel hybrid method based on support vector machine and simulated annealing (SVM-SA) , 2012, Comput. Methods Programs Biomed..

[17]  Ching Y. Suen,et al.  Automatic model selection for the optimization of SVM kernels , 2005, Pattern Recognit..

[18]  Robert Sabourin,et al.  A dynamic model selection strategy for support vector machine classifiers , 2012, Appl. Soft Comput..

[19]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[20]  R. Ali Abbaspour,et al.  Evaluation of Genetic Algorithms for tuning SVM parameters in multi-class problems , 2010, 2010 11th International Symposium on Computational Intelligence and Informatics (CINTI).

[21]  T. Liao Improved ant colony optimization algorithms for continuous and mixed discrete-continuous optimization problems , 2011 .

[22]  Vladimir Vapnik,et al.  A new learning paradigm: Learning using privileged information , 2009, Neural Networks.

[23]  Cheng-Lung Huang,et al.  A distributed PSO-SVM hybrid system with feature selection and parameter optimization , 2008, Appl. Soft Comput..

[24]  Dexian Zhang,et al.  Feature Subset Selection Based on Improved Discrete Particle Swarm and Support Vector Machine Algorithm , 2009, 2009 International Conference on Information Engineering and Computer Science.

[25]  Witold Pedrycz,et al.  Mining axiomatic fuzzy set association rules for classification problems , 2012, Eur. J. Oper. Res..

[26]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..