Investigation on the Effects of ACO Parameters for Feature Selection and Classification

Ant Colony Optimization (ACO) is the most familiar meta-heuristic search algorithm and has been used in optimization of a number of feature selection (FS) problems. As a meta-heuristic search algorithm, ACO requires a set of parameters to solve the problem of feature selection. Pheromone Evaporation Rate (PER) is the most important among all these parameters. Setting up the values of these parameters is a big deal. Usually, these parameters are set up by experimenting through a number of values and finally selecting a set of values that seems to work well for feature selection. The change in optimal feature selection in accordance to different values of PER and other ACO parameters is discussed in this paper. ACO is applied for feature selection and classification of 10 datasets. From the experimental results, it can be seen that, the optimal value for the evaporation rate (ρ) lies around 0.7 leading to selection of best features and increase in classification accuracy.

[1]  Marcus Randall,et al.  Feature Selection for Classification Using an Ant Colony System , 2010, 2010 Sixth IEEE International Conference on e-Science Workshops.

[2]  Mohammad Teshnehlab,et al.  Correlation-based Feature Selection using Ant Colony Optimization , 2010 .

[3]  Dezhao Chen,et al.  Ensemble classifier system based on ant colony algorithm and its application in chemical pattern classification , 2006 .

[4]  Thomas Stützle,et al.  Parameter Adaptation in Ant Colony Optimization , 2012, Autonomous Search.

[5]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[6]  David C. Matthews.  Improved Lower Limits for Pheromone Trails in Ant Colony Optimization , 2008, PPSN.

[7]  Anne M. P. Canuto,et al.  A comparative analysis of genetic algorithm and ant colony optimization to select attributes for an heterogeneous ensemble of classifiers , 2010, IEEE Congress on Evolutionary Computation.

[8]  Boudewijn P. F. Lelieveldt,et al.  Fuzzy feature selection , 1999, Pattern Recognit..

[9]  Ahmed Al-Ani.  Ant Colony Optimization for Feature Subset Selection , 2005, WEC.

[10]  Nasser Ghasem-Aghaee,et al.  Text feature selection using ant colony optimization , 2009, Expert Syst. Appl..

[11]  Felix Dobslaw,et al.  A parameter-tuning framework for metaheuristics based on design of experiments and artificial neural networks , 2010 .

[12]  Daniel Kudenko,et al.  Screening the parameters affecting heuristic performance , 2007, GECCO '07.

[13]  Xin Yao,et al.  Ensemble Learning Using Multi-Objective Evolutionary Algorithms , 2006, J. Math. Model. Algorithms.

[14]  Ahmed Al-Ani,et al.  Feature Subset Selection Using Ant Colony Optimization , 2008 .

[15]  Simon M. Lucas,et al.  Parallel Problem Solving from Nature - PPSN X, 10th International Conference Dortmund, Germany, September 13-17, 2008, Proceedings , 2008, PPSN.

[16]  Karim Faez,et al.  An improved feature selection method based on ant colony optimization (ACO) evaluated on face recognition system , 2008, Appl. Math. Comput..

[17]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[18]  J. K. Bertrand,et al.  The ant colony algorithm for feature selection in high-dimension gene expression data for disease classification. , 2007, Mathematical medicine and biology : a journal of the IMA.

[19]  Marcus Randall.  Near Parameter Free Ant Colony Optimisation , 2004, ANTS Workshop.

[20]  Thomas Stützle,et al.  Ant Colony Optimization and Swarm Intelligence , 2008 .

[21]  Sreeram Ramakrishnan,et al.  A hybrid approach for feature subset selection using neural networks and ant colony optimization , 2007, Expert Syst. Appl..

[22]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[23]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[24]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..