A hybrid algorithm using ant and bee colony optimization for feature selection and classification (AC-ABC Hybrid)

Abstract Ant Colony Optimization (ACO) and Bee Colony Optimization (BCO) are famous meta-heuristic search algorithms used in solving numerous combinatorial optimization problems. Feature Selection (FS) helps to speed up the process of classification by extracting the relevant and useful information from the dataset. FS is seen as an optimization problem because selecting the appropriate feature subset is very important. This paper proposes a novel Swarm based hybrid algorithm AC-ABC Hybrid, which combines the characteristics of Ant Colony and Artificial Bee Colony (ABC) algorithms to optimize feature selection. By hybridizing, we try to eliminate stagnation behavior of the ants and time consuming global search for initial solutions by the employed bees. In the proposed algorithm, Ants use exploitation by the Bees to determine the best Ant and best feature subset; Bees adapt the feature subsets generated by the Ants as their food sources. Thirteen UCI (University of California, Irvine) benchmark datasets have been used for the evaluation of the proposed algorithm. Experimental results show the promising behavior of the proposed method in increasing the classification accuracies and optimal selection of features.

[1]  Li-Yeh Chuang,et al.  Catfish Binary Particle Swarm Optimization for Feature Selection , 2011 .

[2]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[3]  Jianchao Zeng,et al.  Comparison and Analysis of the Selection Mechanism in the Artificial Bee Colony Algorithm , 2009, 2009 Ninth International Conference on Hybrid Intelligent Systems.

[4]  J. Jona,et al.  Ant-cuckoo colony optimization for feature selection in digital mammogram. , 2014, Pakistan journal of biological sciences : PJBS.

[5]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[6]  Manish Kumar,et al.  An ant colony optimization technique for solving min-max Multi-Depot Vehicle Routing Problem , 2013, Swarm Evol. Comput..

[7]  K. Thanushkodi,et al.  A Novel Rough Set Reduct Algorithm for Medical Domain Based on Bee Colony Optimization , 2010, ArXiv.

[8]  Reza Akbari,et al.  A multi-objective artificial bee colony algorithm , 2012, Swarm Evol. Comput..

[9]  T. G. I. Fernando,et al.  Performance analysis of the multi-objective ant colony optimization algorithms for the traveling salesman problem , 2015, Swarm Evol. Comput..

[10]  Mohammad Ehsan Basiri,et al.  A novel hybrid ACO-GA algorithm for text feature selection , 2009, 2009 IEEE Congress on Evolutionary Computation.

[11]  S. Kanmani,et al.  Investigation on the Effects of ACO Parameters for Feature Selection and Classification , 2012 .

[12]  Boudewijn P. F. Lelieveldt,et al.  Fuzzy feature selection , 1999, Pattern Recognit..

[13]  Mohammed El-Abd A cooperative approach to The Artificial Bee Colony algorithm , 2010, IEEE Congress on Evolutionary Computation.

[14]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[15]  Swagatam Das,et al.  Simultaneous feature selection and weighting - An evolutionary multi-objective optimization approach , 2015, Pattern Recognit. Lett..

[16]  Yunlong Zhu,et al.  Cooperative approaches to Artificial Bee Colony algorithm , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[17]  Anne M. P. Canuto,et al.  A comparative analysis of genetic algorithm and ant colony optimization to select attributes for an heterogeneous ensemble of classifiers , 2010, IEEE Congress on Evolutionary Computation.

[18]  V. Sugumaran,et al.  Minimum sample size determination of vibration signals in machine learning approach to fault diagnosis using power analysis , 2010, Expert Syst. Appl..

[19]  Marcus Randall,et al.  Feature Selection for Classification Using an Ant Colony System , 2010, 2010 Sixth IEEE International Conference on e-Science Workshops.

[20]  Li-Yeh Chuang,et al.  Feature Selection using PSO-SVM , 2007, IMECS.

[21]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[22]  Zili Zhang,et al.  An Ensemble of Classifiers with Genetic Algorithm Based Feature Selection , 2008, IEEE Intell. Informatics Bull..

[23]  K. Thanushkodi,et al.  A weighted bee colony optimisation hybrid with rough set reduct algorithm for feature selection in the medical domain , 2011, Int. J. Granul. Comput. Rough Sets Intell. Syst..

[24]  Li-Pei Wong,et al.  Bee Colony Optimization algorithm with Big Valley landscape exploitation for Job Shop Scheduling problems , 2008, 2008 Winter Simulation Conference.

[25]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[26]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[27]  Dervis Karaboga,et al.  A survey: algorithms simulating bee swarm intelligence , 2009, Artificial Intelligence Review.

[28]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[29]  Magdalene Marinaki,et al.  Honey Bees Mating Optimization algorithm for financial classification problems , 2010, Appl. Soft Comput..

[30]  Rami N. Khushaba,et al.  Feature subset selection using differential evolution and a wheel based search strategy , 2013, Swarm Evol. Comput..

[31]  Nasser Ghasem-Aghaee,et al.  Text feature selection using ant colony optimization , 2009, Expert Syst. Appl..

[32]  Karim Faez,et al.  An improved feature selection method based on ant colony optimization (ACO) evaluated on face recognition system , 2008, Appl. Math. Comput..

[33]  Adel Al-Jumaily,et al.  Feature subset selection using differential evolution and a statistical repair mechanism , 2011, Expert Syst. Appl..

[34]  Sreeram Ramakrishnan,et al.  A hybrid approach for feature subset selection using neural networks and ant colony optimization , 2007, Expert Syst. Appl..

[35]  J. K. Bertrand,et al.  The ant colony algorithm for feature selection in high-dimension gene expression data for disease classification. , 2007, Mathematical medicine and biology : a journal of the IMA.

[36]  Labiba Souici-Meslati,et al.  Hybrid ACO-PSO Based Approaches for Feature Selection , 2016 .

[37]  Nasser Ghasem-Aghaee,et al.  A novel ACO-GA hybrid algorithm for feature selection in protein function prediction , 2009, Expert Syst. Appl..

[38]  Kazuyuki Murase,et al.  A new hybrid ant colony optimization algorithm for feature selection , 2012, Expert Syst. Appl..