A hybrid approach of differential evolution and artificial bee colony for feature selection

We developed a hybrid method for feature selection of classification tasks.Our hybrid method combines Artificial Bee Colony with Differential Evolution.We performed experiments over fifteen datasets from the UCI Repository.Our method selects good features without reducing accuracy of classification.By selecting features with our method, we reduced time required for classification. "Dimensionality" is one of the major problems which affect the quality of learning process in most of the machine learning and data mining tasks. Having high dimensional datasets for training a classification model may lead to have "overfitting" of the learned model to the training data. Overfitting reduces generalization of the model, therefore causes poor classification accuracy for the new test instances. Another disadvantage of dimensionality of dataset is to have high CPU time requirement for learning and testing the model. Applying feature selection to the dataset before the learning process is essential to improve the performance of the classification task. In this study, a new hybrid method which combines artificial bee colony optimization technique with differential evolution algorithm is proposed for feature selection of classification tasks. The developed hybrid method is evaluated by using fifteen datasets from the UCI Repository which are commonly used in classification problems. To make a complete evaluation, the proposed hybrid feature selection method is compared with the artificial bee colony optimization, and differential evolution based feature selection methods, as well as with the three most popular feature selection techniques that are information gain, chi-square, and correlation feature selection. In addition to these, the performance of the proposed method is also compared with the studies in the literature which uses the same datasets. The experimental results of this study show that our developed hybrid method is able to select good features for classification tasks to improve run-time performance and accuracy of the classifier. The proposed hybrid method may also be applied to other search and optimization problems as its performance for feature selection is better than pure artificial bee colony optimization, and differential evolution.

[1]  Parham Moradi,et al.  Relevance-redundancy feature selection based on ant colony optimization , 2015, Pattern Recognit..

[2]  Dalila Boughaci,et al.  Hybrid Harmony Search Combined with Stochastic Local Search for Feature Selection , 2015, Neural Processing Letters.

[3]  Ali Wagdy Mohamed,et al.  An alternative differential evolution algorithm for global optimization , 2012 .

[4]  M. Akila,et al.  Hybrid Local Feature Selection In DNA Analysis Based Cancer Classification , 2012 .

[5]  Wenqian Shang,et al.  A novel feature selection algorithm for text categorization , 2007, Expert Syst. Appl..

[6]  J. Jona,et al.  Ant-cuckoo colony optimization for feature selection in digital mammogram. , 2014, Pakistan journal of biological sciences : PJBS.

[7]  Mohammad Reza Meybodi,et al.  A novel hybrid Artificial Bee Colony algorithm and Differential Evolution for unconstrained optimization problems , 2011 .

[8]  Zulaiha Ali Othman,et al.  Hybrid Feature Selection Algorithm for Intrusion Detection System , 2014, J. Comput. Sci..

[9]  Goran Martinovic,et al.  A differential evolution approach to dimensionality reduction for classification needs , 2014, Int. J. Appl. Math. Comput. Sci..

[10]  Shunmugapriya Palanisamy.  Artificial Bee Colony Approach for Optimizing Feature Selection , 2012 .

[11]  S. BabatundeR..  Feature Dimensionality Reduction using a Dual Level Metaheuristic Algorithm , 2014 .

[12]  Yan Dong,et al.  Feature Selection with Discrete Binary Differential Evolution , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[13]  Mohammed Azmi Al-Betar,et al.  Artificial bee colony algorithm, its variants and applications: A survey. , 2013 .

[14]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Sanghamitra Bandyopadhyay,et al.  Unsupervised feature selection using an improved version of Differential Evolution , 2015, Expert Syst. Appl..

[16]  Mohd Saberi Mohamad,et al.  A NEW HYBRID BEE EVOLUTION ALGORITHM FOR PARAMETER ESTIMATION IN BIOLOGICAL MODEL , 2013 .

[17]  Fagbola Temitayo,et al.  Hybrid MetaHeuristic Feature Extraction Technique for Solving Timetabling Problem , 2012 .

[18]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[19]  Nihat Yilmaz,et al.  Feature Selection Method Based on Artificial Bee Colony Algorithm and Support Vector Machines for Medical Datasets Classification , 2013, TheScientificWorldJournal.

[20]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[21]  J. Jona.  A Hybrid Swarm Optimization approach for Feature set reduction in Digital Mammograms , 2012 .

[22]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[23]  Mohammad Ehsan Basiri,et al.  A novel hybrid ACO-GA algorithm for text feature selection , 2009, 2009 IEEE Congress on Evolutionary Computation.

[24]  Michael K. Danquah,et al.  The quintessential research world is progressively interdisciplinary , 2012 .

[25]  Bernhard Schölkopf,et al.  Feature selection for support vector machines by means of genetic algorithm , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[26]  James Montgomery,et al.  An analysis of the operation of differential evolution at high and low crossover rates , 2010, IEEE Congress on Evolutionary Computation.

[27]  V. Murali Bhaskaran,et al.  Modified Artificial Bee Colony Based Feature Selection : A New Method in the Application of Mammogram Image Classification , 2014 .

[28]  S Kanmani,et al.  Artificial Bee Colony Approach for Approach for Approach for Approach for Optimizing Feature Selection , 2012 .

[29]  ZHEN WANG,et al.  A HYBRID ARTIFICIAL BEE COLONY ALGORITHM FOR PORTFOLIO OPTIMIZATION PROBLEM , 2013 .

[30]  Ajith Abraham,et al.  Hybrid differential artificial bee colony algorithm , 2012 .

[31]  Rosni Abdullah,et al.  Adapted Bio-inspired Artificial Bee Colony and Differential Evolution for Feature Selection in Biomarker Discovery Analysis , 2014, SCDM.

[32]  Tiranee Achalakul,et al.  Reducing bioinformatics data dimension with ABC-kNN , 2013, Neurocomputing.

[33]  Beatriz de la Iglesia,et al.  URL-based Web Page Classification - A New Method for URL-based Web Page Classification Using n-Gram Language Models , 2014, KDIR.

[34]  Mengjie Zhang,et al.  A binary ABC algorithm based on advanced similarity scheme for feature selection , 2015, Appl. Soft Comput..

[35]  TANG WENG CHIN.  FEATURE SELECTION FOR THE FUZZY ARTMAP NEURAL NETWORK USING A HYBRID GENETIC ALGORITHM AND TABU SEARCH , 2008 .

[36]  Adel Al-Jumaily,et al.  Differential evolution based feature subset selection , 2008, 2008 19th International Conference on Pattern Recognition.

[37]  Xiaoyan Xiong,et al.  A novel hybrid system for feature selection based on an improved gravitational search algorithm and k-NN method , 2015, Appl. Soft Comput..

[38]  Yunfeng Xu,et al.  A Simple and Efficient Artificial Bee Colony Algorithm , 2013 .

[39]  S. Nasuto,et al.  Exploration vs exploitation in differential evolution , 2008 .

[40]  Minghao Yin,et al.  Hybrid differential evolution with artificial bee colony and its application for design of a reconfigurable antenna array with discrete phase shifters , 2012 .

[41]  Sanyang Liu,et al.  Artificial Bee Colony Algorithm for Portfolio Optimization Problems , 2012 .

[42]  Sanyang Liu,et al.  Improved artificial bee colony algorithm for global optimization , 2011 .

[43]  José Ramón Villar,et al.  A Feature Selection Method Using a Fuzzy Mutual Information Measure , 2008, Innovations in Hybrid Intelligent Systems.

[44]  Wei-Ping Lee,et al.  Modified the Performance of Differential Evolution Algorithm with Dual Evolution Strategy , 2009 .

[45]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[46]  Hélio Pedrini,et al.  Data feature selection based on Artificial Bee Colony algorithm , 2013, EURASIP J. Image Video Process..