Hybrid Binary Bat Enhanced Particle Swarm Optimization Algorithm for solving feature selection problems

Abstract In this paper, we present a new hybrid binary version of bat and enhanced particle swarm optimization algorithm in order to solve feature selection problems. The proposed algorithm is called Hybrid Binary Bat Enhanced Particle Swarm Optimization Algorithm (HBBEPSO). In the proposed HBBEPSO algorithm, we combine the bat algorithm with its capacity for echolocation helping explore the feature space and enhanced version of the particle swarm optimization with its ability to converge to the best global solution in the search space. In order to investigate the general performance of the proposed HBBEPSO algorithm, the proposed algorithm is compared with the original optimizers and other optimizers that have been used for feature selection in the past. A set of assessment indicators are used to evaluate and compare the different optimizers over 20 standard data sets obtained from the UCI repository. Results prove the ability of the proposed HBBEPSO algorithm to search the feature space for optimal feature combinations.

[1]  Hema Banati,et al.  Fire Fly Based Feature Selection Approach , 2011 .

[2]  Mohamed A. Tawhid,et al.  A hybrid social spider optimization and genetic algorithm for minimizing molecular potential energy function , 2017, Soft Comput..

[3]  Jian Xie,et al.  A Novel Bat Algorithm Based on Differential Operator and Lévy Flights Trajectory , 2013, Comput. Intell. Neurosci..

[4]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[5]  Xiaoming Xu,et al.  A hybrid genetic algorithm for feature selection wrapper based on mutual information , 2007, Pattern Recognit. Lett..

[6]  Koffka Khan,et al.  A Fuzzy Bat Clustering Method for Ergonomic Screening of Office Workplaces , 2011 .

[7]  Lior Rokach,et al.  A Survey of Feature Selection Techniques , 2009, Encyclopedia of Data Warehousing and Mining.

[8]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[9]  Carlos Cotta.  A Study of Hybridisation Techniques and Their Application to the Design of Evolutionary Algorithms , 1998, AI Commun..

[10]  Yudong Zhang,et al.  Binary PSO with mutation operator for feature selection using decision tree applied to spam detection , 2014, Knowl. Based Syst..

[11]  D. Agrafiotis,et al.  Feature selection for structure-activity correlation using binary particle swarms. , 2002, Journal of medicinal chemistry.

[12]  H. Schnitzler,et al.  Echolocation by Insect-Eating Bats , 2001 .

[13]  Xin-She Yang,et al.  Bat algorithm for multi-objective optimisation , 2011, Int. J. Bio Inspired Comput..

[14]  Yudong Zhang,et al.  Detection of abnormal MR brains based on wavelet entropy and feature selection , 2016 .

[15]  Xin-She Yang,et al.  Binary Bat Algorithm for Feature Selection , 2013 .

[16]  Mohamed A. Tawhid,et al.  Hybrid Particle Swarm Optimization with a Modified Arithmetical Crossover for Solving Unconstrained Optimization Problems , 2015, INFOR Inf. Syst. Oper. Res..

[17]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[18]  Samina Khalid,et al.  A survey of feature selection and feature extraction techniques in machine learning , 2014, 2014 Science and Information Conference.

[19]  Carlos A. Coello Coello,et al.  Use of Particle Swarm Optimization to Design Combinational Logic Circuits , 2003, ICES.

[20]  Charles R. Michael,et al.  The echolocation of flying insects by bats , 1960 .

[21]  Jiawei Han,et al.  Generalized Fisher Score for Feature Selection , 2011, UAI.

[22]  R. A. Krohling,et al.  Solving numerical equations of hydraulic problems using particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[23]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[24]  Dun-Wei Gong,et al.  Feature selection algorithm based on bare bones particle swarm optimization , 2015, Neurocomputing.

[25]  El-Ghazali Talbi,et al.  A Taxonomy of Hybrid Metaheuristics , 2002, J. Heuristics.

[26]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[27]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[28]  Xin-She Yang,et al.  Binary bat algorithm , 2013, Neural Computing and Applications.

[29]  Aboul Ella Hassanien,et al.  Hybrid flower pollination algorithm with rough sets for feature selection , 2015, 2015 11th International Computer Engineering Conference (ICENCO).

[30]  Mohamed A. Tawhid,et al.  Multi-directional bat algorithm for solving unconstrained optimization problems , 2017 .

[31]  ZhangYong,et al.  Multi-Objective Particle Swarm Optimization Approach for Cost-Based Feature Selection in Classification , 2017 .

[32]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[33]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[34]  Carlos Cotta dash,et al.  A study of hybridisation techniques and their application to the design of evolutionary algorithms , 1998 .

[35]  Yudong Zhang,et al.  A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications , 2015 .

[36]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[37]  David A. Bell,et al.  A Formalism for Relevance and Its Application in Feature Subset Selection , 2000, Machine Learning.

[38]  S. Halgamuge,et al.  A comparison of constraint-handling methods for the application of particle swarm optimization to constrained nonlinear optimization problems , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..