Binary grey wolf optimization approaches for feature selection

In this work, a novel binary version of the grey wolf optimization (GWO) is proposed and used to select optimal feature subset for classification purposes. Grey wolf optimizer (GWO) is one of the latest bio-inspired optimization techniques, which simulate the hunting process of grey wolves in nature. The binary version introduced here is performed using two different approaches. In the first approach, individual steps toward the first three best solutions are binarized and then stochastic crossover is performed among the three basic moves to find the updated binary grey wolf position. In the second approach, sigmoidal function is used to squash the continuous updated position, then stochastically threshold these values to find the updated binary grey wolf position. The two approach for binary grey wolf optimization (bGWO) are hired in the feature selection domain for finding feature subset maximizing the classification accuracy while minimizing the number of selected features. The proposed binary versions were compared to two of the common optimizers used in this domain namely particle swarm optimizer and genetic algorithms. A set of assessment indicators are used to evaluate and compared the different methods over 18 different datasets from the UCI repository. Results prove the capability of the proposed binary version of grey wolf optimization (bGWO) to search the feature space for optimal feature combinations regardless of the initialization and the used stochastic operators.

[1]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[2]  KarabogaDervis,et al.  A powerful and efficient algorithm for numerical function optimization , 2007 .

[3]  Narayanan Kumarappan,et al.  Hybrid improved binary particle swarm optimization approach for generation maintenance scheduling problem , 2013, Swarm Evol. Comput..

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[6]  Lior Rokach,et al.  A Survey of Feature Selection Techniques , 2009, Encyclopedia of Data Warehousing and Mining.

[7]  Ana Maria A. C. Rocha,et al.  Improved binary artificial fish swarm algorithm for the 0-1 multidimensional knapsack problems , 2014, Swarm Evol. Comput..

[8]  Yudong Zhang,et al.  Binary PSO with mutation operator for feature selection using decision tree applied to spam detection , 2014, Knowl. Based Syst..

[9]  Hema Banati,et al.  Fire Fly Based Feature Selection Approach , 2011 .

[10]  Xin-She Yang,et al.  Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms , 2005, IWINAC.

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[13]  Leandro dos Santos Coelho,et al.  Binary optimization using hybrid particle swarm optimization and gravitational search algorithm , 2014, Neural Computing and Applications.

[14]  Li-Yeh Chuang,et al.  Improved binary particle swarm optimization using catfish effect for feature selection , 2011, Expert Syst. Appl..

[15]  Hossein Nezamabadi-pour,et al.  BGSA: binary gravitational search algorithm , 2010, Natural Computing.

[16]  Karim Faez,et al.  Feature Selection Using Ant Colony Optimization (ACO): A New Method and Comparative Study in the Application of Face Recognition System , 2007, ICDM.

[17]  Jadwiga Indulska,et al.  Proceedings of IEEE International Conference on Networks , 1999 .

[18]  Xin-She Yang,et al.  BBA: A Binary Bat Algorithm for Feature Selection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[19]  Li Xiao,et al.  An Optimizing Method Based on Autonomous Animats: Fish-swarm Algorithm , 2002 .

[20]  Erik D. Goodman,et al.  Swarmed feature selection , 2004, 33rd Applied Imagery Pattern Recognition Workshop (AIPR'04).

[21]  David A. Bell,et al.  A Formalism for Relevance and Its Application in Feature Subset Selection , 2000, Machine Learning.

[22]  A. E. Eiben,et al.  Genetic algorithms with multi-parent recombination , 1994, PPSN.

[23]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[24]  Maryam Kouzehgar,et al.  A Comparison among Wolf Pack Search and Four other Optimization Algorithms , 2012 .

[25]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[26]  V. T. Sreedevi,et al.  Development of novel optimization procedure based on honey bee foraging behavior , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[27]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[28]  Xiaoming Xu,et al.  A hybrid genetic algorithm for feature selection wrapper based on mutual information , 2007, Pattern Recognit. Lett..

[29]  H Nezamabadi Pour,et al.  BINARY PARTICLE SWARM OPTIMIZATION: CHALLENGES AND NEW SOLUTIONS , 2008 .

[30]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[31]  Mohammad Teshnehlab,et al.  Novel Binary Particle Swarm Optimization , 2009 .

[32]  Dennis Saleh Zs , 2001 .

[33]  Reza Akbari,et al.  A novel bee swarm optimization algorithm for numerical function optimization , 2010 .

[34]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.