Efficient Hybrid Nature-Inspired Binary Optimizers for Feature Selection

The process of dimensionality reduction is a crucial solution to deal with the dimensionality problem that may be faced when dealing with the majority of machine learning techniques. This paper proposes an enhanced hybrid metaheuristic approach using grey wolf optimizer (GWO) and whale optimization algorithm (WOA) to develop a wrapper-based feature selection method. The main objective of the proposed technique is to alleviate the drawbacks of both algorithms, including immature convergence and stagnation to local optima (LO). The hybridization is done with improvements in the mechanisms of both algorithms. To confirm the stability of the proposed approach, 18 well-known datasets are employed from the UCI repository. Furthermore, the classification accuracy, number of selected features, fitness values, and run time matrices are collected and compared with a set of well-known feature selection approaches in the literature. The results show the superiority of the proposed approach compared with both GWO and WOA. The results also show that the proposed hybrid technique outperforms other state-of-the-art approaches, significantly.

[1]  Hossam Faris,et al.  Binary dragonfly optimization for feature selection using time-varying transfer functions , 2018, Knowl. Based Syst..

[2]  Ge Yu,et al.  Super-Graph Classification Based on Composite Subgraph Features and Extreme Learning Machine , 2018, Cognitive Computation.

[3]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[4]  Salah Kamel,et al.  Accurate economic dispatch solution using hybrid whale-wolf optimization method , 2017, 2017 Nineteenth International Middle East Power Systems Conference (MEPCON).

[5]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[6]  Majdi M. Mafarja,et al.  Feature selection using binary particle swarm optimization with time varying inertia weight strategies , 2018, ICFNDS.

[7]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[8]  J. Kleijnen A new metaheuristic , 2006 .

[9]  Stjepan Oreski,et al.  Genetic algorithm-based heuristic for feature selection in credit risk assessment , 2014, Expert Syst. Appl..

[10]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[11]  Muhammad Kamran Siddiqui,et al.  Study of biological networks using graph theory , 2017, Saudi journal of biological sciences.

[12]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[13]  Akash Saxena,et al.  A comprehensive study of chaos embedded bridging mechanisms and crossover operators for grasshopper optimisation algorithm , 2019, Expert Syst. Appl..

[14]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[15]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[16]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[17]  Hossam Faris,et al.  Dragonfly Algorithm: Theory, Literature Review, and Application in Feature Selection , 2019, Nature-Inspired Optimizers.

[18]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[19]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[20]  Francisco Herrera,et al.  An Insight into Bio-inspired and Evolutionary Algorithms for Global Optimization: Review, Analysis, and Lessons Learnt over a Decade of Competitions , 2018, Cognitive Computation.

[21]  Hossam Faris,et al.  An enhanced associative learning-based exploratory whale optimizer for global optimization , 2019, Neural Computing and Applications.

[22]  Narinder Singh,et al.  A New Hybrid Whale Optimizer Algorithm with Mean Strategy of Grey Wolf Optimizer for Global Optimization , 2018 .

[23]  Hossam Faris,et al.  Optimizing Software Effort Estimation Models Using Firefly Algorithm , 2015, ArXiv.

[24]  Xin-She Yang,et al.  Multi-species Cuckoo Search Algorithm for Global Optimization , 2018, Cognitive Computation.

[25]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[26]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[27]  Nasser R. Sabar,et al.  Rank based binary particle swarm optimisation for feature selection in classification , 2018, ICFNDS.

[28]  Hossam Faris,et al.  Asynchronous accelerating multi-leader salp chains for feature selection , 2018, Appl. Soft Comput..

[29]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[30]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[31]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[32]  Hossam M. Zawbaa,et al.  Feature selection based on antlion optimization algorithm , 2015, 2015 Third World Conference on Complex Systems (WCCS).

[33]  Hossam Faris,et al.  Chapter 28 – Evolving Radial Basis Function Networks Using Moth–Flame Optimizer , 2017 .

[34]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .

[35]  A. N. Jadhav,et al.  WGC: Hybridization of exponential grey wolf optimizer with whale optimization for data clustering , 2017, Alexandria Engineering Journal.

[36]  Seyedali Mirjalili,et al.  Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems , 2015, Neural Computing and Applications.

[37]  Sarah L. Taylor,et al.  Optimizing Echo State Networks for Static Pattern Recognition , 2017, Cognitive Computation.

[38]  Wei Gao,et al.  Partial multi-dividing ontology learning algorithm , 2018, Inf. Sci..

[39]  Kewei Cheng,et al.  Feature Selection , 2016, ACM Comput. Surv..

[40]  Xu Chen,et al.  An opposition-based sine cosine approach with local search for parameter estimation of photovoltaic models , 2019, Energy Conversion and Management.

[41]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[42]  Rajesh Kumar,et al.  β-Chaotic map enabled Grey Wolf Optimizer , 2019, Appl. Soft Comput..

[43]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[44]  Mengjie Zhang,et al.  Novel Initialisation and Updating Mechanisms in PSO for Feature Selection in Classification , 2013, EvoApplications.

[45]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[46]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[47]  Hiroshi Motoda,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998, The Springer International Series in Engineering and Computer Science.

[48]  Wei Gao,et al.  An independent set degree condition for fractional critical deleted graphs , 2019, Discrete & Continuous Dynamical Systems - S.

[49]  Rajesh Kumar,et al.  Intelligent Grey Wolf Optimizer - Development and application for strategic bidding in uniform price spot energy market , 2018, Appl. Soft Comput..

[50]  Hossam Faris,et al.  An intelligent system for spam detection and identification of the most relevant features based on evolutionary Random Weight Networks , 2019, Inf. Fusion.

[51]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[52]  Hossam Faris,et al.  Optimizing Feedforward neural networks using Krill Herd algorithm for E-mail spam detection , 2015, 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[53]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[54]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[55]  Wei Gao,et al.  Nano properties analysis via fourth multiplicative ABC indicator calculating , 2017, Arabian Journal of Chemistry.

[56]  Hossam Faris,et al.  An evolutionary gravitational search-based feature selection , 2019, Inf. Sci..

[57]  Rui Zhang,et al.  Special Issue Editorial: Cognitively-Inspired Computing for Knowledge Discovery , 2018, Cognitive Computation.

[58]  Hossam Faris,et al.  Optimizing the Learning Process of Feedforward Neural Networks Using Lightning Search Algorithm , 2016, Int. J. Artif. Intell. Tools.

[59]  D. Dimitrov,et al.  Tight independent set neighborhood union condition for fractional critical deleted graphs and ID deleted graphs , 2019, Discrete & Continuous Dynamical Systems - S.

[60]  Majdi M. Mafarja,et al.  Binary Dragonfly Algorithm for Feature Selection , 2017, 2017 International Conference on New Trends in Computing Sciences (ICTCS).

[61]  Hossam Faris,et al.  Simultaneous Feature Selection and Support Vector Machine Optimization Using the Grasshopper Optimization Algorithm , 2018, Cognitive Computation.

[62]  Hossam Faris,et al.  Clustering analysis using a novel locality-informed grey wolf-inspired clustering approach , 2019, Knowledge and Information Systems.

[63]  Mengjie Zhang,et al.  Filter based backward elimination in wrapper based PSO for feature selection in classification , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[64]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.