A new binary grasshopper optimization algorithm for feature selection problem

Abstract The grasshopper optimization algorithm is one of the recently population-based optimization techniques inspired by the behaviours of grasshoppers in nature. It is an efficient optimization algorithm and since demonstrates excellent performance in solving continuous problems, but cannot resolve directly binary optimization problems. Many optimization problems have been modelled as binary problems since their decision variables varied in binary space such as feature selection in data classification. The main goal of feature selection is to find a small size subset of feature from a sizeable original set of features that optimize the classification accuracy. In this paper, a new binary variant of the grasshopper optimization algorithm is proposed and used for the feature subset selection problem. This proposed new binary grasshopper optimization algorithm is tested and compared to five well-known swarm-based algorithms used in feature selection problem. All these algorithms are implemented and experimented assessed on twenty data sets with various sizes. The results demonstrated that the proposed approach could outperform the other tested methods.

[1]  Xiaohui Huang,et al.  A feature selection approach for hyperspectral image based on modified ant lion optimizer , 2019, Knowl. Based Syst..

[2]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[3]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[4]  Aboul Ella Hassanien,et al.  Modified cuckoo search algorithm with rough sets for feature selection , 2018, Neural Computing and Applications.

[5]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[6]  Mohamed A. Tawhid,et al.  Hybrid Binary Bat Enhanced Particle Swarm Optimization Algorithm for solving feature selection problems , 2018 .

[7]  Crina Grosan,et al.  Feature Selection via Chaotic Antlion Optimization , 2016, PloS one.

[8]  Yu Xue,et al.  Improved bat algorithm with optimal forage strategy and random disturbance strategy , 2016, Int. J. Bio Inspired Comput..

[9]  Mohammad Reza Meybodi,et al.  Enriched ant colony optimization and its application in feature selection , 2014, Neurocomputing.

[10]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[11]  Zhixin Sun,et al.  An Improved Feature Selection Algorithm Based on Ant Colony Optimization , 2018, IEEE Access.

[12]  Daoliang Li,et al.  Feature selection based on improved ant colony optimization for online detection of foreign fiber in cotton , 2014, Appl. Soft Comput..

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  Hossam Faris,et al.  Evolving Support Vector Machines using Whale Optimization Algorithm for spam profiles detection on online social networks in different lingual contexts , 2018, Knowl. Based Syst..

[15]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[16]  Yaochu Jin,et al.  Feature selection for high-dimensional classification using a competitive swarm optimizer , 2016, Soft Computing.

[17]  Pauline Ong,et al.  Efficient gear fault feature selection based on moth-flame optimisation in discrete wavelet packet analysis domain , 2019 .

[18]  Hossam Faris,et al.  Time-varying hierarchical chains of salps with random weight networks for feature selection , 2020, Expert Syst. Appl..

[19]  Peter Andreae,et al.  A Novel Binary Particle Swarm Optimization Algorithm and Its Applications on Knapsack and Feature Selection Problems , 2017 .

[20]  Xiang-Jun Zhao,et al.  Solving 0–1 knapsack problems by chaotic monarch butterfly optimization algorithm with Gaussian mutation , 2018, Memetic Comput..

[21]  Jon Atli Benediktsson,et al.  Feature Selection Based on Hybridization of Genetic Algorithm and Particle Swarm Optimization , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  Qing Wang,et al.  A filter-based bare-bone particle swarm optimization algorithm for unsupervised feature selection , 2019, Applied Intelligence.

[23]  Souad Larabi Marie-Sainte,et al.  Firefly Algorithm based Feature Selection for Arabic Text Classification , 2020, J. King Saud Univ. Comput. Inf. Sci..

[24]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[25]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[26]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[27]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[28]  K. Thanushkodi,et al.  A Novel Rough Set Reduct Algorithm for Medical Domain Based on Bee Colony Optimization , 2010, ArXiv.

[29]  Andries Petrus Engelbrecht,et al.  Binary artificial bee colony optimization , 2011, 2011 IEEE Symposium on Swarm Intelligence.

[30]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[31]  Sankalap Arora,et al.  Binary butterfly optimization approaches for feature selection , 2019, Expert Syst. Appl..

[32]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[33]  Hema Banati,et al.  Fire Fly Based Feature Selection Approach , 2011 .

[34]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[35]  Hossam Faris,et al.  Binary grasshopper optimisation algorithm approaches for feature selection problems , 2019, Expert Syst. Appl..

[36]  Seyedali Mirjalili,et al.  Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems , 2015, Neural Computing and Applications.

[37]  J. Jona,et al.  Ant-cuckoo colony optimization for feature selection in digital mammogram. , 2014, Pakistan journal of biological sciences : PJBS.

[38]  Said Jadid Abdul Kadir,et al.  Binary Optimization Using Hybrid Grey Wolf Optimization for Feature Selection , 2019, IEEE Access.

[39]  Mehmet Fatih Tasgetiren,et al.  A discrete particle swarm optimization algorithm for the no-wait flowshop scheduling problem , 2008, Comput. Oper. Res..

[40]  Hossam Faris,et al.  A multi-verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture , 2017, Neural Computing and Applications.

[41]  Hossam Faris,et al.  Binary dragonfly optimization for feature selection using time-varying transfer functions , 2018, Knowl. Based Syst..

[42]  Xin-She Yang,et al.  Flower Pollination Algorithm for Global Optimization , 2012, UCNC.

[43]  Abdul Rahim Abdullah,et al.  A New Competitive Binary Grey Wolf Optimizer to Solve the Feature Selection Problem in EMG Signals Classification , 2018, Comput..

[44]  Hossam Faris,et al.  Asynchronous accelerating multi-leader salp chains for feature selection , 2018, Appl. Soft Comput..

[45]  Li Liu,et al.  Cancer Feature Selection and Classification Using a Binary Quantum-Behaved Particle Swarm Optimization and Support Vector Machine , 2016, Comput. Math. Methods Medicine.

[46]  Dogan Aydin,et al.  Angle Modulated Artificial Bee Colony Algorithms for Feature Selection , 2016, Appl. Comput. Intell. Soft Comput..

[47]  Houassi Hichem,et al.  PSO with crossover operator applied to feature selection problem in classification , 2018, Informatica.

[48]  Hossam Faris,et al.  Feature selection using binary grey wolf optimizer with elite-based crossover for Arabic text classification , 2019, Neural Computing and Applications.

[49]  Hossam Faris,et al.  Simultaneous Feature Selection and Support Vector Machine Optimization Using the Grasshopper Optimization Algorithm , 2018, Cognitive Computation.

[50]  L. Congying,et al.  Particle swarm optimization algorithm for quadratic assignment problem , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[51]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[52]  Majdi M. Mafarja,et al.  Hybrid binary ant lion optimizer with rough set and approximate entropy reducts for feature selection , 2018, Soft Comput..

[53]  Zhiwei Ye,et al.  A feature selection method based on modified binary coded ant colony optimization algorithm , 2016, Appl. Soft Comput..

[54]  Jing Wang,et al.  Swarm Intelligence in Cellular Robotic Systems , 1993 .

[55]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[56]  Xin-She Yang,et al.  Binary Flower Pollination Algorithm and Its Application to Feature Selection , 2015, Recent Advances in Swarm Intelligence and Evolutionary Computation.

[57]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[58]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[59]  Xin-She Yang,et al.  BCS: A Binary Cuckoo Search algorithm for feature selection , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).