An Improved Harris Hawks Optimization Algorithm With Simulated Annealing for Feature Selection in the Medical Field

Harris Hawks Optimization (HHO) algorithm is a new metaheuristic algorithm, inspired by the cooperative behavior and chasing style of Harris’ Hawks in nature called surprise pounce. HHO demonstrated promising results compared to other optimization methods. However, HHO suffers from local optima and population diversity drawbacks. To overcome these limitations and adapt it to solve feature selection problems, a novel metaheuristic optimizer, namely Chaotic Harris Hawks Optimization (CHHO), is proposed. Two main improvements are suggested to the standard HHO algorithm. The first improvement is to apply the chaotic maps at the initialization phase of HHO to enhance the population diversity in the search space. The second improvement is to use the Simulated Annealing (SA) algorithm to the current best solution to improve HHO exploitation. To validate the performance of the proposed algorithm, CHHO was applied on 14 medical benchmark datasets from the UCI machine learning repository. The proposed CHHO was compared with the original HHO and some famous and recent metaheuristics algorithms, containing Grasshopper Optimization Algorithm (GOA), Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Butterfly Optimization Algorithm (BOA), and Ant Lion Optimizer (ALO). The used evaluation metrics include the number of selected features, classification accuracy, fitness values, Wilcoxon’s statistical test ( $P$ -value), and convergence curve. Based on the achieved results, CHHO confirms its superiority over the standard HHO algorithm and the other optimization algorithms on the majority of the medical datasets.

[1]  Chee Peng Lim,et al.  Feature selection based on brain storm optimization for data classification , 2019, Appl. Soft Comput..

[2]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[3]  Mohamed Abd Elaziz,et al.  Performance analysis of Chaotic Multi-Verse Harris Hawks Optimization: A case study on solving engineering problems , 2020, Eng. Appl. Artif. Intell..

[4]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[5]  Xuewen Xia,et al.  Efficient Feature Selection Algorithm Based on Particle Swarm Optimization With Learning Memory , 2019, IEEE Access.

[6]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[7]  Duncan Fyfe Gillies,et al.  A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data , 2015, Adv. Bioinformatics.

[8]  Hossam Faris,et al.  Grasshopper optimization algorithm for multi-objective optimization problems , 2017, Applied Intelligence.

[9]  Mohammed Azmi Al-Betar,et al.  The monarch butterfly optimization algorithm for solving feature selection problems , 2020, Neural Computing and Applications.

[10]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[11]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[12]  Heming Jia,et al.  A Novel Hybrid Harris Hawks Optimization for Color Image Multilevel Thresholding Segmentation , 2019, IEEE Access.

[13]  Jon Atli Benediktsson,et al.  Feature Selection Based on Hybridization of Genetic Algorithm and Particle Swarm Optimization , 2015, IEEE Geoscience and Remote Sensing Letters.

[14]  Joong Hoon Kim,et al.  Chaotic genetic algorithm and Adaboost ensemble metamodeling approach for optimum resource planning in emergency departments , 2018, Artif. Intell. Medicine.

[15]  Ram Rup Sarkar,et al.  Binary Genetic Swarm Optimization: A Combination of GA and PSO for Feature Selection , 2019, J. Intell. Syst..

[16]  Majid Abdolrazzagh-Nezhad,et al.  A new hybridization of DBSCAN and fuzzy earthworm optimization algorithm for data cube clustering , 2020, Soft Computing.

[17]  Ahmed M. Anter,et al.  Feature selection strategy based on hybrid crow search optimization algorithm integrated with chaos theory and fuzzy c-means algorithm for medical diagnosis problems , 2019, Soft Computing.

[18]  Ma Long-hua,et al.  A new optimization algorithm based on chaos , 2006 .

[19]  Yong Xia,et al.  GA-SVM based feature selection and parameter optimization in hospitalization expense modeling , 2019, Appl. Soft Comput..

[20]  Rabab K. Ward,et al.  Optimized deep neural network architecture for robust detection of epileptic seizures using EEG signals , 2019, Clinical Neurophysiology.

[21]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[22]  Seyed Mohammad Mirjalili,et al.  Improved Salp Swarm Algorithm based on opposition based learning and novel local search algorithm for feature selection , 2020, Expert Syst. Appl..

[23]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[24]  Tribhuvan Singh,et al.  A chaotic sequence-guided Harris hawks optimizer for data clustering , 2020, Neural Computing and Applications.

[25]  Sankalap Arora,et al.  Chaotic grasshopper optimization algorithm for global optimization , 2019, Neural Computing and Applications.

[26]  Salah Kamel,et al.  Developing and Applying Chaotic Harris Hawks Optimization Technique for Extracting Parameters of Several Proton Exchange Membrane Fuel Cell Stacks , 2020, IEEE Access.

[27]  Mahmoud Hassaballah,et al.  A novel hybrid Harris hawks optimization and support vector machines for drug design and discovery , 2020, Comput. Chem. Eng..

[28]  Sankalap Arora,et al.  Binary butterfly optimization approaches for feature selection , 2019, Expert Syst. Appl..

[29]  Ibrahim Aljarah,et al.  Improved whale optimization algorithm for feature selection in Arabic sentiment analysis , 2018, Applied Intelligence.

[30]  Said Jadid Abdul Kadir,et al.  Binary Optimization Using Hybrid Grey Wolf Optimization for Feature Selection , 2019, IEEE Access.

[31]  Ragab A. El-Sehiemy,et al.  Optimal power flow using an Improved Colliding Bodies Optimization algorithm , 2016, Appl. Soft Comput..

[32]  Jian Zhou,et al.  Deep neural network and whale optimization algorithm to assess flyrock induced by blasting , 2021, Engineering with Computers.

[33]  Jin Song Dong,et al.  Introduction to Nature-Inspired Algorithms , 2019, Nature-Inspired Optimizers.

[34]  Jun Wang,et al.  An Improved Cuckoo Search Optimization Algorithm for the Problem of Chaotic Systems Parameter Estimation , 2016, Comput. Intell. Neurosci..

[35]  Sankalap Arora,et al.  Chaotic grey wolf optimization algorithm for constrained optimization problems , 2018, J. Comput. Des. Eng..

[36]  Qing Wu,et al.  A Feature Selection Method Based on Hybrid Improved Binary Quantum Particle Swarm Optimization , 2019, IEEE Access.

[37]  Aboul Ella Hassanien,et al.  An improved moth flame optimization algorithm based on rough sets for tomato diseases detection , 2017, Comput. Electron. Agric..

[38]  Mohanad Albughdadi,et al.  Variance-based differential evolution algorithm with an optional crossover for data clustering , 2019, Appl. Soft Comput..

[39]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[40]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[41]  Khairul Akram Zainol Ariffin,et al.  Improved Harris Hawks Optimization Using Elite Opposition-Based Learning and Novel Search Mechanism for Feature Selection , 2020, IEEE Access.

[42]  Shaohua Wan,et al.  A unified two-parallel-branch deep neural network for joint gland contour and segmentation learning , 2019, Future Gener. Comput. Syst..

[43]  Sankalap Arora,et al.  Chaotic whale optimization algorithm , 2018, J. Comput. Des. Eng..

[44]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[45]  Nada Almugren,et al.  A Survey on Hybrid Feature Selection Methods in Microarray Gene Expression Data for Cancer Classification , 2019, IEEE Access.

[46]  Satvir Singh,et al.  Butterfly optimization algorithm: a novel approach for global optimization , 2018, Soft Computing.