An Improved Whale Optimization Algorithm for Feature Selection

Whale optimization algorithm (WOA) is a new population-based metaheuristic algorithm. WOA uses shrinking encircling mechanism, spiral rise, and random learning strategies to update whale’s positions. WOA has merit in terms of simple calculation and high computational accuracy, but its convergence speed is slow and it is easy to fall into the local optimal solution. In order to overcome the shortcomings, this paper integrates adaptive neighborhood and hybrid mutation strategies into whale optimization algorithms, designs the average distance from itself to other whales as an adaptive neighborhood radius, and chooses to learn from the optimal solution in the neighborhood instead of random learning strategies. The hybrid mutation strategy is used to enhance the ability of algorithm to jump out of the local optimal solution. A new whale optimization algorithm (HMNWOA) is proposed. The proposed algorithm inherits the global search capability of the original algorithm, enhances the exploitation ability, improves the quality of the population, and thus improves the convergence speed of the algorithm. A feature selection algorithm based on binary HMNWOA is proposed. Twelve standard datasets from UCI repository test the validity of the proposed algorithm for feature selection. The experimental results show that HMNWOA is very competitive compared to the other six popular feature selection methods in improving the classification accuracy and reducing the number of features, and ensures that HMNWOA has strong search ability in the search feature space.

[1]  Hossam M. Zawbaa,et al.  Feature selection based on antlion optimization algorithm , 2015, 2015 Third World Conference on Complex Systems (WCCS).

[2]  V. Suresh Kumar,et al.  A Novel Feature Subset Selection Algorithm Using Artificial Bee Colony in Keystroke Dynamics , 2011, SocProS.

[3]  Petros Drineas,et al.  Feature selection for linear SVM with provable guarantees , 2014, Pattern Recognit..

[4]  Jianzhou Wang,et al.  A novel hybrid system based on a new proposed algorithm-Multi-Objective Whale Optimization Algorithm for wind speed forecasting , 2017 .

[5]  Hossam M. Zawbaa,et al.  Feature selection approach based on whale optimization algorithm , 2017, 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI).

[6]  Roger A. Sauer,et al.  A NURBS-based Inverse Analysis for Reconstruction of Nonlinear Deformations of Thin Shell Structures , 2018, ArXiv.

[7]  Kenji Suzuki,et al.  Binary coordinate ascent: An efficient optimization technique for feature subset selection for machine learning , 2016, Knowl. Based Syst..

[8]  Timon Rabczuk,et al.  A multi-material level set-based topology optimization of flexoelectric composites , 2018, 1901.10752.

[9]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[10]  Mengjie Zhang,et al.  Differential evolution for filter feature selection based on information theory and feature ranking , 2018, Knowl. Based Syst..

[11]  Kumar Chellapilla,et al.  Combining mutation operators in evolutionary programming , 1998, IEEE Trans. Evol. Comput..

[12]  Yongquan Zhou,et al.  Lévy Flight Trajectory-Based Whale Optimization Algorithm for Global Optimization , 2017, IEEE Access.

[13]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[14]  Gil Alterovitz,et al.  Accelerating wrapper-based feature selection with K-nearest-neighbor , 2015, Knowl. Based Syst..

[15]  Aboul Ella Hassanien,et al.  Whale Optimization Algorithm and Moth-Flame Optimization for multilevel thresholding image segmentation , 2017, Expert Syst. Appl..

[16]  Ana Carolina Lorena,et al.  Feature Selection via Pareto Multi-objective Genetic Algorithms , 2017, Appl. Artif. Intell..

[17]  Nikolaos Kourentzes,et al.  Feature selection for time series prediction - A combined filter and wrapper approach for neural networks , 2010, Neurocomputing.

[18]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[19]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[20]  Yu He,et al.  Parameter extraction of solar photovoltaic models using an improved whale optimization algorithm , 2018, Energy Conversion and Management.

[21]  Aboul Ella Hassanien,et al.  Classification of toxicity effects of biotransformed hepatic drugs using whale optimized support vector machines , 2017, J. Biomed. Informatics.

[22]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[23]  M. Kezunovic,et al.  Fuzzy ART neural network algorithm for classifying the power system faults , 2005, IEEE Transactions on Power Delivery.

[24]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .