Dimensionality Reduction Using an Improved Whale Optimization Algorithm for Data Classification

Whale optimization algorithm is a newly proposed bio-inspired optimization technique introduced in 2016 which imitates the hunting demeanor of humpback whales. In this paper, to enhance solution accuracy, reliability and convergence speed, we have introduced some modifications on the basic WOA structure. First, a new control parameter, inertia weight, is proposed to tune the impact on the present best solution, and an improved whale optimization algorithm (IWOA) is obtained. Second, we assess IWOA with various transfer functions to convert continuous solutions to binary ones. The proposed algorithm incorporated with the K-nearest neighbor classifier as a feature selection method for identifying feature subset that enhancing the classification accuracy and limiting the size of selected features. The proposed algorithm was compared with binary versions of the basic whale optimization algorithm, particle swarm optimization, genetic algorithm, antlion optimizer and grey wolf optimizer on 27 common UCI datasets. Optimization results demonstrate that the proposed IWOA not only significantly enhances the basic whale optimization algorithm but also performs much superior to the other algorithms.

[1]  Luis A. M. Pereira,et al.  A Binary Krill Herd Approach for Feature Selection , 2014, 2014 22nd International Conference on Pattern Recognition.

[2]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[3]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[4]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[5]  Michael D. Todd,et al.  Automated Feature Design for Numeric Sequence Classification by Genetic Programming , 2015, IEEE Transactions on Evolutionary Computation.

[6]  Adel Taweel,et al.  Feature Selection based on Hybrid Binary Cuckoo Search and Rough Set Theory in Classification for Nominal Datasets , 2017 .

[7]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[8]  Duoqian Miao,et al.  A rough set approach to feature selection based on ant colony optimization , 2010, Pattern Recognit. Lett..

[9]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[10]  Mengjie Zhang,et al.  Genetic Programming for Feature Subset Ranking in Binary Classification Problems , 2009, EuroGP.

[11]  Amlan Chakrabarti,et al.  Feature Selection: A Practitioner View , 2014 .

[12]  Hossein Nezamabadi-pour,et al.  A new feature selection algorithm based on binary ant colony optimization , 2013, The 5th Conference on Information and Knowledge Technology.

[13]  Xin-She Yang,et al.  BBA: A Binary Bat Algorithm for Feature Selection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[14]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[15]  A. E. Eiben,et al.  Genetic algorithms with multi-parent recombination , 1994, PPSN.

[16]  Thomas Marill,et al.  On the effectiveness of receptors in recognition systems , 1963, IEEE Trans. Inf. Theory.

[17]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[18]  Aboul Ella Hassanien,et al.  New approach for feature selection based on rough set and bat algorithm , 2014, 2014 9th International Conference on Computer Engineering & Systems (ICCES).

[19]  Xin-She Yang,et al.  A Binary Cuckoo Search and Its Application for Feature Selection , 2014 .

[20]  Cheng-Lung Huang,et al.  ACO-based hybrid classification system with feature subset selection and model parameters optimization , 2009, Neurocomputing.

[21]  R. Parimala,et al.  Feature Selection using a Novel Particle Swarm Optimization and It's Variants , 2012 .

[22]  Bishwajit Chakraborty,et al.  Genetic algorithm with fuzzy fitness function for feature selection , 2002, Industrial Electronics, 2002. ISIE 2002. Proceedings of the 2002 IEEE International Symposium on.

[23]  B. Chakraborty.  Feature subset selection by particle swarm optimization with fuzzy fitness function , 2008, 2008 3rd International Conference on Intelligent System and Knowledge Engineering.

[24]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[25]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[26]  L. Chuang,et al.  Chaotic maps in binary particle swarm optimization for feature selection , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[27]  Farhad Rad,et al.  The Impact of Feature Selection on Meta-Heuristic Algorithms to Data Mining Methods , 2016 .

[28]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[29]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[30]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[31]  Jyoti,et al.  Multi-objective genetic algorithm approach to feature subset optimization , 2014, 2014 IEEE International Advance Computing Conference (IACC).