Hybrid Monkey Algorithm with Krill Herd Algorithm optimization for feature selection

In this work, a system for feature selection based on hybrid Monkey Algorithm (MA) with Krill Herd Algorithm (KHA) is proposed. Data sets ordinarily includes a huge number of attributes, with irrelevant and redundant attribute. A system for feature selection is proposed in this work using a hybrid Monkey Algorithm and Krill Herd Algorithm (MAKHA). The MAKHA algorithm adaptively balance the exploration and exploitation to quickly find the optimal solution. MAKHA is a new evolutionary computation technique, inspired by the chicken movement. The MAKHA can quickly search the feature space for optimal or near-optimal feature subset minimizing a given fitness function. The proposed fitness function used incorporate both classification accuracy and feature reduction size. The proposed system was tested on 18 data sets and proves advance over other search methods as particle swarm optimization (PSO) and genetic algorithm (GA) optimizers commonly used in this context using different evaluation indicators.

[1]  Cheng-Hong Yang,et al.  Dimensionality Reduction using GA-PSO , 2006, JCIS.

[2]  Hedieh Sajedi,et al.  SMS Spam Filtering Using Machine Learning Techniques: A Survey , 2016 .

[3]  Wansheng Tang,et al.  Monkey Algorithm for Global Numerical Optimization , 2008 .

[4]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[5]  Ahmed M. E. Khalil,et al.  MAKHA - A New Hybrid Swarm Intelligence Global Optimization Algorithm , 2015, Algorithms.

[6]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[7]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[8]  Mengjie Zhang,et al.  An archive based particle swarm optimisation for feature selection in classification , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[9]  B. Raman,et al.  Instance Based Filter for Feature Selection , 2002 .

[10]  Ratna Babu Chinnam,et al.  mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification , 2011, Inf. Sci..

[11]  Jon Atli Benediktsson,et al.  Feature Selection Based on Hybridization of Genetic Algorithm and Particle Swarm Optimization , 2015, IEEE Geoscience and Remote Sensing Letters.

[12]  Mohammad Reza Meybodi,et al.  Enriched ant colony optimization and its application in feature selection , 2014, Neurocomputing.

[13]  Kazuyuki Murase,et al.  A new hybrid ant colony optimization algorithm for feature selection , 2012, Expert Syst. Appl..

[14]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[15]  Ahmad Taher Azar,et al.  Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis , 2014, Comput. Methods Programs Biomed..

[16]  Lior Rokach,et al.  A Survey of Feature Selection Techniques , 2009, Encyclopedia of Data Warehousing and Mining.

[17]  Xin-She Yang,et al.  A wrapper approach for feature selection based on Bat Algorithm and Optimum-Path Forest , 2014, Expert Syst. Appl..

[18]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .