S-Shaped vs. V-Shaped Transfer Functions for Ant Lion Optimization Algorithm in Feature Selection Problem

Feature selection is an important preprocessing step for classification problems. It deals with selecting near optimal features in the original dataset. Feature selection is an NP-hard problem, so meta-heuristics can be more efficient than exact methods. In this work, Ant Lion Optimizer (ALO), which is a recent metaheuristic algorithm, is employed as a wrapper feature selection method. Six variants of ALO are proposed where each employ a transfer function to map a continuous search space to a discrete search space. The performance of the proposed approaches is tested on eighteen UCI datasets and compared to a number of existing approaches in the literature: Particle Swarm Optimization, Gravitational Search Algorithm and two existing ALO-based approaches. Computational experiments show that the proposed approaches efficiently explore the feature space and select the most informative features, which help to improve the classification accuracy.

[1]  Mohammad Hammoudeh,et al.  Information extraction from sensor networks using the Watershed transform algorithm , 2015, Inf. Fusion.

[2]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[3]  Jun Wang,et al.  A real time IDSs based on artificial Bee Colony-support vector machine algorithm , 2010, Third International Workshop on Advanced Computational Intelligence.

[4]  Salwani Abdullah,et al.  Modified great deluge for attribute reduction in rough set theory , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[5]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[6]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[7]  Bo Xing,et al.  Gravitational Search Algorithm , 2014 .

[8]  Sarah Mount,et al.  Map as a Service: A Framework for Visualising and Maximising Information Return from Multi-Modal Wireless Sensor Networks , 2015, Sensors.

[9]  Crina Grosan,et al.  Feature Selection via Chaotic Antlion Optimization , 2016, PloS one.

[10]  Salwani Abdullah,et al.  Fuzzy Population-Based Meta-Heuristic Approaches for Attribute Reduction in Rough Set Theory , 2015 .

[11]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .

[12]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[13]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[14]  Ning Zhong,et al.  Using Rough Sets with Heuristics for Feature Selection , 1999, Journal of Intelligent Information Systems.

[15]  Majdi M. Mafarja,et al.  Ant colony optimization based feature selection in rough set theory , 2013 .

[16]  Hossam M. Zawbaa,et al.  Feature selection based on antlion optimization algorithm , 2015, 2015 Third World Conference on Complex Systems (WCCS).

[17]  Rafael Bello,et al.  Two-Step Particle Swarm Optimization to Solve the Feature Selection Problem , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[18]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[19]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[20]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[21]  Bamidele Adebisi,et al.  Dynamic clustering and management of mobile wireless sensor networks , 2017, Comput. Networks.

[22]  Kazuyuki Murase,et al.  A new local search based hybrid genetic algorithm for feature selection , 2011, Neurocomputing.

[23]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[24]  Salwani Abdullah,et al.  Investigating memetic algorithm in solving rough set attribute reduction , 2013, Int. J. Comput. Appl. Technol..

[25]  Crina Grosan,et al.  Feature Subset Selection Approach by Gray-Wolf Optimization , 2014, AECIA.

[26]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[27]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[28]  Salwani Abdullah,et al.  Comparison between Record to Record Travel and Great Deluge Attribute Reduction Algorithms for Classification Problem , 2013, M-CAIT.

[29]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[30]  Bamidele Adebisi,et al.  A Wireless Sensor Network Border Monitoring System: Deployment Issues and Routing Protocols , 2017, IEEE Sensors Journal.

[31]  Fevrier Valdez Bio-Inspired Optimization Methods , 2015, Handbook of Computational Intelligence.

[32]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[33]  Salwani Abdullah,et al.  Fuzzy Modified Great Deluge Algorithm for Attribute Reduction , 2014, SCDM.

[34]  Xiaoyan Xiong,et al.  Feature subset selection by gravitational search algorithm optimization , 2014, Inf. Sci..

[35]  Salwani Abdullah,et al.  A fuzzy record-to-record travel algorithm for solving rough set attribute reduction , 2015, Int. J. Syst. Sci..