S-shaped versus V-shaped transfer functions for binary Manta ray foraging optimization in feature selection problem

Feature selection (FS) is considered as one of the core concepts in the areas of machine learning and data mining which immensely impacts the performance of classification model. Through FS, irrelevant or partially relevant features can be eliminated which in turn helps in enhancing the performance of the model. Over the years, researchers have applied different meta-heuristic optimization techniques for the purpose of FS as these overcome the limitations of traditional optimization approaches. Going by the trend, we introduce a new FS approach based on a recently proposed meta-heuristic algorithm called Manta ray foraging optimization (MRFO) which is developed following the food foraging nature of the Manta rays, one of the largest known marine creatures. As MRFO is apposite for continuous search space problems, we have adapted a binary version of MRFO to fit it into the problem of FS by applying eight different transfer functions belonging to two different families: S-shaped and V-shaped. We have evaluated the eight binary versions of MRFO on 18 standard UCI datasets. Of these, the best one is considered for comparison with 16 recently proposed meta-heuristic FS approaches. The results show that MRFO outperforms the state-of-the-art methods in terms of both classification accuracy and number of features selected. The source code of this work is available in https://github.com/Rangerix/MetaheuristicOptimization .

[1]  Neeraj Kumar,et al.  Machine Learning in Cognitive IoT , 2020 .

[2]  Grzegorz Borowik Optimization on the Complementation Procedure Towards Efficient Implementation of the Index Generation Function , 2018, Int. J. Appl. Math. Comput. Sci..

[3]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[4]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Neeraj Kumar,et al.  Deep learning models for traffic flow prediction in autonomous vehicles: A review, solutions, and challenges , 2019, Veh. Commun..

[6]  Hossam Faris,et al.  Binary grasshopper optimisation algorithm approaches for feature selection problems , 2019, Expert Syst. Appl..

[7]  Said Jadid Abdul Kadir,et al.  Binary Optimization Using Hybrid Grey Wolf Optimization for Feature Selection , 2019, IEEE Access.

[8]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[9]  Majdi M. Mafarja,et al.  Hybrid binary ant lion optimizer with rough set and approximate entropy reducts for feature selection , 2018, Soft Comput..

[10]  Witold Pedrycz,et al.  Modified binary particle swarm optimization , 2008 .

[11]  Ram Sarkar,et al.  Late Acceptance Hill Climbing Based Social Ski Driver Algorithm for Feature Selection , 2020, IEEE Access.

[12]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[13]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[14]  Hao Chen,et al.  A Heuristic Feature Selection Approach for Text Categorization by Using Chaos Optimization and Genetic Algorithm , 2013 .

[15]  Hossam Faris,et al.  An evolutionary gravitational search-based feature selection , 2019, Inf. Sci..

[16]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[17]  Hossein Nezamabadi-pour,et al.  BGSA: binary gravitational search algorithm , 2010, Natural Computing.

[18]  Marcin Blachnik,et al.  Ensembles of instance selection methods: A comparative study , 2019, Int. J. Appl. Math. Comput. Sci..

[19]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Marek Kowal,et al.  The Feature Selection Problem in Computer–Assisted Cytology , 2018, Int. J. Appl. Math. Comput. Sci..

[21]  Duoqian Miao,et al.  A rough set approach to feature selection based on ant colony optimization , 2010, Pattern Recognit. Lett..

[22]  Hossam Faris,et al.  Efficient Hybrid Nature-Inspired Binary Optimizers for Feature Selection , 2019, Cognitive Computation.

[23]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[24]  Zuren Feng,et al.  An efficient ant colony optimization approach to attribute reduction in rough set theory , 2008, Pattern Recognit. Lett..

[25]  Ram Sarkar,et al.  Introducing clustering based population in Binary Gravitational Search Algorithm for Feature Selection , 2020, Appl. Soft Comput..

[26]  Albert Y. Zomaya,et al.  A Hybrid Deep Learning-Based Model for Anomaly Detection in Cloud Datacenter Networks , 2019, IEEE Transactions on Network and Service Management.

[27]  Saeed Balochian,et al.  Social mimic optimization algorithm and engineering applications , 2019, Expert Syst. Appl..

[28]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[29]  Liying Wang,et al.  Manta ray foraging optimization: An effective bio-inspired optimizer for engineering applications , 2020, Eng. Appl. Artif. Intell..

[30]  Joel J. P. C. Rodrigues,et al.  Hybrid Deep-Learning-Based Anomaly Detection Scheme for Suspicious Flow Detection in SDN: A Social Multimedia Perspective , 2019, IEEE Transactions on Multimedia.

[31]  Ram Sarkar,et al.  Hybrid of Harmony Search Algorithm and Ring Theory-Based Evolutionary Algorithm for Feature Selection , 2020, IEEE Access.

[32]  Ujjwal Maulik,et al.  A two-stage approach towards protein secondary structure classification , 2020, Medical & Biological Engineering & Computing.

[33]  Ram Sarkar,et al.  Genetic algorithm based cancerous gene identification from microarray data using ensemble of filter methods , 2018, Medical & Biological Engineering & Computing.

[34]  Ram Sarkar,et al.  Embedded chaotic whale survival algorithm for filter–wrapper feature selection , 2020, Soft Computing.