A V-Shaped Binary Crow Search Algorithm for Feature Selection

Feature Selection (FS) is the process of identifying and separating relevant features of a dataset to obtain the best solutions for a pattern-classification or regression problem. The main benefits of FS include more accurate classification models, simplified interpretation of models and a reduction in the processing time required for classification. One of the main approaches used in FS involves wrappers. In this approach features are selected based on an evaluation performed by a classification algorithm. Recently, an optimization bio-inspired metaheuristic based on the intelligent behavior of crows called Crow Search Algorithm (CSA) has been proposed. CSA works based on the idea that crows store their excess food in hiding places and retrieve it when the food is needed. The main reasons of using CSA are its easy implementation, few control parameters to adjust, fast convergence speed and high efficiency. To further enhance the performance of the classical CSA algorithm, this paper proposes a new wrapper based in a “v-shaped” binarization of the CSA. The wrapper, which is referred to here as Binary CSA (BCSA), is applied to six benchmark data sets. The paper compares and discusses the advantages and disadvantages of the proposed technique in terms of classification accuracy, number of selected features and computational cost against some classical and state-of-art algorithms. The results were encouraging and showed that BCSA achieved very good results in terms of classification accuracy and also selected subsets with a small number of features with a relatively low computational cost.

[1]  Luis A. M. Pereira,et al.  A Binary Krill Herd Approach for Feature Selection , 2014, 2014 22nd International Conference on Pattern Recognition.

[2]  O. Güntürkün,et al.  Mirror-Induced Behavior in the Magpie (Pica pica): Evidence of Self-Recognition , 2008, PLoS biology.

[3]  Alireza Askarzadeh,et al.  Capacitor placement in distribution systems for power loss reduction and voltage improvement: a new methodology , 2016 .

[4]  Enrique Alba,et al.  Two hybrid wrapper-filter feature selection algorithms applied to high-dimensional microarray experiments , 2016, Appl. Soft Comput..

[5]  Zhiwei Ye,et al.  A feature selection method based on modified binary coded ant colony optimization algorithm , 2016, Appl. Soft Comput..

[6]  Gadadhar Sahoo,et al.  Crow search based virtual machine placement strategy in cloud data centers with live migration , 2017, Comput. Electr. Eng..

[7]  Russell D. Gray,et al.  Extraordinary large brains in tool-using New Caledonian crows (Corvus moneduloides) , 2008, Neuroscience Letters.

[8]  Haider Banka,et al.  A Hamming distance based binary particle swarm optimization (HDBPSO) algorithm for high dimensional feature selection, classification and validation , 2015, Pattern Recognit. Lett..

[9]  Zeynep Banu Ozger,et al.  A comparative study on binary Artificial Bee Colony optimization methods for feature selection , 2016, 2016 International Symposium on INnovations in Intelligent SysTems and Applications (INISTA).

[10]  Anupam Shukla,et al.  A survey of nature-inspired algorithms for feature selection to identify Parkinson's disease , 2017, Comput. Methods Programs Biomed..

[11]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[12]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[13]  Amr Badr,et al.  A binary clonal flower pollination algorithm for feature selection , 2016, Pattern Recognit. Lett..

[14]  Xin-She Yang,et al.  BCS: A Binary Cuckoo Search algorithm for feature selection , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[15]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[16]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[17]  Yudong Zhang,et al.  Binary PSO with mutation operator for feature selection using decision tree applied to spam detection , 2014, Knowl. Based Syst..

[18]  Leandro dos Santos Coelho,et al.  Improved differential evolution approach based on cultural algorithm and diversity measure applied to solve economic load dispatch problems , 2009, Math. Comput. Simul..

[19]  Mohammad-Reza Feizi-Derakhshi,et al.  Feature selection using Forest Optimization Algorithm , 2016, Pattern Recognit..

[20]  Nathan Emery,et al.  Corvid cognition , 2005, Current Biology.

[21]  Nicola S. Clayton,et al.  The Mentality of Crows: Convergent Evolution of Intelligence in Corvids and Apes , 2004, Science.

[22]  Leandro dos Santos Coelho,et al.  Modified crow search approach applied to electromagnetic optimization , 2016, 2016 IEEE Conference on Electromagnetic Field Computation (CEFC).

[23]  Abdollah Kavousi-Fard,et al.  A Hybrid Accurate Model for Tidal Current Prediction , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Xin-She Yang,et al.  BBA: A Binary Bat Algorithm for Feature Selection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[25]  João Miguel da Costa Sousa,et al.  Binary Fish School Search applied to feature selection: Application to ICU readmissions , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[26]  Mohit Chamania,et al.  Artificial Intelligence (AI) Methods in Optical Networks: A Comprehensive Survey , 2018, Opt. Switch. Netw..

[27]  Changhe Li,et al.  A survey of swarm intelligence for dynamic optimization: Algorithms and applications , 2017, Swarm Evol. Comput..

[28]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[29]  Christian Rutz,et al.  Hook innovation boosts foraging efficiency in tool-using crows , 2018, Nature Ecology & Evolution.

[30]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[31]  Mengjie Zhang,et al.  A binary ABC algorithm based on advanced similarity scheme for feature selection , 2015, Appl. Soft Comput..

[32]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[33]  Mengjie Zhang,et al.  Particle Swarm Optimisation with genetic operators for feature selection , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[34]  Yong Zhang,et al.  A PSO-based multi-objective multi-label feature selection method in classification , 2017, Scientific Reports.