Enhanced Crow Search Algorithm for Feature Selection

Abstract The crow search algorithm (CSA) is a recent metaheuristic inspired by the intelligent group behavior of crows. It has attracted the attention of many researchers because of its simplicity and easy implementation. However, it suffers from premature convergence because of its ability to balance between exploration and exploitation is weak. Therefore, we investigate in this paper, an enhanced version of CSA called by us ECSA as a wrapper feature selection method to extract the best feature subsets. This enhancement achieved by introducing three modifications to the original CSA to improve its performance. Firstly, we propose an adaptive awareness probability to enhance the balance between exploration and exploitation. Secondly, we replace the random choice of the crow to follow by the dynamic local neighborhood to guide the local search. Thirdly, we introduce a novel global search strategy to increase the global exploration capability of the crow. The performance of ECSA is measured using three performance metrics and statistical significance over 16 datasets from the UCI repository. The obtained results are compared with those of the original CSA and some state-of-the-art techniques in the literature. Experimental results showed that ECSA presents a better convergence speed and a better-quality solution.

[1]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[2]  Pengfei Duan,et al.  A Hybrid Method of Sine Cosine Algorithm and Differential Evolution for Feature Selection , 2017, ICONIP.

[3]  S. Kanmani,et al.  A hybrid algorithm using ant and bee colony optimization for feature selection and classification (AC-ABC Hybrid) , 2017, Swarm Evol. Comput..

[4]  Rasmita Dash,et al.  An Adaptive Harmony Search Approach for Gene Selection and Classification of High Dimensional Medical Data , 2018, J. King Saud Univ. Comput. Inf. Sci..

[5]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[6]  Satvir Singh,et al.  Butterfly optimization algorithm: a novel approach for global optimization , 2018, Soft Computing.

[7]  Gang Wang,et al.  A novel bacterial foraging optimization algorithm for feature selection , 2017, Expert Syst. Appl..

[8]  Juyang Weng,et al.  Efficient content-based image retrieval using automatic feature selection , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[9]  Manoj Kumar,et al.  Optimization of Feature Selection in Face Recognition System Using Differential Evolution and Genetic Algorithm , 2015, SocProS.

[10]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[11]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[12]  Eid Emary,et al.  Feature selection approach based on moth-flame optimization algorithm , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[13]  Sheng Zhang,et al.  Improved Crow Search Algorithm with Inertia Weight Factor and Roulette Wheel Selection Scheme , 2017, 2017 10th International Symposium on Computational Intelligence and Design (ISCID).

[14]  Nadeem Javaid,et al.  Enhanced Differential Evolution and Crow Search Algorithm Based Home Energy Management in Smart Grid , 2017, BWCCA.

[15]  Amir H. Gandomi,et al.  CCSA: Conscious Neighborhood-based Crow Search Algorithm for Solving Global Optimization Problems , 2019, Appl. Soft Comput..

[16]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[17]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[18]  Chee Peng Lim,et al.  Feature selection based on brain storm optimization for data classification , 2019, Appl. Soft Comput..

[19]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[20]  Huan Liu,et al.  Customer Retention via Data Mining , 2000, Artificial Intelligence Review.

[21]  Mohamed Elhoseny,et al.  Feature selection based on artificial bee colony and gradient boosting decision tree , 2019, Appl. Soft Comput..

[22]  M. Hariharan,et al.  Sine–cosine algorithm for feature selection with elitism strategy and new updating mechanism , 2017, Neural Comput. Appl..

[23]  Abdul Rahim Abdullah,et al.  A New Competitive Binary Grey Wolf Optimizer to Solve the Feature Selection Problem in EMG Signals Classification , 2018, Comput..

[24]  Diego Oliva,et al.  An improved Opposition-Based Sine Cosine Algorithm for global optimization , 2017, Expert Syst. Appl..

[25]  S. B. Singh,et al.  Hybrid Algorithm of Particle Swarm Optimization and Grey Wolf Optimizer for Improving Convergence Performance , 2017, J. Appl. Math..

[26]  Hossam M. Zawbaa,et al.  Feature selection approach based on whale optimization algorithm , 2017, 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI).

[27]  Nacira Ghoualmi Zine,et al.  Hybrid Artificial Bees Colony and Particle Swarm on Feature Selection , 2018, CIIA.

[28]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[29]  Asif Ekbal,et al.  Joint model for feature selection and parameter optimization coupled with classifier ensemble in chemical mention recognition , 2015, Knowl. Based Syst..

[30]  Asif Ekbal,et al.  Differential evolution-based feature selection technique for anaphora resolution , 2015, Soft Comput..

[31]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[32]  Erik Cuevas,et al.  An Improved Crow Search Algorithm Applied to Energy Problems , 2018 .

[33]  Mengjie Zhang,et al.  A binary ABC algorithm based on advanced similarity scheme for feature selection , 2015, Appl. Soft Comput..

[34]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  Xin-She Yang,et al.  BBA: A Binary Bat Algorithm for Feature Selection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[37]  Neeraj Kumar Singh,et al.  A novel hybrid GWO-SCA approach for optimization problems , 2017 .

[38]  Hossam Faris,et al.  Efficient Hybrid Nature-Inspired Binary Optimizers for Feature Selection , 2019, Cognitive Computation.

[39]  Saptarsi Goswami,et al.  Feature selection using differential evolution with binary mutation scheme , 2016, 2016 International Conference on Microelectronics, Computing and Communications (MicroCom).

[40]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[41]  Changhe Li,et al.  Particle swarm optimisation with simple and efficient neighbourhood search strategies , 2011 .

[42]  Leandro dos Santos Coelho,et al.  Modified crow search approach applied to electromagnetic optimization , 2016, 2016 IEEE Conference on Electromagnetic Field Computation (CEFC).

[43]  Hossam Faris,et al.  Asynchronous accelerating multi-leader salp chains for feature selection , 2018, Appl. Soft Comput..

[44]  Leandro dos Santos Coelho,et al.  A V-Shaped Binary Crow Search Algorithm for Feature Selection , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[45]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[46]  Nadeem Javaid,et al.  A Hybrid Bat-Crow Search Algorithm Based Home Energy Management in Smart Grid , 2018, CISIS.

[47]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[48]  Harpreet Singh,et al.  A New Hybrid Algorithm Based on Grey Wolf Optimization and Crow Search Algorithm for Unconstrained Function Optimization and Feature Selection , 2019, IEEE Access.

[49]  Ragab A. El-Sehiemy,et al.  Optimal allocation of capacitor devices on MV distribution networks using crow search algorithm , 2017 .

[50]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[51]  Sankalap Arora,et al.  Binary butterfly optimization approaches for feature selection , 2019, Expert Syst. Appl..

[52]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[53]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[54]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[55]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[56]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[57]  Santosh Kumar Majhi,et al.  Oppositional Crow Search Algorithm with mutation operator for global optimization and application in designing FOPID controller , 2019, Evol. Syst..

[58]  Salvatore J. Stolfo,et al.  Adaptive Intrusion Detection: A Data Mining Approach , 2000, Artificial Intelligence Review.

[59]  Yanming Fu,et al.  Crow Search Algorithm Based on Neighborhood Search of Non-Inferior Solution Set , 2019, IEEE Access.

[60]  Aboul Ella Hassanien,et al.  A hybrid crow search algorithm based on rough searching scheme for solving engineering optimization problems , 2018, Journal of Ambient Intelligence and Humanized Computing.

[61]  Masoud Nikravesh,et al.  Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing) , 2006 .

[62]  Li-Yeh Chuang,et al.  A hybrid feature selection method for DNA microarray data , 2011, Comput. Biol. Medicine.

[63]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[64]  Michael I. Jordan,et al.  Feature selection for high-dimensional genomic microarray data , 2001, ICML.