Introducing clustering based population in Binary Gravitational Search Algorithm for Feature Selection

Abstract Feature Selection (FS) is an important aspect of knowledge extraction as it helps to reduce dimensionality of data. Among the numerous FS algorithms proposed over the years, Gravitational Search Algorithm (GSA) is a popular one which has been applied to various domains. However, GSA suffers from the problem of pre-mature convergence which affects exploration leading to performance degradation. To aid exploration, in the present work, we use a clustering technique in order to make the initial population distributed over the entire feature space and to increase the inclusion of features which are more promising. The proposed method is named Clustering based Population in Binary GSA (CPBGSA). To assess the performance of our proposed model, 20 standard UCI datasets are used, and the results are compared with some contemporary methods. It is observed that CPBGSA outperforms other methods in 12 out of 20 cases in terms of average classification accuracy. The relevant codes of the entire CPBGSA model can be found in the provided link: https://github.com/ManosijGhosh/Clustering-based-Population-in-Binary-GSA .

[1]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[2]  Mansour Sheikhan,et al.  Hybrid of binary gravitational search algorithm and mutual information for feature selection in intrusion detection systems , 2015, Soft Computing.

[3]  R. Tallarida,et al.  Chi-Square Test , 2020, Definitions.

[4]  Haider Banka,et al.  A Hamming distance based binary particle swarm optimization (HDBPSO) algorithm for high dimensional feature selection, classification and validation , 2015, Pattern Recognit. Lett..

[5]  Mita Nasipuri,et al.  Memetic Algorithm Based Feature Selection for Handwritten City Name Recognition , 2017, CICBA.

[6]  Mita Nasipuri,et al.  Feature Selection Using Histogram-Based Multi-objective GA for Handwritten Devanagari Numeral Recognition , 2018 .

[7]  Vikrant Bhateja,et al.  Deluge based Genetic Algorithm for feature selection , 2019, Evolutionary Intelligence.

[8]  Jin-Kao Hao,et al.  A memetic algorithm for gene selection and molecular classification of cancer , 2009, GECCO '09.

[9]  Marco Dorigo Ant colony optimization , 2004, Scholarpedia.

[10]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[11]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[12]  Mita Nasipuri,et al.  A GA based hierarchical feature selection approach for handwritten word recognition , 2019, Neural Computing and Applications.

[13]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[14]  Ram Sarkar,et al.  Feature selection for facial emotion recognition using late hill-climbing based memetic algorithm , 2019, Multimedia Tools and Applications.

[15]  Ram Sarkar,et al.  A wrapper-filter feature selection technique based on ant colony optimization , 2019, Neural Computing and Applications.

[16]  Zexuan Zhu,et al.  Markov blanket-embedded genetic algorithm for gene selection , 2007, Pattern Recognit..

[17]  Ruisheng Zhang,et al.  A BPSO-SVM algorithm based on memory renewal and enhanced mutation mechanisms for feature selection , 2017, Appl. Soft Comput..

[18]  Manuel Laguna,et al.  Tabu Search , 1997 .

[19]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[20]  A. Engelbrecht,et al.  A new locally convergent particle swarm optimiser , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[21]  Hossein Nezamabadi-pour,et al.  Feature subset selection using improved binary gravitational search algorithm , 2014, J. Intell. Fuzzy Syst..

[22]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[23]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[24]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[25]  Kathryn A. Dowsland,et al.  Simulated Annealing , 1989, Encyclopedia of GIS.

[26]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[27]  Hossein Nezamabadi-pour,et al.  BGSA: binary gravitational search algorithm , 2010, Natural Computing.

[28]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[29]  Hossein Nezamabadi-pour,et al.  A quantum-inspired gravitational search algorithm for binary encoded optimization problems , 2015, Eng. Appl. Artif. Intell..

[30]  Binjie Gu,et al.  MODIFIED GRAVITATIONAL SEARCH ALGORITHM WITH PARTICLE MEMORY ABILITY AND ITS APPLICATION , 2013 .

[31]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Igor Kononenko,et al.  Non-Myopic Feature Quality Evaluation with (R)ReliefF , 2007 .

[33]  Hossein Nezamabadi-pour,et al.  Disruption: A new operator in gravitational search algorithm , 2011, Sci. Iran..

[34]  Ujjwal Maulik,et al.  Recursive Memetic Algorithm for gene selection in microarray data , 2019, Expert Syst. Appl..

[35]  Ram Sarkar,et al.  Genetic algorithm based cancerous gene identification from microarray data using ensemble of filter methods , 2018, Medical & Biological Engineering & Computing.

[36]  Xin-She Yang,et al.  Binary bat algorithm , 2013, Neural Computing and Applications.

[37]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[38]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[39]  Joseph Culberson On the Futility of Blind Search , 1996 .