Feature selection based on chaotic binary black hole algorithm for data classification

Abstract With the advance of generating high-dimensional data, feature selection is the most significant procedure to guarantee selecting the most discriminative subset of features and to improve the classification performance. As a result, a binary black hole optimization algorithm (CBBHA) has been developed by getting inspired from natural phenomena. In this paper, the most discriminating features are selected by a new chaotic binary black hole algorithm (CBBHA) where chaotic maps embedded with movement of stars in the BBHA. Ten chaotic maps are employed. Experiments on three chemical datasets show the proposed algorithm, CBBHA, has an advantage over the standard BBHA in terms of selecting relevant features with a high classification performance. Additionally the performance of CBBHA is compared with BBHA in term of the computational time efficiency which is revealing that CBBHA outperforms the BBHA.

[1]  Abdelkader Benyettou,et al.  Gray Wolf Optimizer for hyperspectral band selection , 2016, Appl. Soft Comput..

[2]  Taher Niknam,et al.  Short-term scheduling of thermal power systems using hybrid gradient based modified teaching–learning optimizer with black hole algorithm , 2014 .

[3]  Xiang Yu,et al.  Study on the chaos anti-control technology in nonlinear vibration isolation system , 2008 .

[4]  Abdolreza Hatamlou,et al.  Solving travelling salesman problem using black hole algorithm , 2018, Soft Comput..

[5]  Yudong Zhang,et al.  Binary PSO with mutation operator for feature selection using decision tree applied to spam detection , 2014, Knowl. Based Syst..

[6]  Abdolreza Hatamlou,et al.  Solving optimization problems using black hole algorithm , 2015 .

[7]  Xin-She Yang,et al.  Binary Bat Algorithm for Feature Selection , 2013 .

[8]  Dunwei Gong,et al.  Binary differential evolution with self-learning for multi-objective feature selection , 2020, Inf. Sci..

[9]  Zakariya Yahya Algamal,et al.  Tuning parameter estimation in SCAD-support vector machine using firefly algorithm with application in gene selection and cancer classification , 2018, Comput. Biol. Medicine.

[10]  Hossam Faris,et al.  Binary dragonfly optimization for feature selection using time-varying transfer functions , 2018, Knowl. Based Syst..

[11]  Eduardo A. Castro,et al.  Predictive QSAR study of chalcone derivatives cytotoxicity activity against HT-29 human colon adenocarcinoma cell lines , 2014 .

[12]  Haithem Taha Mohammad Ali,et al.  A QSAR classification model for neuraminidase inhibitors of influenza A viruses (H1N1) based on weighted penalized support vector machine , 2017, SAR and QSAR in environmental research.

[13]  José García,et al.  Putting Continuous Metaheuristics to Work in Binary Search Spaces , 2017, Complex..

[14]  H. R. E. H. Bouchekara,et al.  Optimal power flow using black-hole-based optimization approach , 2014, Appl. Soft Comput..

[15]  Leandro dos Santos Coelho,et al.  Use of chaotic sequences in a biologically inspired algorithm for engineering design optimization , 2008, Expert Syst. Appl..

[16]  Sungkono,et al.  Black hole algorithm for determining model parameter in self-potential data , 2018 .

[17]  Hossam Faris,et al.  Binary grasshopper optimisation algorithm approaches for feature selection problems , 2019, Expert Syst. Appl..

[18]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[19]  Zakariya Yahya Algamal,et al.  Feature Selection Using Different Transfer Functions for Binary Bat Algorithm , 2020 .

[20]  Zakariya Yahya Algamal,et al.  A novel molecular descriptor selection method in QSAR classification model based on weighted penalized logistic regression , 2017 .

[21]  Kia Fallahi,et al.  An application of Chen system for secure chaotic communication based on extended Kalman filter and multi-shift cipher algorithm , 2008 .

[22]  Li-Yeh Chuang,et al.  Chaotic maps based on binary particle swarm optimization for feature selection , 2011, Appl. Soft Comput..

[23]  Nizamettin Aydin,et al.  Gene selection using hybrid binary black hole algorithm and modified binary particle swarm optimization. , 2019, Genomics.

[24]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[25]  Douglas Rodrigues,et al.  On the Study of Commercial Losses in Brazil: A Binary Black Hole Algorithm for Theft Characterization , 2018, IEEE Transactions on Smart Grid.

[26]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[27]  Hossam Faris,et al.  Dragonfly Algorithm: Theory, Literature Review, and Application in Feature Selection , 2019, Nature-Inspired Optimizers.

[28]  José Fco. Martínez-Trinidad,et al.  A review of unsupervised feature selection methods , 2019, Artificial Intelligence Review.

[29]  Aboul Ella Hassanien,et al.  Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection , 2018, Applied Intelligence.

[30]  O. Qasim,et al.  Two-Stage Gene Selection in Microarray Dataset Using Fuzzy Mutual Information and Binary Particle Swarm Optimization , 2019, Indian Journal of Forensic Medicine & Toxicology.

[31]  Nizamettin Aydin,et al.  Binary black hole algorithm for feature selection and classification on biological data , 2017, Appl. Soft Comput..

[32]  Wei Gao,et al.  Study on stability of high embankment slope based on black hole algorithm , 2016, Environmental Earth Sciences.

[33]  Hossein Momeni,et al.  Binary Black Holes Algorithm , 2013 .

[34]  Toshifumi Moriyama.  Calibration of spaceborne polarimetric SAR data using a genetic alogrithm , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[35]  Ying Xue,et al.  Quantitative structure–activity relationship study of influenza virus neuraminidase A/PR/8/34 (H1N1) inhibitors by genetic algorithm feature selection and support vector regression , 2013 .