Analysis of various transfer functions for binary owl search algorithm in feature selection problem

ABSTRACT Owl Search Algorithm (OSA) is a recently proposed nature-inspired meta-heuristic algorithm which is easily implementable and exhibits great potential for solving continuous optimization problems. In our earlier work, a binary version of owl search algorithm (BOSA), with transfer functions for mapping the continuous solution space into a binary one, has been developed and applied in optimal feature subset selection problem. In our preliminary simulation experiments, it was found that the performance of the solution depends on the type of transfer function used. In this work, an extensive analysis of various types of transfer functions and their respective effects on the selection of optimal feature subset has been studied by simulation experiments with multiple benchmark datasets. Transfer functions of three different families, S-shaped, V-shaped and quadratic, are used for designing eleven BOSA models, each of which is made by combining individual transfer function. The performances of the proposed wrapper based feature subset selection algorithm based on several BOSA models have been evaluated by simulation experiments with twenty datasets for finding out the best model. The best observed BOSA model has also been compared with other similar meta-heuristics algorithms for feature subset selection. Experimental results show that the feature subset selected by BOSA with quadratic transfer function produces the highest classification accuracy with the minimum number of selected features compared to other algorithms.

[1]  Basabi Chakraborty,et al.  Binary Owl Search Algorithm for Feature Subset Selection , 2019, 2019 IEEE 10th International Conference on Awareness Science and Technology (iCAST).

[2]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[3]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[4]  Fernando Fausto,et al.  From ants to whales: metaheuristics for all tastes , 2019, Artificial Intelligence Review.

[5]  José García,et al.  Putting Continuous Metaheuristics to Work in Binary Search Spaces , 2017, Complex..

[6]  Li-Yeh Chuang,et al.  Improved binary particle swarm optimization using catfish effect for feature selection , 2011, Expert Syst. Appl..

[7]  Hossam Faris,et al.  Binary grasshopper optimisation algorithm approaches for feature selection problems , 2019, Expert Syst. Appl..

[8]  M. Hariharan,et al.  Sine–cosine algorithm for feature selection with elitism strategy and new updating mechanism , 2017, Neural Comput. Appl..

[9]  Vijander Singh,et al.  Owl search algorithm: A novel nature-inspired heuristic paradigm for global optimization , 2018, J. Intell. Fuzzy Syst..

[10]  Hong Shen,et al.  Hamming distance and hop count based classification for multicast network topology inference , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[11]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[12]  S. C. Neoh,et al.  A Micro-GA Embedded PSO Feature Selection Approach to Intelligent Facial Emotion Recognition , 2017, IEEE Transactions on Cybernetics.

[13]  Erkan Ülker,et al.  An efficient binary social spider algorithm for feature selection problem , 2020, Expert Syst. Appl..

[14]  Yu Xue,et al.  A hybrid feature selection algorithm for gene expression data classification , 2017, Neurocomputing.

[15]  Adel Al-Jumaily,et al.  Feature subset selection using differential evolution and a statistical repair mechanism , 2011, Expert Syst. Appl..

[16]  Ayman M. Nabil,et al.  A chaotic owl search algorithm based bilateral negotiation model , 2020 .

[17]  Haider Banka,et al.  A Hamming distance based binary particle swarm optimization (HDBPSO) algorithm for high dimensional feature selection, classification and validation , 2015, Pattern Recognit. Lett..

[18]  Kun-Huang Chen,et al.  An improved particle swarm optimization for feature selection , 2011, Intell. Data Anal..

[19]  Verónica Bolón-Canedo,et al.  Recent advances and emerging challenges of feature selection in the context of big data , 2015, Knowl. Based Syst..

[20]  Yonghua Song,et al.  Providing a guaranteed power for the BTS in telecom tower based on improved balanced owl search algorithm , 2020 .

[21]  A. Rezaee Jordehi,et al.  Binary particle swarm optimisation with quadratic transfer function: A new binary optimisation algorithm for optimal scheduling of appliances in smart homes , 2019, Appl. Soft Comput..

[22]  Basabi Chakraborty,et al.  Rough fuzzy consistency measure with evolutionary algorithm for attribute reduction , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[23]  Luiz Eduardo Soares de Oliveira,et al.  A Methodology for Feature Selection Using Multiobjective Genetic Algorithms for Handwritten Digit String Recognition , 2003, Int. J. Pattern Recognit. Artif. Intell..

[24]  Nasser Ghasem-Aghaee,et al.  Text feature selection using ant colony optimization , 2009, Expert Syst. Appl..

[25]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[26]  V. Bajic,et al.  DWFS: A Wrapper Feature Selection Tool Based on a Parallel Genetic Algorithm , 2015, PloS one.

[27]  M. Nandhini,et al.  Optimal feature selection using binary teaching learning based optimization algorithm , 2018, J. King Saud Univ. Comput. Inf. Sci..

[28]  Aboul Ella Hassanien,et al.  Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection , 2018, Applied Intelligence.

[29]  Kazuyuki Murase,et al.  A new hybrid ant colony optimization algorithm for feature selection , 2012, Expert Syst. Appl..

[30]  Sankalap Arora,et al.  Binary butterfly optimization approaches for feature selection , 2019, Expert Syst. Appl..

[31]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[32]  Andries Petrus Engelbrecht,et al.  Binary differential evolution strategies , 2007, 2007 IEEE Congress on Evolutionary Computation.

[33]  Aboul Ella Hassanien,et al.  Chaotic multi-verse optimizer-based feature selection , 2017, Neural Computing and Applications.

[34]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[35]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[36]  Rasmita Dash,et al.  An Adaptive Harmony Search Approach for Gene Selection and Classification of High Dimensional Medical Data , 2018, J. King Saud Univ. Comput. Inf. Sci..

[37]  Crina Grosan,et al.  Feature Selection via Chaotic Antlion Optimization , 2016, PloS one.

[38]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[39]  K. Jermsittiparsert,et al.  A new optimized configuration for capacity and operation improvement of CCHP system based on developed owl search algorithm , 2020 .

[40]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[41]  K. Vijayakumar,et al.  An ACO–ANN based feature selection algorithm for big data , 2019, Cluster Computing.

[42]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[43]  Panos M. Pardalos,et al.  Feature selection based on meta-heuristics for biomedicine , 2014, Optim. Methods Softw..

[44]  Chengye Li,et al.  Gaussian mutational chaotic fruit fly-built optimization and feature selection , 2020, Expert Syst. Appl..

[45]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[46]  Nizamettin Aydin,et al.  Binary black hole algorithm for feature selection and classification on biological data , 2017, Appl. Soft Comput..

[47]  Ling Zheng,et al.  Self-adjusting harmony search-based feature selection , 2014, Soft Computing.

[48]  Ahmad Taher Azar,et al.  A novel hybrid feature selection method based on rough set and improved harmony search , 2015, Neural Computing and Applications.

[49]  Hossam Faris,et al.  Binary dragonfly optimization for feature selection using time-varying transfer functions , 2018, Knowl. Based Syst..

[50]  Yongquan Zhou,et al.  Binary Symbiotic Organism Search Algorithm for Feature Selection and Analysis , 2019, IEEE Access.

[51]  H. Hannah Inbarani,et al.  PSO-based feature selection and neighborhood rough set-based classification for BCI multiclass motor imagery task , 2017, Neural Computing and Applications.

[52]  Vikrant Bhateja,et al.  Deluge based Genetic Algorithm for feature selection , 2019, Evolutionary Intelligence.

[53]  Said Jadid Abdul Kadir,et al.  Binary Optimization Using Hybrid Grey Wolf Optimization for Feature Selection , 2019, IEEE Access.

[54]  Alaa F. Farhan,et al.  Maximum Power Point Tracking Technique Using Combined Perturb & Observe and Owl Search Algorithms , 2019, 2019 International Conference on Electrical and Computing Technologies and Applications (ICECTA).