Asynchronous accelerating multi-leader salp chains for feature selection

Abstract Feature selection is an imperative preprocessing step that can positively affect the performance of machine learning techniques. Searching for the optimal feature subset amongst an unabridged dataset is a challenging problem, especially for large-scale datasets. In this research, a binary Salp Swarm Algorithm (SSA) with asynchronous updating rules and a new leadership structure is proposed. To set the best leadership structure, several extensive experiments are performed to determine the most effective number of leaders in the social organization of the artificial salp chain. Inspired from the behavior of a termite colony (TC) in dividing the termites into four types, the salp chain is then divided into several sub-chains, where the salps in each sub-chain can follow a different strategy to adaptively update their locations. Three different updating strategies are employed in this paper. The proposed algorithm is tested and validated on 20 well-known datasets from the UCI repository. The results and comparisons verify that utilizing half of the salps as leaders of the chain can significantly improve the performance of SSA in terms of accuracy metric. Furthermore, dynamically tuning the single parameter of algorithm enable it to more effectively explore the search space in dealing with different feature selection datasets.

[1]  Xingjuan Cai.  A new modified PSO based on black stork foraging process , 2009, 2009 8th IEEE International Conference on Cognitive Informatics.

[2]  Manijeh Keshtgari,et al.  Termite colony optimization: A novel approach for optimizing continuous problems , 2010, 2010 18th Iranian Conference on Electrical Engineering.

[3]  Youxian Sun,et al.  Fault Diagnosis Based on Fuzzy Support Vector Machine with Parameter Tuning and Feature Selection , 2007 .

[4]  S. Gunasundari,et al.  Velocity Bounded Boolean Particle Swarm Optimization for improved feature selection in liver and kidney disease diagnosis , 2016, Expert Syst. Appl..

[5]  Hossam Faris,et al.  Grey wolf optimizer: a review of recent variants and applications , 2017, Neural Computing and Applications.

[6]  Hossam Faris,et al.  Improved monarch butterfly optimization for unconstrained global search and neural network training , 2018, Applied Intelligence.

[7]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[8]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[9]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[10]  Mohammed Aladeemy,et al.  A new hybrid approach for feature selection and support vector machine model selection based on self-adaptive cohort intelligence , 2017, Expert Syst. Appl..

[11]  Rahim Ali Abbaspour,et al.  Enhanced Chaotic Grey Wolf Optimizer for Real-World Optimization Problems: A Comparative Study , 2018 .

[12]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[13]  Zhihua Cui,et al.  An Improved PSO with Time-Varying Accelerator Coefficients , 2008, 2008 Eighth International Conference on Intelligent Systems Design and Applications.

[14]  Hossam Faris,et al.  Optimizing the Learning Process of Feedforward Neural Networks Using Lightning Search Algorithm , 2016, Int. J. Artif. Intell. Tools.

[15]  Hossam Faris,et al.  Simultaneous Feature Selection and Support Vector Machine Optimization Using the Grasshopper Optimization Algorithm , 2018, Cognitive Computation.

[16]  Salwani Abdullah,et al.  Fuzzy Population-Based Meta-Heuristic Approaches for Attribute Reduction in Rough Set Theory , 2015 .

[17]  Salwani Abdullah,et al.  Investigating memetic algorithm in solving rough set attribute reduction , 2013, Int. J. Comput. Appl. Technol..

[18]  Hossam Faris,et al.  A Hybrid Approach Based on Particle Swarm Optimization and Random Forests for E-Mail Spam Filtering , 2016, ICCCI.

[19]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[20]  Jing J. Liang,et al.  A self-adaptive global best harmony search algorithm for continuous optimization problems , 2010, Appl. Math. Comput..

[21]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[22]  Hossam Faris,et al.  Optimizing connection weights in neural networks using the whale optimization algorithm , 2016, Soft Computing.

[23]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[24]  Ibrahim Aljarah,et al.  A new clustering approach based on Glowworm Swarm Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Hiroshi Motoda,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998, The Springer International Series in Engineering and Computer Science.

[26]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[27]  Salwani Abdullah,et al.  Modified great deluge for attribute reduction in rough set theory , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[28]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[29]  Quan-Ke Pan,et al.  Self-adaptive fruit fly optimizer for global optimization , 2017, Natural Computing.

[30]  Zhang Dingxue,et al.  A Modified Particle Swarm Optimization with an Adaptive Acceleration Coefficients , 2009, 2009 Asia-Pacific Conference on Information Processing.

[31]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[32]  A. Rezaee Jordehi,et al.  An efficient chaotic water cycle algorithm for optimization tasks , 2015, Neural Computing and Applications.

[33]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[34]  Tapan Kumar Singh,et al.  Constrained self-adaptive genetic algorithm , 2016 .

[35]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[36]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[37]  Oscar Castillo,et al.  A Review of Fuzzy and Mathematic Methods for Dynamic Parameter Adaptation in the Firefly Algorithm , 2018, Advances in Data Analysis with Computational Intelligence Methods.

[38]  M. R. Delavar,et al.  A MODIFIED GENETIC ALGORITHM FOR FINDING FUZZY SHORTEST PATHS IN UNCERTAIN NETWORKS , 2016 .

[39]  A. Rezaee Jordehi,et al.  Gaussian bare-bones water cycle algorithm for optimal reactive power dispatch in electrical power systems , 2017, Appl. Soft Comput..

[40]  Parham Pahlavani,et al.  An efficient modified grey wolf optimizer with Lévy flight for optimization tasks , 2017, Appl. Soft Comput..

[41]  Crina Grosan,et al.  Feature Selection via Chaotic Antlion Optimization , 2016, PloS one.

[42]  Hossam Faris,et al.  Training feedforward neural networks using multi-verse optimizer for binary classification problems , 2016, Applied Intelligence.

[43]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[44]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[45]  Li Wang,et al.  A Robust Monte Carlo Tracking Algorithm Based on Feature Adaptive Selection , 2012, 2012 IEEE 12th International Conference on Computer and Information Technology.

[46]  Hossam Faris,et al.  Evolutionary static and dynamic clustering algorithms based on multi-verse optimizer , 2018, Eng. Appl. Artif. Intell..

[47]  Vlad Dafinescu,et al.  Parameter control and hybridization techniques in differential evolution: a survey , 2015, Artificial Intelligence Review.

[48]  Salwani Abdullah,et al.  A fuzzy record-to-record travel algorithm for solving rough set attribute reduction , 2015, Int. J. Syst. Sci..

[49]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[50]  Majdi M. Mafarja,et al.  S-Shaped vs. V-Shaped Transfer Functions for Ant Lion Optimization Algorithm in Feature Selection Problem , 2017, ICFNDS.

[51]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[52]  Hossam Faris,et al.  A multi-verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture , 2017, Neural Computing and Applications.

[53]  Guangqing Bao,et al.  Particle swarm optimization algorithm with asymmetric time varying acceleration coefficients , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[54]  Sven F. Crone,et al.  The impact of preprocessing on data mining: An evaluation of classifier sensitivity in direct marketing , 2006, Eur. J. Oper. Res..

[55]  Hossam M. Zawbaa,et al.  Feature selection based on antlion optimization algorithm , 2015, 2015 Third World Conference on Complex Systems (WCCS).

[56]  Rafael Bello,et al.  Two-Step Particle Swarm Optimization to Solve the Feature Selection Problem , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[57]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[58]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[59]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[60]  Irene Moser,et al.  A Systematic Literature Review of Adaptive Parameter Control Methods for Evolutionary Algorithms , 2016, ACM Comput. Surv..

[61]  Andrew Lewis,et al.  Autonomous Particles Groups for Particle Swarm Optimization , 2014 .

[62]  Hossam Faris,et al.  Training radial basis function networks using biogeography-based optimizer , 2018, Neural Computing and Applications.

[63]  Salwani Abdullah,et al.  Record-to-Record Travel algorithm for attribute reduction in rough set theory , 2013 .

[64]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[65]  Crina Grosan,et al.  Experienced Gray Wolf Optimization Through Reinforcement Learning and Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[66]  Hossam Faris,et al.  Optimizing Feedforward neural networks using Krill Herd algorithm for E-mail spam detection , 2015, 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[67]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..