A novel chaotic selfish herd optimizer for global optimization and feature selection

Selfish Herd Optimizer (SHO) is a recently proposed population-based metaheuristic inspired by the predatory interactions of herd and predators. It has been proved that SHO can provide competitive results in comparison to other well-known metaheuristics on various optimization problems. Like other metaheuristic algorithms, the main problem faced by the SHO is that it may easily get trapped into local optimal solutions, creating low precision and slow convergence speeds. Therefore, in order to enhance the global convergence speeds, and to obtain better performance, chaotic search have been augmented to searching process of SHO. Various chaotic maps were considered in the proposed Chaotic Selfish Herd Optimizer (CSHO) algorithm in order to replace the value of survival parameter of each searching agent which assists in controlling both exploration and exploitation. The performance of the proposed CSHO is compared with recent high performing meta-heuristics on 13 benchmark functions having unimodal and multimodal properties. Additionally the performance of CSHO as a feature selection approach is compared with various state-of-the-art feature selection approaches. The simulation results demonstrated that the chaotic maps (especially tent map) are able to significantly boost the performance of SHO. Moreover, the results clearly indicated the competency of CSHO in achieving the optimal feature subset by accomplishing maximum accuracy and a minimum number of features.

[1]  Ardeshir Bahreininejad,et al.  Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems , 2013, Appl. Soft Comput..

[2]  Meikang Qiu,et al.  The Effects of Using Chaotic Map on Improving the Performance of Multiobjective Evolutionary Algorithms , 2014 .

[3]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[4]  Kazuyuki Murase,et al.  A new local search based hybrid genetic algorithm for feature selection , 2011, Neurocomputing.

[5]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[6]  Tamer Ölmez,et al.  A new metaheuristic for numerical function optimization: Vortex Search algorithm , 2015, Inf. Sci..

[7]  Himani Joshi,et al.  Enhanced Grey Wolf Optimization Algorithm for Global Optimization , 2017, Fundam. Informaticae.

[8]  Jonathan J. H. Zhu,et al.  Controllability of Weighted and Directed Networks with Nonidentical Node Dynamics , 2013 .

[9]  Crina Grosan,et al.  Feature Selection via Chaotic Antlion Optimization , 2016, PloS one.

[10]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[11]  Salwani Abdullah,et al.  A fuzzy record-to-record travel algorithm for solving rough set attribute reduction , 2015, Int. J. Syst. Sci..

[12]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[13]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[14]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[15]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[16]  Bilal Alatas,et al.  Chaotic bee colony algorithms for global numerical optimization , 2010, Expert Syst. Appl..

[17]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[18]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[19]  A. Rezaee Jordehi,et al.  Chaotic bat swarm optimisation (CBSO) , 2015, Appl. Soft Comput..

[20]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[21]  Yaochu Jin,et al.  Feature selection for high-dimensional classification using a competitive swarm optimizer , 2016, Soft Computing.

[22]  Yasir Hamid,et al.  Feature selection techniques for intrusion detection using non-bio-inspired and bio-inspired optimization algorithms , 2017, Journal of Communications and Information Networks.

[23]  Andrew Lewis,et al.  Biogeography-based optimisation with chaos , 2014, Neural Computing and Applications.

[24]  Andrew Lewis,et al.  Evolutionary Population Dynamics and Multi-Objective Optimisation Problems , 2008 .

[25]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[26]  R. G. Fenton,et al.  A MIXED INTEGER-DISCRETE-CONTINUOUS PROGRAMMING METHOD AND ITS APPLICATION TO ENGINEERING DESIGN OPTIMIZATION , 1991 .

[27]  Gehad Ismael,et al.  Feature selection via a novel chaotic crow search algorithm , 2017 .

[28]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[29]  S. Arora,et al.  Node Localization in Wireless Sensor Networks Using Butterfly Optimization Algorithm , 2017, Arabian Journal for Science and Engineering.

[30]  Di He,et al.  Chaotic characteristics of a one-dimensional iterative map with infinite collapses , 2001 .

[31]  Xin-She Yang,et al.  Flower pollination algorithm: A novel approach for multiobjective optimization , 2014, ArXiv.

[32]  Anis Naanaa,et al.  Fast chaotic optimization algorithm based on spatiotemporal maps for global optimization , 2015, Appl. Math. Comput..

[33]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[34]  Alexander Hapfelmeier,et al.  Nonparametric Subgroup Identification by PRIM and CART: A Simulation and Application Study , 2017, Comput. Math. Methods Medicine.

[35]  Salwani Abdullah,et al.  Record-to-Record Travel algorithm for attribute reduction in rough set theory , 2013 .

[36]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[37]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[38]  Qiang Li,et al.  An Enhanced Grey Wolf Optimization Based Feature Selection Wrapped Kernel Extreme Learning Machine for Medical Diagnosis , 2017, Comput. Math. Methods Medicine.

[39]  Sankalap Arora,et al.  Chaos-enhanced flower pollination algorithms for global optimization , 2017, J. Intell. Fuzzy Syst..

[40]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[41]  Sankalap Arora,et al.  Binary butterfly optimization approaches for feature selection , 2019, Expert Syst. Appl..

[42]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[43]  Amir Hossein Gandomi,et al.  Chaotic bat algorithm , 2014, J. Comput. Sci..

[44]  Sankalap Arora,et al.  Chaotic whale optimization algorithm , 2018, J. Comput. Des. Eng..

[45]  Mohamed H. Haggag,et al.  A novel chaotic salp swarm algorithm for global optimization and feature selection , 2018, Applied Intelligence.

[46]  Javad Alikhani Koupaei,et al.  A new optimization algorithm based on chaotic maps and golden section search method , 2016, Eng. Appl. Artif. Intell..

[47]  Chen Tian-Lun,et al.  Application of Chaos in Genetic Algorithms , 2002 .

[48]  Erik Valdemar Cuevas Jiménez,et al.  A global optimization algorithm inspired in the behavior of selfish herds , 2017, Biosyst..

[49]  G. Cheng,et al.  On the efficiency of chaos optimization algorithms for global optimization , 2007 .

[50]  A. Rezaee Jordehi,et al.  An efficient chaotic water cycle algorithm for optimization tasks , 2015, Neural Computing and Applications.

[51]  Hao Chen,et al.  A Heuristic Feature Selection Approach for Text Categorization by Using Chaos Optimization and Genetic Algorithm , 2013 .

[52]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2015 Special Session on Bound Constrained Single-Objective Computationally Expensive Numerical Optimization , 2015 .

[53]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[54]  Xin-She Yang,et al.  Firefly algorithm with chaos , 2013, Commun. Nonlinear Sci. Numer. Simul..

[55]  Satvir Singh,et al.  An improved butterfly optimization algorithm with chaos , 2017, J. Intell. Fuzzy Syst..

[56]  Huaguang Zhang,et al.  Chaotic Dynamics in Smart Grid and Suppression Scheme via Generalized Fuzzy Hyperbolic Model , 2014 .

[57]  MirjaliliSeyedali Moth-flame optimization algorithm , 2015 .

[58]  Xin-She Yang,et al.  Chaos-enhanced accelerated particle swarm optimization , 2013, Commun. Nonlinear Sci. Numer. Simul..

[59]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[60]  Amr Badr,et al.  A binary clonal flower pollination algorithm for feature selection , 2016, Pattern Recognit. Lett..

[61]  Sankalap Arora,et al.  Chaotic grey wolf optimization algorithm for constrained optimization problems , 2018, J. Comput. Des. Eng..

[62]  Hossam Faris,et al.  Feature Selection Using Salp Swarm Algorithm with Chaos , 2018, ISMSI '18.

[63]  Pradipta Kishore Dash,et al.  A self adaptive differential harmony search based optimized extreme learning machine for financial time series prediction , 2014, Swarm Evol. Comput..

[64]  Louis M Pecora,et al.  Synchronization of chaotic systems. , 2015, Chaos.

[65]  B. Alatas Uniform Big Bang–Chaotic Big Crunch optimization , 2011 .

[66]  MirjaliliSeyedali,et al.  Grasshopper Optimisation Algorithm , 2017 .

[67]  Kwang Ryel Ryu,et al.  A Dual-Population Genetic Algorithm for Adaptive Diversity Control , 2010, IEEE Transactions on Evolutionary Computation.

[68]  Satvir Singh,et al.  An Effective Hybrid Butterfly Optimization Algorithm with Artificial Bee Colony for Numerical Optimization , 2017, Int. J. Interact. Multim. Artif. Intell..

[69]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[70]  Ana Carolina Olivera,et al.  A Parallel Discrete Firefly Algorithm on GPU for Permutation Combinatorial Optimization Problems , 2014, CARLA.

[71]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[72]  B. Alatas,et al.  Chaos embedded particle swarm optimization algorithms , 2009 .

[73]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[74]  Shifali Kalra,et al.  Firefly Algorithm Hybridized with Flower Pollination Algorithm for Multimodal Functions , 2016 .

[75]  Satvir Singh,et al.  Butterfly optimization algorithm: a novel approach for global optimization , 2018, Soft Computing.

[76]  Aboul Ella Hassanien,et al.  Binary ant lion approaches for feature selection , 2016, Neurocomputing.

[77]  Sankalap Arora,et al.  Chaotic grasshopper optimization algorithm for global optimization , 2019, Neural Computing and Applications.

[78]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[79]  Rossitza Setchi,et al.  Feature selection using Joint Mutual Information Maximisation , 2015, Expert Syst. Appl..