Cooperative meta-heuristic algorithms for global optimization problems

Abstract This paper presents an alternative global optimization meta-heuristics (MHs) approach, inspired by the natural selection theory. The proposed approach depends on the competition among six MHs that allows generating an offspring, which can breed the high characteristics of parents since they are unique and competitive. Therefore, this leads to improve the convergence of the solutions towards an optimal solution and also, to avoid the limitations of other methods that aim to balance between exploitation and exploration. The six algorithms are differential evolution, whale optimization algorithm, grey wolf optimization, symbiotic organisms search algorithm, sine-cosine algorithm, and salp swarm algorithm. According to these algorithms, three variants of the proposed method are developed, in the first variant, one of the six algorithms will be used to update the current individual based on a predefined order and the probability of the fitness function for each individual. Whereas, the second variant updates each individual by permuting the six algorithms, then using the algorithms in the current permutation to update individuals. The third variant is considered as an extension of the second variant, which updates all individuals using only one algorithm from the six algorithms. Three different experiments are carried out using CEC 2014 and CEC 2017 benchmark functions to evaluate the efficiency of the proposed approach. Moreover, the proposed approach is compared with well known MH methods, including the six methods used to build it. Comparison results confirmed the efficiency of the proposed approach compared to other approaches according to different performance measures.

[1]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[2]  Farid Najafi,et al.  PSOSCALF: A new hybrid PSO based on Sine Cosine Algorithm and Levy flight for solving optimization problems , 2018, Appl. Soft Comput..

[3]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[4]  Matej Crepinsek,et al.  A note on teaching-learning-based optimization algorithm , 2012, Inf. Sci..

[5]  Vivek K. Patel,et al.  Adaptive symbiotic organisms search (SOS) algorithm for structural design optimization , 2016, J. Comput. Des. Eng..

[6]  D. Werner,et al.  Wind Driven Optimization (WDO): A novel nature-inspired optimization algorithm and its application to electromagnetics , 2010, 2010 IEEE Antennas and Propagation Society International Symposium.

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Neeraj Kumar Singh,et al.  A novel hybrid GWO-SCA approach for optimization problems , 2017 .

[10]  Kusum Deep,et al.  A Hybrid Harmony search and Simulated Annealing algorithm for continuous optimization , 2018, Inf. Sci..

[11]  Seyedali Mirjalili,et al.  Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems , 2015, Neural Computing and Applications.

[12]  Ibrahim Berkan Aydilek A hybrid firefly and particle swarm optimization algorithm for computationally expensive numerical problems , 2018, Appl. Soft Comput..

[13]  K. Muneeswaran,et al.  Firefly algorithm based feature selection for network intrusion detection , 2019, Comput. Secur..

[14]  Reza Moghdani,et al.  Volleyball Premier League Algorithm , 2018, Appl. Soft Comput..

[15]  Sanjay Kumar Malik,et al.  Chemical Reaction-Based Optimization Algorithm for Solving Clustering Problems , 2019 .

[16]  Tome Eftimov,et al.  A novel statistical approach for comparing meta-heuristic stochastic optimization algorithms according to the distribution of solutions in the search space , 2019, Inf. Sci..

[17]  Chaohua Dai,et al.  Seeker Optimization Algorithm , 2006, 2006 International Conference on Computational Intelligence and Security.

[18]  Xia Wang,et al.  A novel hybrid algorithm based on Biogeography-Based Optimization and Grey Wolf Optimizer , 2018, Appl. Soft Comput..

[19]  Shu-Cherng Fang,et al.  An Electromagnetism-like Mechanism for Global Optimization , 2003, J. Glob. Optim..

[20]  Victor O. K. Li,et al.  Chemical-Reaction-Inspired Metaheuristic for Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[21]  John R. Koza,et al.  Genetic programming as a means for programming computers by natural selection , 1994 .

[22]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[23]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[24]  Madhav J. Nigam,et al.  A hybrid grey wolf optimizer and artificial bee colony algorithm for enhancing the performance of complex systems , 2018, J. Comput. Sci..

[25]  Ali Husseinzadeh Kashan,et al.  League Championship Algorithm: A New Algorithm for Numerical Function Optimization , 2009, 2009 International Conference of Soft Computing and Pattern Recognition.

[26]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[27]  Chee Peng Lim,et al.  A modified Intelligent Water Drops algorithm and its application to optimization problems , 2014, Expert Syst. Appl..

[28]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[29]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[30]  Vijander Singh,et al.  A novel nature-inspired algorithm for optimization: Squirrel search algorithm , 2019, Swarm Evol. Comput..

[31]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[32]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[33]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[34]  Shafii Muhammad Abdulhamid,et al.  An efficient symbiotic organisms search algorithm with chaotic optimization strategy for multi-objective task scheduling problems in cloud computing environment , 2019, J. Netw. Comput. Appl..

[35]  Petr Bujok,et al.  Cooperative Model for Nature-Inspired Algorithms in Solving Real-World Optimization Problems , 2018, BIOMA.

[36]  Mohamed Abd Elaziz,et al.  Multilevel Thresholding for Image Segmentation Based on Metaheuristic Algorithms , 2019, Metaheuristic Algorithms for Image Segmentation: Theory and Applications.

[37]  Ricardo Landa Becerra,et al.  Efficient evolutionary optimization through the use of a cultural algorithm , 2004 .

[38]  K. V. Price,et al.  Differential evolution: a fast and simple numerical optimizer , 1996, Proceedings of North American Fuzzy Information Processing.

[39]  Zbigniew Michalewicz,et al.  Evolution Strategies and Other Methods , 1994 .

[40]  Nabil Neggaz,et al.  Face detection based on evolutionary Haar filter , 2019, Pattern Analysis and Applications.

[41]  Min-Yuan Cheng,et al.  Symbiotic Organisms Search: A new metaheuristic optimization algorithm , 2014 .

[42]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[43]  T. Ryan Gregory,et al.  Understanding Natural Selection: Essential Concepts and Common Misconceptions , 2009, Evolution: Education and Outreach.

[44]  Harish Sharma,et al.  Hybrid Artificial Bee Colony algorithm with Differential Evolution , 2017, Appl. Soft Comput..

[45]  Francisco Herrera,et al.  Since CEC 2005 competition on real-parameter optimisation: a decade of research, progress and comparative analysis’s weakness , 2017, Soft Comput..

[46]  Ezugwu E. Absalom,et al.  Symbiotic organisms search algorithm: Theory, recent advances and applications , 2019, Expert Syst. Appl..

[47]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[48]  Dumitru Baleanu,et al.  A new hybrid algorithm for continuous optimization problem , 2018 .

[49]  Songfeng Lu,et al.  Improved salp swarm algorithm based on particle swarm optimization for feature selection , 2018, Journal of Ambient Intelligence and Humanized Computing.

[50]  Keiichiro Yasuda,et al.  Primary study of spiral dynamics inspired optimization , 2011 .

[51]  Sakkayaphop Pravesjit A hybrid bat algorithm with natural-inspired algorithms for continuous optimization problem , 2015, Artificial Life and Robotics.

[52]  Mojtaba Tahani,et al.  Flow Regime Algorithm (FRA): a physics-based meta-heuristics algorithm , 2018, Knowledge and Information Systems.

[53]  Dervis Karaboga,et al.  On clarifying misconceptions when comparing variants of the Artificial Bee Colony Algorithm by offering a new implementation , 2015, Inf. Sci..

[54]  Naser Moosavian,et al.  Soccer league competition algorithm: A novel meta-heuristic algorithm for optimal design of water distribution networks , 2014, Swarm Evol. Comput..

[55]  Amer Draa,et al.  On the performances of the flower pollination algorithm - Qualitative and quantitative analyses , 2015, Appl. Soft Comput..

[56]  Mohammad Mahdi Paydar,et al.  Tree Growth Algorithm (TGA): A novel approach for solving optimization problems , 2018, Eng. Appl. Artif. Intell..

[57]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[58]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[59]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[60]  Ali Husseinzadeh Kashan,et al.  A new metaheuristic for optimization: Optics inspired optimization (OIO) , 2015, Comput. Oper. Res..

[61]  Hossam Faris,et al.  Automatic selection of hidden neurons and weights in neural networks using grey wolf optimizer based on a hybrid encoding scheme , 2019, International Journal of Machine Learning and Cybernetics.

[62]  E. Tanyildizi,et al.  Golden Sine Algorithm: A Novel Math-Inspired Algorithm , 2017 .

[63]  Anas A. Hadi,et al.  LSHADE-SPA memetic framework for solving large-scale optimization problems , 2018, Complex & Intelligent Systems.

[64]  Ahamad Tajudin Abdul Khader,et al.  Hybridizing cuckoo search algorithm with bat algorithm for global numerical optimization , 2018, The Journal of Supercomputing.

[65]  Dervis Karaboga,et al.  A novel clustering approach: Artificial Bee Colony (ABC) algorithm , 2011, Appl. Soft Comput..