Improved grey wolf optimization based on the two-stage search of hybrid CMA-ES

Hybrid algorithms with different features are an important trend in algorithm improvement. In this paper, an improved grey wolf optimization based on the two-stage search of hybrid covariance matrix adaptation-evolution strategy (CMA-ES) is proposed to overcome the shortcomings of the original grey wolf optimization that easily falls into the local minima when solving complex optimization problems. First, the improved algorithm divides the whole search process into two stages. In the first stage, the improved algorithm makes full use of the global search ability of grey wolf optimization on a large scale and thoroughly explores the location of the optimal solution. In the second stage, due to CMA-ES having a strong local search capability, the three CMA-ES instances use the α wolf, β wolf and δ wolf as the starting points. In addition, these instances have different step size for parallel local exploitations. Second, in order to make full use of the global search ability of the grey wolf algorithm, the Beta distribution is used to generate as much of an initial population as possible in the non-edge region of the solution space. Third, the new algorithm improves the hunting formula of the grey wolf algorithm, which increases the diversity of the population through the interference of other individuals and reduces the use of the head wolf’s guidance to the population. Finally, the new algorithm is quantitatively evaluated by fifteen standard benchmark functions, five test functions of CEC 2014 suite and two engineering design cases. The results show that the improved algorithm significantly improves the convergence, robustness and efficiency for solving complex optimization problems compared with other six well-known optimization algorithms.

[1]  Xiang Wang,et al.  A multilevel coordinate search algorithm for well placement, control and joint optimization , 2015, Comput. Chem. Eng..

[2]  Rajesh Kumar,et al.  β-Chaotic map enabled Grey Wolf Optimizer , 2019, Appl. Soft Comput..

[3]  Provas Kumar Roy,et al.  Grey wolf optimization applied to economic load dispatch problems , 2016 .

[4]  Günther R. Raidi.  A unified view on hybrid metaheuristics , 2006 .

[5]  Andries Petrus Engelbrecht,et al.  Measuring exploration/exploitation in particle swarms using swarm diversity , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[6]  L. Suganthi,et al.  Hybrid GA-PSO Optimization of Artificial Neural Network for Forecasting Electricity Demand , 2018 .

[7]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[8]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[9]  James T. Lin,et al.  A hybrid particle swarm optimization with local search for stochastic resource allocation problem , 2018, J. Intell. Manuf..

[10]  Juan Xie,et al.  A Hybrid Social Spider Optimization Algorithm with Differential Evolution for Global Optimization , 2017, J. Univers. Comput. Sci..

[11]  Wang Baoyi,et al.  Research on Personnel Information Collaborative Sensing Method of Intelligent Building Based on CPS , 2019 .

[12]  J. Anitha,et al.  Optimum laplacian wavelet mask based medical image using hybrid cuckoo search - grey wolf optimization algorithm , 2017, Knowl. Based Syst..

[13]  Kusum Deep,et al.  Cauchy Grey Wolf Optimiser for continuous optimisation problems , 2018, J. Exp. Theor. Artif. Intell..

[14]  Aboul Ella Hassanien,et al.  New Rough Set Attribute Reduction Algorithm Based on Grey Wolf Optimization , 2015, AISI.

[15]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[16]  S. B. Singh,et al.  Hybrid Algorithm of Particle Swarm Optimization and Grey Wolf Optimizer for Improving Convergence Performance , 2017, J. Appl. Math..

[17]  K. Baskaran,et al.  Genetic Grey Wolf Optimizer Based Channel Estimation in Wireless Communication System , 2018, Wirel. Pers. Commun..

[18]  Marcelo Seido Nagano,et al.  A high quality solution constructive heuristic for flow shop sequencing , 2002, J. Oper. Res. Soc..

[19]  Kusum Deep,et al.  A novel Random Walk Grey Wolf Optimizer , 2019, Swarm Evol. Comput..

[20]  Tao Li,et al.  Particle swarm optimizer with crossover operation , 2018, Eng. Appl. Artif. Intell..

[21]  Emerson H. V. Segundo,et al.  Modified Social-Spider Optimization Algorithm Applied to Electromagnetic Optimization , 2016, IEEE Transactions on Magnetics.

[22]  Mike Preuss,et al.  Niching the CMA-ES via nearest-better clustering , 2010, GECCO '10.

[23]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[24]  Xin-She Yang,et al.  New directional bat algorithm for continuous optimization problems , 2017, Expert Syst. Appl..

[25]  Abdelkader Benyettou,et al.  Gray Wolf Optimizer for hyperspectral band selection , 2016, Appl. Soft Comput..

[26]  Rui Chi,et al.  A hybridization of cuckoo search and particle swarm optimization for solving optimization problems , 2017, Neural Computing and Applications.

[27]  Vikram Kumar Kamboj,et al.  Solution of non-convex economic load dispatch problem using Grey Wolf Optimizer , 2015, Neural Computing and Applications.

[28]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[29]  Haipeng Peng,et al.  Topology Identification of Complex Network via Chaotic Ant Swarm Algorithm , 2013 .

[30]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[31]  Kusum Deep,et al.  Random walk grey wolf optimizer for constrained engineering optimization problems , 2018, Comput. Intell..

[32]  Masahito Yamamoto,et al.  Attraction basin sphere estimation approach for niching CMA-ES , 2017, Soft Comput..

[33]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[34]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[35]  Siti Zaiton Mohd Hashim,et al.  Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm , 2012, Appl. Math. Comput..

[36]  Chris Drummond,et al.  Reproducible research: a minority opinion , 2018, J. Exp. Theor. Artif. Intell..

[37]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[38]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[39]  Juhyung Kim,et al.  Development of Easily Accessible Electricity Consumption Model Using Open Data and GA-SVR , 2018 .

[40]  Ibrahim Berkan Aydilek.  A hybrid firefly and particle swarm optimization algorithm for computationally expensive numerical problems , 2018, Appl. Soft Comput..

[41]  P. Borne,et al.  Lyapunov analysis of sliding motions: Application to bounded control , 1996 .

[42]  Jun Wu,et al.  Hybridizing grey wolf optimization with differential evolution for global optimization and test scheduling for 3D stacked SoC , 2015 .

[43]  Kusum Deep,et al.  An opposition-based chaotic Grey Wolf Optimizer for global optimisation tasks , 2018, J. Exp. Theor. Artif. Intell..

[44]  Vinicius Veloso de Melo,et al.  A modified Covariance Matrix Adaptation Evolution Strategy with adaptive penalty function and restart for constrained optimization , 2014, Expert Syst. Appl..