An Improved Butterfly Optimization Algorithm for Engineering Design Problems Using the Cross-Entropy Method

Engineering design optimization in real life is a challenging global optimization problem, and many meta-heuristic algorithms have been proposed to obtain the global best solutions. An excellent meta-heuristic algorithm has two symmetric search capabilities: local search and global search. In this paper, an improved Butterfly Optimization Algorithm (BOA) is developed by embedding the cross-entropy (CE) method into the original BOA. Based on a co-evolution technique, this new method achieves a proper balance between exploration and exploitation to enhance its global search capability, and effectively avoid it falling into a local optimum. The performance of the proposed approach was evaluated on 19 well-known benchmark test functions and three classical engineering design problems. The results of the test functions show that the proposed algorithm can provide very competitive results in terms of improved exploration, local optima avoidance, exploitation, and convergence rate. The results of the engineering problems prove that the new approach is applicable to challenging problems with constrained and unknown search spaces.

[1]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[2]  Benjamin Peherstorfer,et al.  Multifidelity Preconditioning of the Cross-Entropy Method for Rare Event Simulation and Failure Probability Estimation , 2018, SIAM/ASA J. Uncertain. Quantification.

[3]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[4]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[5]  S. Goldfeld,et al.  Maximization by Quadratic Hill-Climbing , 1966 .

[6]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[7]  Yaroslav D. Sergeyev,et al.  GOSH: derivative-free global optimization using multi-dimensional space-filling curves , 2018, J. Glob. Optim..

[8]  Satvir Singh,et al.  An Improved Butterfly Optimization Algorithm for Global Optimization , 2016 .

[9]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010 .

[10]  Ling Wang,et al.  An effective co-evolutionary differential evolution for constrained optimization , 2007, Appl. Math. Comput..

[11]  Tapan Kumar Roy,et al.  NS-Cross Entropy-Based MAGDM under Single-Valued Neutrosophic Set Environment , 2018, Inf..

[12]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[13]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[14]  Yaroslav D. Sergeyev,et al.  A deterministic global optimization using smooth diagonal auxiliary functions , 2015, Commun. Nonlinear Sci. Numer. Simul..

[15]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[16]  Xiaohui Hu,et al.  Engineering optimization with particle swarm , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[17]  Tito Homem-de-Mello,et al.  Solving the Vehicle Routing Problem with Stochastic Demands using the Cross-Entropy Method , 2005, Ann. Oper. Res..

[18]  Dirk P. Kroese,et al.  The Cross-Entropy Method for Continuous Multi-Extremal Optimization , 2006 .

[19]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[20]  R. Rubinstein.  The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[21]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[22]  Chris Aldrich,et al.  The cross-entropy method in multi-objective optimisation: An assessment , 2011, Eur. J. Oper. Res..

[23]  Saeid Abbasbandy,et al.  Improving Newton-Raphson method for nonlinear equations by modified Adomian decomposition method , 2003, Appl. Math. Comput..

[24]  Xin-She Yang,et al.  Bat algorithm based on simulated annealing and Gaussian perturbations , 2013, Neural Computing and Applications.

[25]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[26]  S. Arora,et al.  Node Localization in Wireless Sensor Networks Using Butterfly Optimization Algorithm , 2017, Arabian Journal for Science and Engineering.

[27]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[28]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[29]  Xin-She Yang,et al.  Cuckoo search: recent advances and applications , 2013, Neural Computing and Applications.

[30]  Qinyu Zhang,et al.  Cross-Entropy-Based Energy-Efficient Radio Resource Management in HetNets with Coordinated Multiple Points , 2016, Inf..

[31]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[32]  Ya D Sergeyev,et al.  On the efficiency of nature-inspired metaheuristics in expensive global optimization with limited budget , 2018, Scientific Reports.

[33]  Xinsheng Lai,et al.  An efficient ensemble of GA and PSO for real function optimization , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[34]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[35]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[36]  Siti Zaiton Mohd Hashim,et al.  A New Hybrid Firefly Algorithm for Complex and Nonlinear Problem , 2012, DCAI.

[37]  Antanas Zilinskas,et al.  Performance of global random search algorithms for large dimensions , 2018, J. Glob. Optim..

[38]  S. Mirjalili,et al.  A new hybrid PSOGSA algorithm for function optimization , 2010, 2010 International Conference on Computer and Information Application.

[39]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[40]  Mohammad-Reza Feizi-Derakhshi,et al.  Forest Optimization Algorithm , 2014, Expert Syst. Appl..

[41]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[42]  Shalabh Bhatnagar,et al.  An online prediction algorithm for reinforcement learning with linear function approximation using cross entropy method , 2018, Machine Learning.

[43]  Antanas Zilinskas,et al.  Stochastic Global Optimization: A Review on the Occasion of 25 Years of Informatica , 2016, Informatica.

[44]  Ayesha Khan,et al.  Ensemble Based Classification of Sentiments Using Forest Optimization Algorithm , 2019, Data.

[45]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[46]  Satvir Singh,et al.  Butterfly algorithm with Lèvy Flights for global optimization , 2015, 2015 International Conference on Signal Processing, Computing and Control (ISPCC).

[47]  Amir Hossein Gandomi,et al.  Bat algorithm for constrained optimization tasks , 2012, Neural Computing and Applications.

[48]  Przemyslaw Ignaciuk,et al.  Continuous Genetic Algorithms as Intelligent Assistance for Resource Distribution in Logistic Systems , 2018, Data.

[49]  Satvir Singh,et al.  Butterfly optimization algorithm: a novel approach for global optimization , 2018, Soft Computing.

[50]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[51]  Keyun Qin,et al.  The Consistency between Cross-Entropy and Distance Measures in Fuzzy Sets , 2019, Symmetry.

[52]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.