Adaptive Multi-Level Search for Global Optimization: An Integrated Swarm Intelligence-Metamodelling Technique

Over the last decade, metaheuristic algorithms have emerged as a powerful paradigm for global optimization of multimodal functions formulated by nonlinear problems arising from various engineering subjects. However, numerical analyses of many complex engineering design problems may be performed using finite element method (FEM) or computational fluid dynamics (CFD), by which function evaluations of population-based algorithms are repetitively computed to seek a global optimum. It is noted that these simulations become computationally prohibitive for design optimization of complex structures. To efficiently and effectively address this class of problems, an adaptively integrated swarm intelligence-metamodelling (ASIM) technique enabling multi-level search and model management for the optimal solution is proposed in this paper. The developed technique comprises two steps: in the first step, a global-level exploration for near optimal solution is performed by adaptive swarm-intelligence algorithm, and in the second step, a local-level exploitation for the fine optimal solution is studied on adaptive metamodels, which are constructed by the multipoint approximation method (MAM). To demonstrate the superiority of the proposed technique over other methods, such as conventional MAM, particle swarm optimization, hybrid cuckoo search, and water cycle algorithm in terms of computational expense associated with solving complex optimization problems, one benchmark mathematical example and two real-world complex design problems are examined. In particular, the key factors responsible for the balance between exploration and exploitation are discussed as well.

[1]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[2]  Yafei Huang,et al.  An effective hybrid cuckoo search algorithm for constrained global optimization , 2014, Neural Computing and Applications.

[3]  Rehan Ahmad,et al.  Review on Image Enhancement Techniques Using Biologically Inspired Artificial Bee Colony Algorithms and Its Variants , 2018 .

[4]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[5]  Jiachen Wang,et al.  Heterogeneous comprehensive learning and dynamic multi-swarm particle swarm optimizer with two mutation operators , 2020, Inf. Sci..

[6]  Thomas Philip Runarsson,et al.  Constrained Evolutionary Optimization by Approximate Ranking and Surrogate Models , 2004, PPSN.

[7]  Ali Husseinzadeh Kashan,et al.  An efficient algorithm for constrained global optimization and application to mechanical engineering design: League championship algorithm (LCA) , 2011, Comput. Aided Des..

[8]  Rommel G. Regis,et al.  Particle swarm with radial basis function surrogates for expensive black-box optimization , 2014, J. Comput. Sci..

[9]  S. Rippa,et al.  Numerical Procedures for Surface Fitting of Scattered Data by Radial Functions , 1986 .

[10]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Carlos A. Coello Coello,et al.  An empirical study about the usefulness of evolution strategies to solve constrained optimization problems , 2008, Int. J. Gen. Syst..

[12]  Kok Wai Wong,et al.  Surrogate-Assisted Evolutionary Optimization Frameworks for High-Fidelity Engineering Design Problems , 2005 .

[13]  J. Sampson Adaptation in Natural and Artificial Systems (John H. Holland) , 1976 .

[14]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[15]  Tianyou Chai,et al.  Heterogeneous Ensemble-Based Infill Criterion for Evolutionary Multiobjective Optimization of Expensive Problems , 2019, IEEE Transactions on Cybernetics.

[16]  John A. W. McCall,et al.  Exploring aspects of cell intelligence with artificial reaction networks , 2013, Soft Computing.

[17]  Vassili Toropov,et al.  Simulation approach to structural optimization , 1989 .

[18]  Octavio A. González-Estrada,et al.  Damage detection in a unidimensional truss using the firefly optimization algorithm and finite elements , 2017, ArXiv.

[19]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[20]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[21]  Y. Yaxiang,et al.  A Simple Multistart Algorithm for Global Optimization , 1997 .

[22]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[23]  Vassili Toropov,et al.  Mid-range metamodel assembly building based on linear regression for large scale optimization problems , 2012 .

[24]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[25]  Nikolaos V. Sahinidis,et al.  Derivative-free optimization: a review of algorithms and comparison of software implementations , 2013, J. Glob. Optim..

[26]  Ali Mortazavi,et al.  Sizing and layout design of truss structures under dynamic and static constraints with an integrated particle swarm optimization algorithm , 2017, Appl. Soft Comput..

[27]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Zuomin Dong,et al.  SCGOSR: Surrogate-based constrained global optimization using space reduction , 2018, Appl. Soft Comput..

[29]  Vassili Toropov,et al.  Multiparameter structural optimization using FEM and multipoint explicit approximations , 1993 .

[30]  Ali Kaveh,et al.  Colliding bodies optimization: A novel meta-heuristic method , 2014 .

[31]  Zhun Fan,et al.  Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique , 2009 .

[32]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[33]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[34]  V. Toropov,et al.  Implementation of Discrete Capability into the Enhanced Multipoint Approximation Method for Solving Mixed Integer-Continuous Optimization Problems , 2016 .

[35]  Harish Garg,et al.  A hybrid PSO-GA algorithm for constrained optimization problems , 2016, Appl. Math. Comput..

[36]  Vassili Toropov,et al.  Multi-Disciplinary Design Optimisation of the Cooled Squealer Tip for High Pressure Turbines , 2018 .

[37]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[38]  Connie M. Borror,et al.  Response Surface Methodology: A Retrospective and Literature Survey , 2004 .

[39]  Joseph Morlier,et al.  Efficient global optimization for high-dimensional constrained problems by using the Kriging models combined with the partial least squares method , 2018 .

[40]  Jianqiao Chen,et al.  A surrogate-based particle swarm optimization algorithm for solving optimization problems with expensive black box functions , 2013 .

[41]  Bożena Borowska,et al.  Genetic Learning Particle Swarm Optimization with Interlaced Ring Topology , 2020, ICCS.

[42]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[43]  Vassili Toropov,et al.  NEW DEVELOPMENTS IN STRUCTURAL OPTIMIZATION USING ADAPTIVE MESH REFINEMENT AND MULTIPOINT APPROXIMATIONS , 1997 .