Global and Local Surrogate-Assisted Differential Evolution for Expensive Constrained Optimization Problems With Inequality Constraints

For expensive constrained optimization problems (ECOPs), the computation of objective function and constraints is very time-consuming. This paper proposes a novel global and local surrogate-assisted differential evolution (DE) for solving ECOPs with inequality constraints. The proposed method consists of two main phases: 1) global surrogate-assisted phase and 2) local surrogate-assisted phase. In the global surrogate-assisted phase, DE serves as the search engine to produce multiple trial vectors. Afterward, the generalized regression neural network is used to evaluate these trial vectors. In order to select the best candidate from these trial vectors, two rules are combined. The first is the feasibility rule, which at first guides the population toward the feasible region, and then toward the optimal solution. In addition, the second rule puts more emphasis on the solution with the highest predicted uncertainty, and thus alleviates the inaccuracy of the surrogates. In the local surrogate-assisted phase, the interior point method coupled with radial basis function is utilized to refine each individual in the population. During the evolution, the global surrogate-assisted phase has the capability to promptly locate the promising region and the local surrogate-assisted phase is able to speed up the convergence. Therefore, by combining these two important elements, the number of fitness evaluations can be reduced remarkably. The proposed method has been tested on numerous benchmark test functions from three test suites and two real-world cases. The experimental results demonstrate that the performance of the proposed method is better than that of other state-of-the-art methods.

[1]  J. Alonso,et al.  SU2: An Open-Source Suite for Multiphysics Simulation and Design , 2016 .

[2]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[3]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[4]  Rainer Laur,et al.  Constrained Single-Objective Optimization Using Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  Thomas Philip Runarsson,et al.  Constrained Evolutionary Optimization by Approximate Ranking and Surrogate Models , 2004, PPSN.

[6]  Witold Pedrycz,et al.  A variable reduction strategy for evolutionary algorithms handling equality constraints , 2015, Appl. Soft Comput..

[7]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[8]  X. Yao,et al.  Combining landscape approximation and local search in global optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Thomas Philip Runarsson,et al.  Approximate Evolution Strategy using Stochastic Ranking , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[10]  Christine A. Shoemaker,et al.  A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions , 2007, INFORMS J. Comput..

[11]  W. Konen,et al.  SACOBRA: Self-Adjusting Constrained Black-Box Optimization with RBF , 2015 .

[12]  Rammohan Mallipeddi,et al.  An evolving surrogate model-based differential evolution algorithm , 2015, Appl. Soft Comput..

[13]  Tapabrata Ray,et al.  A surrogate-assisted differential evolution algorithm with dynamic parameters selection for solving expensive optimization problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[14]  Bu-Sung Lee,et al.  Memetic algorithm using multi-surrogates for computationally expensive optimization problems , 2007, Soft Comput..

[15]  Witold Pedrycz,et al.  Using variable reduction strategy to accelerate evolutionary optimization , 2017, Appl. Soft Comput..

[16]  Jianguang Fang,et al.  Configurational optimization of multi-cell topologies for multiple oblique loads , 2018 .

[17]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[18]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[19]  Rommel G. Regis,et al.  Trust Regions in Surrogate-Assisted Evolutionary Programming for Constrained Expensive Black-Box Optimization , 2015 .

[20]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[21]  Carlos A. Coello Coello,et al.  A Preliminary Study of Fitness Inheritance in Evolutionary Constrained Optimization , 2007, NICSO.

[22]  Tetsuyuki Takahama,et al.  Efficient Constrained Optimization by the ε Constrained Rank-Based Differential Evolution , 2012, 2012 IEEE Congress on Evolutionary Computation.

[23]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[24]  Chee Keong Kwoh,et al.  Feasibility Structure Modeling: An Effective Chaperone for Constrained Memetic Algorithms , 2010, IEEE Transactions on Evolutionary Computation.

[25]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[26]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[27]  Thomas Bäck,et al.  Metamodel-Assisted Evolution Strategies , 2002, PPSN.

[28]  Craig T. Lawrence,et al.  A Computationally Efficient Feasible Sequential Quadratic Programming Algorithm , 2000, SIAM J. Optim..

[29]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[30]  C. Coello,et al.  CONSTRAINT-HANDLING USING AN EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION TECHNIQUE , 2000 .

[31]  Virginia Torczon,et al.  Using approximations to accelerate engineering design optimization , 1998 .

[32]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[33]  Marc Schoenauer,et al.  ASCHEA: new results using adaptive segregational constraint handling , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[34]  Jonathan A. Wright,et al.  Self-adaptive fitness formulation for constrained optimization , 2003, IEEE Trans. Evol. Comput..

[35]  R. Regis Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points , 2014 .

[36]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[37]  Manolis Papadrakakis,et al.  Structural optimization using evolution strategies and neural networks , 1998 .

[38]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[39]  WuGuohua,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016 .

[40]  Yong Wang,et al.  Constrained Evolutionary Optimization by Means of ( + )-Differential Evolution and Improved Adaptive Trade-Off Model , 2011, Evolutionary Computation.

[41]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[42]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[43]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[44]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[45]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[46]  Eduardo Krempser Differential Evolution Assisted by Surrogate Models for Structural Optimization Problems , 2012 .

[47]  F. Grimaccia,et al.  Genetical Swarm Optimization: Self-Adaptive Hybrid Evolutionary Algorithm for Electromagnetics , 2007, IEEE Transactions on Antennas and Propagation.

[48]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[49]  Yuren Zhou,et al.  Multiobjective Optimization and Hybrid Evolutionary Algorithm to Solve Constrained Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[50]  David W. Coit,et al.  Adaptive Penalty Methods for Genetic Optimization of Constrained Combinatorial Problems , 1996, INFORMS J. Comput..

[51]  Dario Floreano,et al.  Memetic Viability Evolution for Constrained Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[52]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[53]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[54]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[55]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[56]  Christine A. Shoemaker,et al.  Global Convergence of Radial Basis Function Trust-Region Algorithms for Derivative-Free Optimization , 2013, SIAM Rev..

[57]  Yong Wang,et al.  Incorporating Objective Function Information Into the Feasibility Rule for Constrained Evolutionary Optimization , 2016, IEEE Transactions on Cybernetics.

[58]  Andy J. Keane,et al.  Optimization using surrogate models and partially converged computational fluid dynamics simulations , 2006, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[59]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[60]  Stephen J. Wright,et al.  Primal-Dual Interior-Point Methods , 1997 .

[61]  Chee Keong Kwoh,et al.  Classification-Assisted Memetic Algorithms for Equality-Constrained Optimization Problems , 2009, Australasian Conference on Artificial Intelligence.

[62]  Yew-Soon Ong,et al.  A surrogate-assisted memetic co-evolutionary algorithm for expensive constrained optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[63]  M. Stein Large sample properties of simulations using latin hypercube sampling , 1987 .

[64]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[65]  C. Coello TREATING CONSTRAINTS AS OBJECTIVES FOR SINGLE-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2000 .

[66]  Yong Wang,et al.  An improved (μ + λ)-constrained differential evolution for constrained optimization , 2013, Inf. Sci..

[67]  Christine A. Shoemaker,et al.  Local function approximation in evolutionary algorithms for the optimization of costly functions , 2004, IEEE Transactions on Evolutionary Computation.