Efficient hierarchical surrogate-assisted differential evolution for high-dimensional expensive optimization

Abstract Surrogate-assisted evolutionary algorithms have gained increasingly attention due to the promising search capabilities for solving computationally expensive optimization problems. However, when dealing with high-dimensional expensive optimization problems, the effectiveness of surrogate-assisted algorithms deteriorates drastically. In this paper, a novel and efficient hierarchical surrogate-assisted differential evolution (EHSDE) algorithm is proposed towards high-dimensional expensive optimization problems. To balance the exploration and exploitation during the optimization process, EHSDE utilizes a hierarchical framework. In the first phase, the best and the most uncertain offspring are identified respectively. The best offspring is prescreened by a global surrogate model which is built by using a radial basis function network with all the sample points, while the most uncertain offspring is built by the Euclidean distance between offspring and existing sample points. Subsequently, two local surrogate models, which are built by using the most promising sample points and the sample points surrounding the current best solution respectively, are utilized to accelerate the convergence speed. Moreover, experimental studies are conducted on the benchmark functions from 20D to 100D and on an oil reservoir production optimization problem. The results show that the proposed method is effective and efficient for most benchmark functions and for the production optimization problem compared with other state-of-the-art algorithms.

[1]  John Doherty,et al.  Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles , 2019, IEEE Transactions on Evolutionary Computation.

[2]  Vic Grout,et al.  Efficient Global Optimization of Actuator Based on a Surrogate Model Assisted Hybrid Algorithm , 2018, IEEE Transactions on Industrial Electronics.

[3]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[4]  Ying Tan,et al.  A generation-based optimal restart strategy for surrogate-assisted social learning particle swarm optimization , 2019, Knowl. Based Syst..

[5]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[6]  Ying Tan,et al.  Multiobjective Infill Criterion Driven Gaussian Process-Assisted Particle Swarm Optimization of High-Dimensional Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[7]  Atharv Bhosekar,et al.  Advances in surrogate based modeling, feasibility analysis, and optimization: A review , 2018, Comput. Chem. Eng..

[8]  John Doherty,et al.  Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems , 2017, IEEE Transactions on Cybernetics.

[9]  Yang Wang,et al.  A Novel Evolutionary Sampling Assisted Optimization Method for High-Dimensional Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[10]  Xian-Huan Wen,et al.  Uncertainty quantification and value of information assessment using proxies and Markov chain Monte Carlo method for a pilot project , 2017 .

[11]  Wei Gong,et al.  An adaptive surrogate modeling-based sampling strategy for parameter optimization and distribution estimation (ASMO-PODE) , 2017, Environ. Model. Softw..

[12]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[13]  Pengcheng Ye,et al.  Global optimization method using ensemble of metamodels based on fuzzy clustering for design space reduction , 2017, Engineering with Computers.

[14]  M. Stein Large sample properties of simulations using latin hypercube sampling , 1987 .

[15]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[16]  Chao Lu,et al.  An on-line variable-fidelity surrogate-assisted harmony search algorithm with multi-level screening strategy for expensive engineering design optimization , 2019, Knowl. Based Syst..

[17]  Baowei Song,et al.  Multi-start Space Reduction (MSSR) surrogate-based global optimization method , 2016 .

[18]  Joseph Morlier,et al.  Efficient global optimization for high-dimensional constrained problems by using the Kriging models combined with the partial least squares method , 2018 .

[19]  Xinyu Li,et al.  Efficient Generalized Surrogate-Assisted Evolutionary Algorithm for High-Dimensional Expensive Problems , 2020, IEEE Transactions on Evolutionary Computation.

[20]  Jianchao Zeng,et al.  Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems , 2017, IEEE Transactions on Evolutionary Computation.

[21]  Carlos A. Coello Coello,et al.  Comparison of metamodeling techniques in evolutionary algorithms , 2017, Soft Comput..

[22]  Swagatam Das,et al.  Reusing the Past Difference Vectors in Differential Evolution—A Simple But Significant Improvement , 2020, IEEE Transactions on Cybernetics.

[23]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[24]  A. Basudhar,et al.  Constrained efficient global optimization with support vector machines , 2012, Structural and Multidisciplinary Optimization.

[25]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[26]  Lean Yu,et al.  Fuzzy Optimal Allocation Model for Task–Resource Assignment Problem in a Collaborative Logistics Network , 2019, IEEE Transactions on Fuzzy Systems.

[27]  Uday K. Chakraborty,et al.  Advances in Differential Evolution , 2010 .

[28]  Dan Guo,et al.  Data-Driven Evolutionary Optimization: An Overview and Case Studies , 2019, IEEE Transactions on Evolutionary Computation.

[29]  C. Shoemaker,et al.  Combining radial basis function surrogates and dynamic coordinate search in high-dimensional expensive black-box optimization , 2013 .

[30]  Bo Liu,et al.  Global Optimization of Microwave Filters Based on a Surrogate Model-Assisted Evolutionary Algorithm , 2017, IEEE Transactions on Microwave Theory and Techniques.

[31]  Zuomin Dong,et al.  Hybrid surrogate-based optimization using space reduction (HSOSR) for expensive black-box functions , 2018, Appl. Soft Comput..

[32]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[33]  Zuomin Dong,et al.  SCGOSR: Surrogate-based constrained global optimization using space reduction , 2018, Appl. Soft Comput..

[34]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[35]  Zhixue Sun,et al.  A FRACTAL DISCRETE FRACTURE NETWORK MODEL FOR HISTORY MATCHING OF NATURALLY FRACTURED RESERVOIRS , 2019, Fractals.

[36]  Hao Zhang,et al.  Cooperative Artificial Bee Colony Algorithm With Multiple Populations for Interval Multiobjective Optimization Problems , 2019, IEEE Transactions on Fuzzy Systems.

[37]  Xinyu Li,et al.  Surrogate-guided differential evolution algorithm for high dimensional expensive problems , 2019, Swarm Evol. Comput..

[38]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[39]  Meng Li,et al.  High-Dimensional Reliability-Based Design Optimization Involving Highly Nonlinear Constraints and Computationally Expensive Simulations , 2019, Journal of Mechanical Design.

[40]  Rommel G. Regis,et al.  Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions , 2011, Comput. Oper. Res..

[41]  Bernhard Sendhoff,et al.  Generalizing Surrogate-Assisted Evolutionary Computation , 2010, IEEE Transactions on Evolutionary Computation.

[42]  Liang Gao,et al.  Ensemble of surrogates assisted particle swarm optimization of medium scale expensive problems , 2019, Appl. Soft Comput..

[43]  Rommel G. Regis,et al.  Particle swarm with radial basis function surrogates for expensive black-box optimization , 2014, J. Comput. Sci..

[44]  Ying Tan,et al.  Surrogate-assisted hierarchical particle swarm optimization , 2018, Inf. Sci..

[45]  Yong Wang,et al.  Global and Local Surrogate-Assisted Differential Evolution for Expensive Constrained Optimization Problems With Inequality Constraints , 2019, IEEE Transactions on Cybernetics.

[46]  J. Carrasco,et al.  Recent Trends in the Use of Statistical Tests for Comparing Swarm and Evolutionary Computing Algorithms: Practical Guidelines and a Critical Review , 2020, Swarm Evol. Comput..

[47]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.