SCGOSR: Surrogate-based constrained global optimization using space reduction

Abstract Global optimization problems with computationally expensive objective and constraints are challenging. In this work, we present a new kriging-based constrained global optimization algorithm SCGOSR that can find global optima with fewer objective and constraint function evaluations. In SCGOSR, we propose a multi-start constrained optimization algorithm that can capture approximately local optimal points from kriging and select the promising ones for updating. In addition, according to two different penalty functions, two subspaces are created to construct local surrogate models and speed up the local search. Subspace1 is the neighborhood of the presented best solution, and Subspace2 is a region that covers several promising samples. The proposed multi-start constrained optimization is carried out alternately in Subspace1, Subspace2 and the global space. With iterations going on, kriging models of the costly objective and constraints are dynamically updated. In order to guarantee the balance between local and global search, the estimated mean square error of kriging is used to explore the unknown design space. Once SCGOSR gets stuck in a local valley, the algorithm will focus on the sparsely sampled regions. After comparison with 6 surrogate-based optimization algorithms on 13 representative cases, SCGOSR shows noticeable advantages in handling computationally expensive black-box problems.

[1]  Yan Wang,et al.  A sequential multi-fidelity metamodeling approach for data regression , 2017, Knowl. Based Syst..

[2]  Zuomin Dong,et al.  Trends, features, and tests of common and recently introduced global optimization methods , 2010 .

[3]  S. Rippa,et al.  Numerical Procedures for Surface Fitting of Scattered Data by Radial Functions , 1986 .

[4]  Mattias Björkman,et al.  Global Optimization of Costly Nonconvex Functions Using Radial Basis Functions , 2000 .

[5]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[6]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[7]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[8]  Christine A. Shoemaker,et al.  SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications , 2014, J. Glob. Optim..

[9]  Hans-Martin Gutmann,et al.  A Radial Basis Function Method for Global Optimization , 2001, J. Glob. Optim..

[10]  Charles Audet,et al.  A mesh adaptive direct search algorithm for multiobjective optimization , 2009, Eur. J. Oper. Res..

[11]  M. Sasena,et al.  Global optimization of problems with disconnected feasible regions via surrogate modeling , 2002 .

[12]  Harish Garg Solving structural engineering design optimization problems using an artificial bee colony algorithm , 2013 .

[13]  Julien Marzat,et al.  Analysis of multi-objective Kriging-based methods for constrained global optimization , 2016, Comput. Optim. Appl..

[14]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[15]  Zuomin Dong,et al.  Hybrid and adaptive meta-model-based global optimization , 2012 .

[16]  Christine A. Shoemaker,et al.  A quasi-multistart framework for global optimization of expensive functions using response surface models , 2013, J. Glob. Optim..

[17]  G. Vanderplaats,et al.  Survey of Discrete Variable Optimization for Structural Design , 1995 .

[18]  Yan Wang,et al.  An active learning radial basis function modeling method based on self-organization maps for simulation-based design problems , 2017, Knowl. Based Syst..

[19]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[20]  Juliane Müller,et al.  GOSAC: global optimization with surrogate approximation of constraints , 2017, J. Glob. Optim..

[21]  Christine A. Shoemaker,et al.  A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions , 2007, INFORMS J. Comput..

[22]  M. Sasena,et al.  Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization , 2002 .

[23]  Rommel G. Regis,et al.  Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions , 2011, Comput. Oper. Res..

[24]  Z. Dong,et al.  Metamodelling and search using space exploration and unimodal region elimination for design optimization , 2010 .

[25]  Yuansheng Cheng,et al.  Balancing global and local search in parallel efficient global optimization algorithms , 2017, J. Glob. Optim..

[26]  Panos M. Pardalos,et al.  A Hybrid-coded Human Learning Optimization for mixed-variable optimization problems , 2017, Knowl. Based Syst..

[27]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[28]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Bryan A. Tolson,et al.  Dynamically dimensioned search algorithm for computationally efficient watershed model calibration , 2007 .

[30]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[31]  Andy J. Keane,et al.  Enhancing infill sampling criteria for surrogate-based constrained optimization , 2012, J. Comput. Methods Sci. Eng..

[32]  R. Regis Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points , 2014 .

[33]  Baowei Song,et al.  Multi-start Space Reduction (MSSR) surrogate-based global optimization method , 2016 .

[34]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[35]  A. Basudhar,et al.  Constrained efficient global optimization with support vector machines , 2012, Structural and Multidisciplinary Optimization.

[36]  Masao Arakawa,et al.  Sequential approximate multi-objective optimization using radial basis function network , 2013 .

[37]  Liping Chen,et al.  J Glob Optim Table 1 Constraint handling in auxiliary problem for Kriging and radial basis function Surrogate model Constraint handling in auxiliary problem Via penalty Via explicit constraint Kriging Schonlau , 2016 .

[38]  Jeng-Shyang Pan,et al.  QUasi-Affine TRansformation Evolutionary (QUATRE) algorithm: A cooperative swarm based algorithm for global optimization , 2016, Knowl. Based Syst..

[39]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[40]  Tom Dhaene,et al.  Performance study of multi-fidelity gradient enhanced kriging , 2015 .

[41]  Huseyin Polat,et al.  Privacy-preserving kriging interpolation on partitioned data , 2014, Knowl. Based Syst..

[42]  Connie M. Borror,et al.  Response Surface Methodology: A Retrospective and Literature Survey , 2004 .

[43]  M. Tyan,et al.  Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aerofoil design , 2015 .

[44]  John A. W. McCall,et al.  Exploring aspects of cell intelligence with artificial reaction networks , 2013, Soft Computing.

[45]  Hirotaka Nakayama,et al.  Multi-objective optimization based on meta-modeling by using support vector regression , 2009 .

[46]  Anirban Chaudhuri,et al.  Parallel surrogate-assisted global optimization with expensive functions – a survey , 2016 .

[47]  Shigeru Obayashi,et al.  Kriging-surrogate-based optimization considering expected hypervolume improvement in non-constrained many-objective test problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[48]  Frank Jiang,et al.  Binary Hybrid Particle Swarm Optimization with Wavelet Mutation , 2014, KSE.

[49]  Thomas Bäck,et al.  Self-adjusting parameter control for surrogate-assisted constrained optimization under limited budgets , 2017, Appl. Soft Comput..