A Kriging-Assisted Multi-Objective Constrained Global Optimization Method for Expensive Black-Box Functions

The kriging optimization method that can only obtain one sampling point per cycle has encountered a bottleneck in practical engineering applications. How to find a suitable optimization method to generate multiple sampling points at a time while improving the accuracy of convergence and reducing the number of expensive evaluations has been a wide concern. For this reason, a kriging-assisted multi-objective constrained global optimization (KMCGO) method has been proposed. The sample data obtained from the expensive function evaluation is first used to construct or update the kriging model in each cycle. Then, kriging-based estimated target, RMSE (root mean square error), and feasibility probability are used to form three objectives, which are optimized to generate the Pareto frontier set through multi-objective optimization. Finally, the sample data from the Pareto frontier set is further screened to obtain more promising and valuable sampling points. The test results of five benchmark functions, four design problems, and a fuel economy simulation optimization prove the effectiveness of the proposed algorithm.

[1]  Harish Garg.  Solving structural engineering design optimization problems using an artificial bee colony algorithm , 2013 .

[2]  Julien Marzat,et al.  Analysis of multi-objective Kriging-based methods for constrained global optimization , 2016, Comput. Optim. Appl..

[3]  Charles Audet,et al.  A surrogate-model-based method for constrained optimization , 2000 .

[4]  David Herrero Pérez,et al.  Kriging-based infill sampling criterion for constraint handling in multi-objective optimization , 2016, J. Glob. Optim..

[5]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[6]  James M. Parr,et al.  Infill sampling criteria for surrogate-based optimization with constraint handling , 2012 .

[7]  Lyle H. Ungar,et al.  Using radial basis functions to approximate a function and its error bounds , 1992, IEEE Trans. Neural Networks.

[8]  Jize Zhang,et al.  Evolutionary Multi-Objective Optimization Under Uncertainty Through Adaptive Kriging in Augmented Input Space , 2020 .

[9]  Yuanmin Zhang,et al.  A Kriging-based bi-objective constrained optimization method for fuel economy of hydrogen fuel cell vehicle , 2019, International Journal of Hydrogen Energy.

[10]  Jack P. C. Kleijnen,et al.  Robust Optimization in Simulation: Taguchi and Krige Combined , 2009, INFORMS J. Comput..

[11]  Carlos A. Coello Coello,et al.  A Review of Techniques for Handling Expensive Functions in Evolutionary Multi-Objective Optimization , 2010 .

[12]  Yaohui Li,et al.  A sequential Kriging method assisted by trust region strategy for proxy cache size optimization of the streaming media video data due to fragment popularity distribution , 2018, Multimedia Tools and Applications.

[13]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Ranjan Ganguli,et al.  Conceptual design of UAV using Kriging based multi-objective genetic algorithm , 2008, The Aeronautical Journal (1968).

[15]  Inneke Van Nieuwenhuyse,et al.  A multiobjective stochastic simulation optimization algorithm , 2020, Eur. J. Oper. Res..

[16]  Zuomin Dong,et al.  SCGOSR: Surrogate-based constrained global optimization using space reduction , 2018, Appl. Soft Comput..

[17]  Joseph Morlier,et al.  Efficient global optimization for high-dimensional constrained problems by using the Kriging models combined with the partial least squares method , 2018 .

[18]  Jianjun Zhao,et al.  An efficient multi-objective PSO algorithm assisted by Kriging metamodel for expensive black-box problems , 2017, J. Glob. Optim..

[19]  Inneke Van Nieuwenhuyse,et al.  A survey on kriging-based infill algorithms for multiobjective simulation optimization , 2020, Comput. Oper. Res..

[20]  Shapour Azarm,et al.  A Kriging Metamodel Assisted Multi-Objective Genetic Algorithm for Design Optimization , 2008 .

[21]  Efrén Mezura-Montes,et al.  Empirical analysis of a modified Artificial Bee Colony for constrained numerical optimization , 2012, Appl. Math. Comput..

[22]  Jack P. C. Kleijnen,et al.  Robust Optimization in Simulation: Taguchi and Response Surface Methodology , 2008 .

[23]  Feng Zhao,et al.  A Kriging-Assisted Reference Vector Guided Multi-Objective Evolutionary Fuzzy Clustering Algorithm for Image Segmentation , 2019, IEEE Access.

[24]  Yuanmin Zhang,et al.  KMCGO: Kriging-Assisted Multi-objective Constrained Global Optimization , 2019, WCGO.

[25]  Zuomin Dong,et al.  A new Kriging–Bat Algorithm for solving computationally expensive black-box global optimization problems , 2019 .

[26]  D. Basak,et al.  Support Vector Regression , 2008 .

[27]  J. Friedman.  Multivariate adaptive regression splines , 1990 .

[28]  Farrokh Mistree,et al.  Kriging Models for Global Approximation in Simulation-Based Multidisciplinary Design Optimization , 2001 .

[29]  Yu Zhang,et al.  Variable-fidelity expected improvement method for efficient global optimization of expensive functions , 2018 .

[30]  Yizhong Wu,et al.  A Kriging-based constrained global optimization algorithm for expensive black-box functions with infeasible initial points , 2017, J. Glob. Optim..

[31]  Jeong‐Soo Park.  Optimal Latin-hypercube designs for computer experiments , 1994 .

[32]  Nong Zhang,et al.  Interval multi-objective optimisation of structures using adaptive Kriging approximations , 2013 .

[33]  Rommel G. Regis,et al.  Trust regions in Kriging-based optimization with expected improvement , 2016 .

[34]  Tom Dhaene,et al.  Efficient Multi-Objective Simulation-Driven Antenna Design Using Co-Kriging , 2014, IEEE Transactions on Antennas and Propagation.