The Effect of Multi-Additional Sampling for Multi-Fidelity Efficient Global Optimization

Powerful computer-aided design tools are presently vital for engineering product development. Efficient global optimization (EGO) is one of the most popular methods for design of a high computational cost problem. The original EGO is proposed for only one additional sample point. In this work, parallel computing is applied to the original EGO process via a multi-additional sampling technique. The weak point of the multi-additional sampling is it has slower convergence rate when compared with the original EGO. This paper applies the multi-fidelity technique to the multi-additional EGO process to see the effect of the number of multi-additional sampling points and the converge rate. A co-kriging method and a hybrid RBF/Kriging surrogate model are selected for the surrogate model in the EGO process to show the advantage of the multi-additional EGO process compared with the single-fidelity Kriging surrogate model. In the experiment, single-additional sampling points and two to four number of multi-additional sampling per iteration are tested with symmetry and asymmetry mathematical test functions. The results show the hybrid RBF/Kriging surrogate model can obtain the similar optimal points when using the multi-additional sampling EGO.

[1]  Zhenghong Gao,et al.  Research on multi-fidelity aerodynamic optimization methods , 2013 .

[2]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[3]  Browne,et al.  Cross-Validation Methods. , 2000, Journal of mathematical psychology.

[4]  Pierantonio Facco,et al.  A novel and systematic approach to identify the design space of pharmaceutical processes , 2018, Comput. Chem. Eng..

[5]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[6]  Sujin Bureerat,et al.  An Approach Combining an Efficient and Global Evolutionary Algorithm with a Gradient-Based Method for Airfoil Design Problems , 2020, Smart Science.

[7]  Junfeng Gu,et al.  Investigation on parallel algorithms in efficient global optimization based on multiple points infill criterion and domain decomposition , 2016 .

[8]  Nantiwat Pholdee,et al.  An efficient optimum Latin hypercube sampling technique based on sequencing optimisation using simulated annealing , 2015, Int. J. Syst. Sci..

[9]  Nantiwat Pholdee,et al.  Self-adaptive many-objective meta-heuristic based on decomposition for many-objective conceptual design of a fixed wing unmanned aerial vehicle , 2020 .

[10]  Qingfu Zhang,et al.  A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems , 2016, J. Comput. Sci..

[11]  Doo-Hyun Choi,et al.  Cooperative mutation based evolutionary programming for continuous function optimization , 2002, Oper. Res. Lett..

[12]  Masahiro Kanazaki,et al.  Multi-modal distribution crossover method based on two crossing segments bounded by selected parents applied to multi-objective design optimization , 2015 .

[13]  Alexander I. J. Forrester,et al.  Multi-fidelity optimization via surrogate modelling , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[14]  Kwang-Yong Kim,et al.  Effects of Latin hypercube sampling on surrogate modeling and optimization , 2017 .

[15]  M. Ierapetritou,et al.  A novel feasibility analysis method for black‐box processes using a radial basis function adaptive sampling approach , 2017 .

[16]  Anirban Chaudhuri,et al.  Parallel surrogate-assisted global optimization with expensive functions – a survey , 2016 .

[17]  Sujin Bureerat,et al.  Finite Element Analysis of Grain Size Effects on Curvature in Micro-Extrusion , 2020, Applied Sciences.

[18]  Masahiro Kanazaki,et al.  Multi-Fidelity Multi-Objective Efficient Global Optimization Applied to Airfoil Design Problems , 2017 .

[19]  Masahiro Kanazaki,et al.  Hybrid surrogate-model-based multi-fidelity efficient global optimization applied to helicopter blade design , 2017 .

[20]  Sujin Bureerat,et al.  Constraint handling technique for four-bar linkage path generation using self-adaptive teaching–learning-based optimization with a diversity archive , 2020 .

[21]  Zilong Wang,et al.  Constrained optimization of black-box stochastic systems using a novel feasibility enhanced Kriging-based method , 2018, Comput. Chem. Eng..

[22]  G. Matheron.  Principles of geostatistics , 1963 .

[23]  Yu Sun,et al.  Hybrid analysis and optimization of hierarchical stiffened plates based on asymptotic homogenization method , 2015 .

[24]  Zilong Wang,et al.  Surrogate-based Optimization for Pharmaceutical Manufacturing Processes , 2017 .

[25]  Bo Wang,et al.  Toward the robust establishment of variable-fidelity surrogate models for hierarchical stiffened shells by two-step adaptive updating approach , 2020 .

[26]  Qing Li,et al.  A two-stage multi-fidelity optimization procedure for honeycomb-type cellular materials , 2010 .