A Fast-Converging Ensemble Infilling Approach Balancing Global Exploration and Local Exploitation: The Go-Inspired Hybrid Infilling Strategy

Infilling strategies have been proposed for decades and are widely used in engineering problems. It is still challenging to achieve an effective trade-off between global exploration and local exploitation. In this paper, a novel decision-making infilling strategy named the Go-inspired hybrid infilling (Go-HI) strategy is proposed. The Go-HI strategy combines multiple individual infilling strategies, such as the mean square error (MSE), expected improvement (EI), and probability of improvement (PoI) strategies. The Go-HI strategy consists of two major parts. In the first part, a tree-like structure consisting of several subtrees is built. In the second part, the decision value for each subtree is calculated using a cross-validation (CV)-based criterion. Key factors that significantly influence the performance of the Go-HI strategy, such as the number of component infilling strategies and the tree depth, are explored. Go-HI strategies with different component strategies and tree depths are investigated and also compared with four baseline adaptive sampling strategies through three numerical functions and one engineering case. Results show that the number of component infilling strategies exerts a larger influence on the global and local performance than the tree depth; the Go-HI strategy with two component strategies performs better than the ones with three; the Go-HI strategy always outperforms the three component infilling strategies and the other four benchmark strategies in global performance and robustness and saves much computational cost. [DOI: 10.1115/1.4044112]

[1]  T. J. Mitchell,et al.  Exploratory designs for computational experiments , 1995 .

[2]  D. Dennis,et al.  SDO : A Statistical Method for Global Optimization , 1997 .

[3]  R. Haftka,et al.  Multiple surrogates: how cross-validation errors can help us to obtain the best predictor , 2009 .

[4]  Dirk Gorissen,et al.  A Novel Hybrid Sequential Design Strategy for Global Surrogate Modeling of Computer Experiments , 2011, SIAM J. Sci. Comput..

[5]  Andy J. Keane,et al.  On the Design of Optimization Strategies Based on Global Response Surface Approximation Models , 2005, J. Glob. Optim..

[6]  Tanguy Chouard.  The Go Files: AI computer wins first match against master Go player , 2016, Nature.

[7]  Kenny Q. Ye,et al.  Algorithmic construction of optimal symmetric Latin hypercube designs , 2000 .

[8]  Nam H. Kim,et al.  General-Surrogate Adaptive Sampling Using Interquartile Range for Design Space Exploration , 2020 .

[9]  Haitao Liu,et al.  A Robust Error-Pursuing Sequential Sampling Approach for Global Metamodeling Based on Voronoi Diagram and Cross Validation , 2014 .

[10]  Thomas P. Ryan.  Fractional Factorial Designs with Two Levels , 2006 .

[11]  Yan Wang,et al.  A sequential multi-fidelity metamodeling approach for data regression , 2017, Knowl. Based Syst..

[12]  Ming Jian Zuo,et al.  A new adaptive sequential sampling method to construct surrogate models for efficient reliability analysis , 2018, Reliab. Eng. Syst. Saf..

[13]  D Deschrijver,et al.  Adaptive Sampling Algorithm for Macromodeling of Parameterized $S$ -Parameter Responses , 2011, IEEE Transactions on Microwave Theory and Techniques.

[14]  Haitao Liu,et al.  An adaptive sampling approach for Kriging metamodeling by maximizing expected prediction error , 2017, Comput. Chem. Eng..

[15]  Richard Boddy,et al.  Effective Experimentation: For Scientists and Technologists , 2010 .

[16]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[17]  Ruichen Jin,et al.  On Sequential Sampling for Global Metamodeling in Engineering Design , 2002, DAC 2002.

[18]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[19]  William I. Notz,et al.  Sequential adaptive designs in computer experiments for response surface model fit , 2008 .

[20]  Xinyu Shao,et al.  An adaptive sampling strategy for Kriging metamodel based on Delaunay triangulation and TOPSIS , 2018, Applied Intelligence.

[21]  Jerome Sacks,et al.  Choosing the Sample Size of a Computer Experiment: A Practical Guide , 2009, Technometrics.

[22]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[23]  Haitao Liu,et al.  A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design , 2017, Structural and Multidisciplinary Optimization.

[24]  Dirk Gorissen,et al.  A novel sequential design strategy for global surrogate modeling , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[25]  G. Venter,et al.  An algorithm for fast optimal Latin hypercube design of experiments , 2010 .

[26]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[27]  Sébastien Le Digabel,et al.  Statistical Surrogate Formulations for Simulation-Based Design Optimization , 2015 .

[28]  Iftekhar A. Karimi,et al.  Design of computer experiments: A review , 2017, Comput. Chem. Eng..

[29]  R. J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output... , 2000 .

[30]  Iftekhar A. Karimi,et al.  Smart Sampling Algorithm for Surrogate Model Development , 2017, Comput. Chem. Eng..

[31]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[32]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[33]  Tom Dhaene,et al.  A Fuzzy Hybrid Sequential Design Strategy for Global Surrogate Modeling of High-Dimensional Computer Experiments , 2015, SIAM J. Sci. Comput..

[34]  Xin Chen,et al.  A deterministic sequential maximin Latin hypercube design method using successive local enumeration for metamodel-based optimization , 2016 .

[35]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[36]  D. Dennis,et al.  A statistical method for global optimization , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.