Extracting optimal datasets for metamodelling and perspectives for incremental samplings

Selecting the best input values for the purpose of fitting a metamodel to the response of a computer code presents several issues. Classical designs for physical experiments (DoE) have been developed to deal with noisy responses, while general space filling designs, though being usually effective for complete classes of problems, are not easily translated into adaptive incremental designs for specific problems. We discuss one-stage and incremental strategies for generating designs of experiments encountered in literature and present an extraction technique along with some benchmark on theoretical functions. We finally propose complexity indicators which could be considered for developing effective incremental samplings.

[1]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[2]  Saltelli Andrea,et al.  Sensitivity Analysis for Nonlinear Mathematical Models. Numerical ExperienceSensitivity Analysis for Nonlinear Mathematical Models. Numerical Experience , 1995 .

[3]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[4]  T. J. Mitchell,et al.  Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments , 1991 .

[5]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[6]  N. M. Alexandrov,et al.  A trust-region framework for managing the use of approximation models in optimization , 1997 .

[7]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[8]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[9]  G. Box,et al.  On the Experimental Attainment of Optimum Conditions , 1951 .

[10]  Ruichen Jin,et al.  On Sequential Sampling for Global Metamodeling in Engineering Design , 2002, DAC 2002.

[11]  C. Currin,et al.  A Bayesian Approach to the Design and Analysis of Computer Experiments , 1988 .

[12]  Margaret A. Nemeth.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 2nd Edition , 2003 .

[13]  Erik D. Goodman,et al.  Evaluation of Injection Island GA Performance on Flywheel Design Optimisation , 1998 .

[14]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.