Multi-fidelity optimization via surrogate modelling

This paper demonstrates the application of correlated Gaussian process based approximations to optimization where multiple levels of analysis are available, using an extension to the geostatistical method of co-kriging. An exchange algorithm is used to choose which points of the search space to sample within each level of analysis. The derivation of the co-kriging equations is presented in an intuitive manner, along with a new variance estimator to account for varying degrees of computational ‘noise’ in the multiple levels of analysis. A multi-fidelity wing optimization is used to demonstrate the methodology.

[1]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[2]  G. Matheron Principles of geostatistics , 1963 .

[3]  H. Theil Principles of econometrics , 1971 .

[4]  R. D. Cook,et al.  A Comparison of Algorithms for Constructing Exact D-Optimal Designs , 1980 .

[5]  Brian Maskew,et al.  Prediction of Subsonic Aerodynamic Characteristics: A Case for Low-Order Panel Methods , 1982 .

[6]  J. Cousin,et al.  The BAe (commercial aircraft) LTD transport aircraft synthesis and optimisation program (TASOP) , 1990 .

[7]  A. Flint,et al.  Precipitation Estimation in Mountainous Terrain Using Multivariate Geostatistics. Part II: Isohyetal Maps , 1990 .

[8]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[9]  A. Flint,et al.  Precipitation Estimation in Mountainous Terrain Using Multivariate Geostatistics. Part I: Structural Analysis , 1992 .

[10]  T. J. Mitchell,et al.  Exploratory designs for computational experiments , 1995 .

[11]  Marco Locatelli,et al.  Bayesian Algorithms for One-Dimensional Global Optimization , 1997, J. Glob. Optim..

[12]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[13]  A. O'Hagan,et al.  Predicting the output from a complex computer code when fast approximations are available , 2000 .

[14]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[15]  Andy J. Keane,et al.  Wing Optimization Using Design of Experiment, Response Surface, and Data Fusion Methods , 2003 .

[16]  Alexander I. J. Forrester,et al.  Optimization with missing data , 2006, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[17]  A. Forrester,et al.  Design and analysis of 'noisy' computer experiments , 2006 .

[18]  Andy J. Keane,et al.  Optimization using surrogate models and partially converged computational fluid dynamics simulations , 2006, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.