A complex mathematical model that produces output values from input values is now commonly called a computer model. This thesis considers the problem of finding the global optimum of the response with few function evaluations. A small number of function evaluations is desirable since the computer model is often expensive (time consuming) to evaluate.
The function to be optimized is modeled as a stochastic process from initial function evaluations. Points are sampled sequentially according to a criterion that combines promising prediction values with prediction uncertainty. Some graphical tools are given that allow early assessment about whether the modeling strategy will work well. The approach is generalized by introducing a parameter that controls how global versus local the search strategy is. Strategies to conduct the optimization in stages and for optimization subject to constraints on additional response variables are presented.
Special consideration is given to the stopping criterion of the global optimization algorithm. The problem of achieving a tolerance on the global minimum can be represented by determining whether the first order statistic of N dependent variables is greater than a certain value. An algorithm is developed that quickly determines bounds on the probability of this event.
A strategy to explore high-dimensional data informally through effect plots is presented. The interpretation of the plots is guided by pointwise standard errors of the effects which are developed. When used in the context of global optimization, the graphical analysis sheds light on the number and location of local optima.
[1]
Alan J. Mayne,et al.
Towards Global Optimisation 2
,
1976
.
[2]
István Deák,et al.
Three digit accurate multiple normal probabilities
,
1980
.
[3]
Jonas Mockus,et al.
Application of Bayesian approach to numerical methods of global and stochastic optimization
,
1994,
J. Glob. Optim..
[4]
C. D. Perttunen,et al.
Lipschitzian optimization without the Lipschitz constant
,
1993
.
[5]
Feller William,et al.
An Introduction To Probability Theory And Its Applications
,
1950
.
[6]
T. J. Mitchell,et al.
Bayesian design and analysis of computer experiments: Use of derivatives in surface prediction
,
1993
.
[7]
M. Schervish.
Multivariate normal probabilities with error bound
,
1984
.
[8]
Noel A Cressie,et al.
Statistics for Spatial Data, Revised Edition.
,
1994
.
[9]
J. Mockus,et al.
The Bayesian approach to global optimization
,
1989
.
[10]
Reuven Y. Rubinstein,et al.
Simulation and the Monte Carlo method
,
1981,
Wiley series in probability and mathematical statistics.
[11]
Douglas M. Bates,et al.
Nonlinear Regression Analysis and Its Applications
,
1988
.
[12]
T. J. Mitchell,et al.
Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments
,
1991
.
[13]
Bruno Betrò,et al.
Bayesian methods in global optimization
,
1991,
J. Glob. Optim..
[14]
J. H. Schuenemeyer,et al.
Generalized Linear Models (2nd ed.)
,
1992
.