Extension of the direct optimization algorithm for noisy functions

DIRECT (Dividing RECTangles) is a deterministic global optimization algorithm for bound-constrained problems. The algorithm, based on a space-partitioning scheme, performs both global exploration and local exploitation. In this paper, we modify the deterministic DIRECT algorithm to handle noisy function optimization. We adopt a simple approach that replicates multiple function evaluations per point and takes an average to reduce functional uncertainty. Particular features of the DIRECT method are modified using acquired Bayesian sample information to determine appropriate numbers of replications. The noisy version of the DIRECT algorithm is suited for simulation-based optimization problems. The algorithm is a sampling approach, that only uses objective function evaluations. We have applied the new algorithm in a number of noisy global optimizations, including an ambulance base simulation optimization problem.

[1]  Raghu Pasupathy,et al.  A Testbed of Simulation-Optimization Problems , 2006, Proceedings of the 2006 Winter Simulation Conference.

[2]  Michael C. Ferris,et al.  Variable-Number Sample-Path Optimization , 2008, Math. Program..

[3]  Arnold Neumaier,et al.  SNOBFIT -- Stable Noisy Optimization by Branch and Fit , 2008, TOMS.

[4]  D. Finkel,et al.  Direct optimization algorithm user guide , 2003 .

[5]  Chun-Hung Chen,et al.  An asymptotic allocation for simultaneous simulation experiments , 1999, WSC '99.

[6]  E. Klein,et al.  SELECTing the best. , 2007, The Journal of urology.

[7]  Stephen E. Chick,et al.  New Procedures to Select the Best Simulated System Using Common Random Numbers , 2001, Manag. Sci..

[8]  Michael C. Ferris,et al.  Adaptation of the Uobyqa Algorithm for Noisy Functions , 2006, Proceedings of the 2006 Winter Simulation Conference.

[9]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[10]  Daniel E. Finkel,et al.  Global optimization with the direct algorithm , 2005 .

[11]  Donald R. Jones,et al.  Direct Global Optimization Algorithm , 2009, Encyclopedia of Optimization.

[12]  P. Sánchez,et al.  SELECTING THE BEST SYSTEM : THEORY AND METHODS , 2003 .

[13]  Barry L. Nelson,et al.  Selecting the best system: selecting the best system: theory and methods , 2003, WSC '03.

[14]  Stephen E. Chick,et al.  New Two-Stage and Sequential Procedures for Selecting the Best Simulated System , 2001, Oper. Res..