ASTRO-DF: Adaptive sampling trust-region optimization algorithms, heuristics, and numerical experience

ASTRO-DF is a class of adaptive sampling algorithms for solving simulation optimization problems in which only estimates of the objective function are available by executing a Monte Carlo simulation. ASTRO-DF algorithms are iterative trust-region algorithms, where a local model is repeatedly constructed and optimized as iterates evolve through the search space. The ASTRO-DF class of algorithms is derivative-free in the sense that it does not rely on direct observations of the function derivatives. A salient feature of ASTRO-DF is the incorporation of adaptive sampling and replication to keep the model error and the trust-region radius in lock-step, to ensure efficiency. ASTRO-DF has been demonstrated to generate iterates that globally converge to a first-order critical point with probability one. In this paper, we describe and list ASTRO-DF, and discuss key heuristics that ensure good finite-time performance. We report our numerical experience with ASTRO-DF on test problems in low to moderate dimensions.

[1]  M. Powell.  A Direct Search Optimization Method That Models the Objective and Constraint Functions by Linear Interpolation , 1994 .

[2]  Oguzhan Alagoz,et al.  Optimizing Organ Allocation and Acceptance , 2009 .

[3]  Nicholas I. M. Gould,et al.  CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimization , 2013, Computational Optimization and Applications.

[4]  Deepti Rani,et al.  Simulation–Optimization Modeling: A Survey and Potential Application in Reservoir Systems Operation , 2010 .

[5]  E. Nsoesie,et al.  A Simulation Optimization Approach to Epidemic Forecasting , 2013, PloS one.

[6]  Raghu Pasupathy,et al.  A Testbed of Simulation-Optimization Problems , 2006, Proceedings of the 2006 Winter Simulation Conference.

[7]  F. Al-Shamali,et al.  Author Biographies. , 2015, Journal of social work in disability & rehabilitation.

[8]  John L. Nazareth,et al.  Introduction to derivative-free optimization , 2010, Math. Comput..

[9]  Raghu Pasupathy,et al.  ASTRO-DF: A Class of Adaptive Sampling Trust-Region Algorithms for Derivative-Free Stochastic Optimization , 2016, SIAM J. Optim..

[10]  Katya Scheinberg,et al.  Global Convergence of General Derivative-Free Trust-Region Algorithms to First- and Second-Order Critical Points , 2009, SIAM J. Optim..

[11]  Michel Bierlaire,et al.  A surrogate model for traffic optimization of congested networks: an analytic queueing network approach , 2009 .

[12]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[13]  Jeffrey Larson,et al.  DERIVATIVE-FREE OPTIMIZATION OF NOISY FUNCTIONS , 2012 .

[14]  Katya Scheinberg,et al.  Stochastic optimization using a trust-region method and random models , 2015, Mathematical Programming.

[15]  H. Sherali,et al.  Applied Optimization Methods for Wireless Networks: Methods for Near-optimal and Approximation Solutions , 2014 .

[16]  R. Pasupathy,et al.  ASTRO-DF: A CLASS OF ADAPTIVE SAMPLING TRUST-REGION ALGORITHMS FOR DERIVATIVE-FREE SIMULATION OPTIMIZATION , 2015 .

[17]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..