Expected Improvements for the Asynchronous Parallel Global Optimization of Expensive Functions: Potentials and Challenges

Sequential sampling strategies based on Gaussian processes are now widely used for the optimization of problems involving costly simulations. But Gaussian processes can also generate parallel optimization strategies. We focus here on a new, parameter free, parallel expected improvement criterion for asynchronous optimization. An estimation of the criterion, which mixes Monte Carlo sampling and analytical bounds, is proposed. Logarithmic speed-ups are measured on 1 and 9 dimensional functions.

[1]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[2]  Stephen J. Leary,et al.  A parallel updating scheme for approximating and optimizing high fidelity computer simulations , 2004 .

[3]  Rodolphe Le Riche,et al.  Parallel Expected Improvements for Global Optimization: Summary, Bounds and Speed-up , 2011 .

[4]  D. Ginsbourger,et al.  Dealing with asynchronicity in parallel Gaussian Process based global optimization , 2010 .

[5]  P Brochet,et al.  A Parallel Multiobjective Efficient Global Optimization: The Finite Element Method in Optimal Design and Model Development , 2010, IEEE Transactions on Magnetics.

[6]  Jürgen Branke,et al.  Distribution of Evolutionary Algorithms in Heterogeneous Networks , 2004, GECCO.

[7]  Christine A. Shoemaker,et al.  Parallel radial basis function methods for the global optimization of expensive functions , 2007, Eur. J. Oper. Res..

[8]  Riccardo Poli,et al.  Genetic and Evolutionary Computation – GECCO 2004 , 2004, Lecture Notes in Computer Science.

[9]  D. Ginsbourger,et al.  Kriging is well-suited to parallelize optimization , 2010 .

[10]  Tamara G. Kolda,et al.  Revisiting Asynchronous Parallel Pattern Search for Nonlinear Optimization , 2005, SIAM J. Optim..

[11]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[12]  Chi-Keong Goh,et al.  Computational Intelligence in Expensive Optimization Problems , 2010 .