Clustered multiple generalized expected improvement: A novel infill sampling criterion for surrogate models

Surrogate model-based optimization is a well-known technique for optimizing expensive black-box functions. By applying this function approximation, the number of real problem evaluations can be reduced because the optimization is performed on the model. In this case two contradictory targets have to be achieved: increasing global model accuracy and exploiting potentially optimal areas. The key to these targets is the criterion for selecting the next point, which is then evaluated on the expensive black-box function - the dasiainfill sampling criterionpsila. Therefore, a novel approach - the dasiaClustered Multiple Generalized Expected Improvementpsila (CMGEI) - is introduced and motivated by an empirical study. Furthermore, experiments benchmarking its performance compared to the state of the art are presented.

[1]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[2]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .

[3]  Wolfgang Ponweiser,et al.  Robust Handling of Multiple Multi-Objective Optimisations , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[4]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[5]  Mattias Björkman,et al.  Global Optimization of Costly Nonconvex Functions Using Radial Basis Functions , 2000 .

[6]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[8]  John W. Bandler,et al.  An Introduction to the Space Mapping Technique , 2001 .

[9]  Parveen Kumar Chandila,et al.  Strategy for Global Optimization and Post-Optimality Using Local Kriging Approximations , 2004 .

[10]  A. A. Torn Cluster Analysis Using Seed Points and Density-Determined Hyperspheres as an Aid to Global Optimization , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  M. Sasena,et al.  Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization , 2002 .

[12]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[13]  Virginia Torczon,et al.  Using approximations to accelerate engineering design optimization , 1998 .

[14]  Kok Wai Wong,et al.  Surrogate-Assisted Evolutionary Optimization Frameworks for High-Fidelity Engineering Design Problems , 2005 .

[15]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[16]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[17]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[19]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[20]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[21]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[22]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[23]  John W. Bandler,et al.  Space mapping technique for electromagnetic optimization , 1994 .

[24]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[25]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[26]  G. Matheron Principles of geostatistics , 1963 .

[27]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[28]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[30]  Wolfgang Ponweiser,et al.  The Multiple Multi Objective Problem - Definition, Solution and Evaluation , 2007, EMO.