A Multicriteria Generalization of Bayesian Global Optimization

This chapter discusses a generalization of the expected improvement used in Bayesian global optimization to the multicriteria optimization domain, where the goal is to find an approximation to the Pareto front. The expected hypervolume improvement (EHVI) measures improvement as the gain in dominated hypervolume relative to a given approximation to the Pareto front. We will review known properties of the EHVI, applications in practice and propose a new exact algorithm for computing EHVI. The new algorithm has asymptotically optimal time complexity O(nlogn). This improves existing computation schemes by a factor of n∕logn. It shows that this measure, at least for a small number of objective functions, is as fast as other simpler measures of multicriteria expected improvement that were considered in recent years.

[1]  Shigeru Obayashi,et al.  Updating Kriging Surrogate Models Based on the Hypervolume Indicator in Multi-Objective Optimization , 2013 .

[2]  Michael T. M. Emmerich,et al.  Hypervolume-based expected improvement: Monotonicity properties and exact computation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[3]  J. Mockus,et al.  The Bayesian approach to global optimization , 1989 .

[4]  Wolfgang Ponweiser,et al.  On Expected-Improvement Criteria for Model-based Multi-objective Optimization , 2010, PPSN.

[5]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[6]  Andy J. Keane,et al.  Statistical Improvement Criteria for Use in Multiobjective Design Optimization , 2006 .

[7]  Michael T. M. Emmerich,et al.  Faster Exact Algorithms for Computing Expected Hypervolume Improvement , 2015, EMO.

[8]  Shigeru Obayashi,et al.  Comparison of the criteria for updating Kriging response surface models in multi-objective optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[9]  Michael T. M. Emmerich,et al.  Faster Computation of Expected Hypervolume Improvement , 2014, ArXiv.

[10]  Tom Dhaene,et al.  Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization , 2014, J. Glob. Optim..

[11]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[12]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[13]  Thomas Bäck,et al.  Efficient multi-criteria optimization on noisy machine learning problems , 2015, Appl. Soft Comput..

[14]  Daniel Gaida,et al.  Dynamic real-time substrate feed optimization of anaerobic co-digestion plants , 2014 .

[15]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Thomas Bartz-Beielstein,et al.  A Case Study on Multi-Criteria Optimization of an Event Detection Software under Limited Budgets , 2013, EMO.

[17]  Ofer M. Shir,et al.  The application of evolutionary multi-criteria optimization to dynamic molecular alignment , 2007, 2007 IEEE Congress on Evolutionary Computation.

[18]  Howie Choset,et al.  Adapting control policies for expensive systems to changing environments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[21]  E. Vázquez,et al.  Convergence properties of the expected improvement algorithm with fixed mean and covariance functions , 2007, 0712.3744.