Multi-Objective Bayesian Global Optimization using expected hypervolume improvement gradient

Abstract The Expected Hypervolume Improvement (EHVI) is a frequently used infill criterion in Multi-Objective Bayesian Global Optimization (MOBGO), due to its good ability to lead the exploration. Recently, the computational complexity of EHVI calculation is reduced to O(n log n) for both 2-D and 3-D cases. However, the optimizer in MOBGO still requires a significant amount of time, because the calculation of EHVI is carried out in each iteration and usually tens of thousands of the EHVI calculations are required. This paper derives a formula for the Expected Hypervolume Improvement Gradient (EHVIG) and proposes an efficient algorithm to calculate EHVIG. The new criterion (EHVIG) is utilized by two different strategies to improve the efficiency of the optimizer discussed in this paper. Firstly, it enables gradient ascent methods to be used in MOBGO. Moreover, since the EHVIG of an optimal solution should be a zero vector, it can be regarded as a stopping criterion in global optimization, e.g., in Evolution Strategies. Empirical experiments are performed on seven benchmark problems. The experimental results show that the second proposed strategy, using EHVIG as a stopping criterion for local search, can outperform the normal MOBGO on problems where the optimal solutions are located in the interior of the search space. For the ZDT series test problems, EHVIG still can perform better when gradient projection is applied.

[1]  Wolfgang Ponweiser,et al.  On Expected-Improvement Criteria for Model-based Multi-objective Optimization , 2010, PPSN.

[2]  Michael T. M. Emmerich,et al.  Faster Exact Algorithms for Computing Expected Hypervolume Improvement , 2015, EMO.

[3]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[4]  Shigeru Obayashi,et al.  Kriging-surrogate-based optimization considering expected hypervolume improvement in non-constrained many-objective test problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[5]  Mark Fleischer,et al.  The measure of pareto optima: Applications to multi-objective metaheuristics , 2003 .

[6]  Thomas Bäck,et al.  Truncated expected hypervolume improvement: Exact computation and application , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[7]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[8]  Hao Wang,et al.  A Multicriteria Generalization of Bayesian Global Optimization , 2016, Advances in Stochastic and Deterministic Global Optimization.

[9]  Carlos M. Fonseca,et al.  Computing Hypervolume Contributions in Low Dimensions: Asymptotically Optimal Algorithm and Complexity Results , 2011, EMO.

[10]  Intan Zaurah Mat Darus,et al.  PID controller tuning using evolutionary algorithms , 2012 .

[11]  Shinn-Ying Ho,et al.  Designing structure-specified mixed H/sub 2//H/sub /spl infin// optimal controllers using an intelligent genetic algorithm IGA , 2005, IEEE Transactions on Control Systems Technology.

[12]  Hao Wang,et al.  Balancing risk and expected gain in kriging-based global optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[13]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[14]  Carlos M. Fonseca,et al.  Computing 3-D Expected Hypervolume Improvement and Related Integrals in Asymptotically Optimal Time , 2017, EMO.

[15]  E. Vázquez,et al.  Convergence properties of the expected improvement algorithm with fixed mean and covariance functions , 2007, 0712.3744.

[16]  Michael T. M. Emmerich,et al.  Hypervolume-based expected improvement: Monotonicity properties and exact computation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[17]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[18]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[19]  Tinkle Chugh,et al.  Handling expensive multiobjective optimization problems with evolutionary algorithms , 2017 .

[20]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[21]  Thomas Bäck,et al.  Metamodel-assisted mixed integer evolution strategies and their application to intravascular ultrasound image analysis , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[22]  Harold J. Kushner,et al.  A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise , 1963 .

[23]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[24]  T. Furukawa,et al.  Pareto‐based continuous evolutionary algorithms for multiobjective optimization , 2002 .

[25]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[26]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[27]  Shigeru Obayashi,et al.  Kriging model based many-objective optimization with efficient calculation of expected hypervolume improvement , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[28]  Thomas Bäck,et al.  Preference-based multiobjective optimization using truncated expected hypervolume improvement , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[29]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[30]  J. Mockus Bayesian Approach to Global Optimization: Theory and Applications , 1989 .

[31]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[32]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[33]  Thomas Bäck,et al.  Expected hypervolume improvement algorithm for PID controller tuning and the multiobjective dynamical control of a biogas plant , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[34]  Timothy M. Chan Klee's Measure Problem Made Easy , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[35]  Bor-Sen Chen,et al.  A structure-specified H∞ optimal control design for practical applications: a genetic approach , 1998, IEEE Trans. Control. Syst. Technol..

[36]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[37]  Nicola Beume,et al.  On the Complexity of Computing the Hypervolume Indicator , 2009, IEEE Transactions on Evolutionary Computation.

[38]  Ponnuthurai N. Suganthan,et al.  Multi-objective robust PID controller tuning using two lbests multi-objective particle swarm optimization , 2011, Inf. Sci..

[39]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum , 1974, Optimization Techniques.

[40]  Michael T. M. Emmerich,et al.  Test Problems Based on Lamé Superspheres , 2007, EMO.

[41]  Pedro Oliveira,et al.  An evolution strategy for multiobjective optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[42]  Tom Dhaene,et al.  Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization , 2014, J. Glob. Optim..

[43]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[44]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[45]  Pierre Borne,et al.  Tuning PID Controller Using Multiobjective Ant Colony Optimization , 2012, Appl. Comput. Intell. Soft Comput..

[46]  J. Dennis,et al.  MANAGING APPROXIMATION MODELS IN OPTIMIZATION , 2007 .