Expected improvement of constraint violation for expensive constrained optimization

For computationally expensive constrained optimization problems, one crucial issue is that the existing expected improvement (EI) criteria are no longer applicable when a feasible point is not initially provided. To address this challenge, this paper uses the expected improvement of constraint violation to reach feasible region. A new constrained expected improvement criterion is proposed to select sample solutions for the update of Gaussian process (GP) surrogate models. The validity of the proposed constrained expected improvement criterion is proved theoretically. It is also verified by experimental studies and results show that it performs better than or competitive to compared criteria.

[1]  Julien Marzat,et al.  Analysis of multi-objective Kriging-based methods for constrained global optimization , 2016, Comput. Optim. Appl..

[2]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[3]  Kalyanmoy Deb,et al.  A Generative Kriging Surrogate Model for Constrained and Unconstrained Multi-objective Optimization , 2016, GECCO.

[4]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[5]  Bernhard Sendhoff,et al.  A Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling , 2015, IEEE Transactions on Evolutionary Computation.

[6]  M. Stein Large sample properties of simulations using latin hypercube sampling , 1987 .

[7]  Kaisa Miettinen,et al.  A survey on handling computationally expensive multiobjective optimization problems with evolutionary algorithms , 2017, Soft Computing.

[8]  Tapabrata Ray,et al.  A study on the effectiveness of constraint handling schemes within Efficient Global Optimization framework , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[9]  Kaisa Miettinen,et al.  A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[10]  Kalyanmoy Deb,et al.  Constraint handling in efficient global optimization , 2017, GECCO.

[11]  Ruwang Jiao,et al.  A General Framework of Dynamic Constrained Multiobjective Evolutionary Algorithms for Constrained Optimization , 2017, IEEE Transactions on Cybernetics.

[12]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[13]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Changhe Li,et al.  Typical Constrained Optimization Formulation in Evolutionary Computation Not Suitable for Expensive Optimization , 2017, ISICA.

[15]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[16]  Shigeru Obayashi,et al.  Expected Improvement of Penalty-Based Boundary Intersection for Expensive Multiobjective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[17]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..