Constraint handling in efficient global optimization

Real-world optimization problems are often subject to several constraints which are expensive to evaluate in terms of cost or time. Although a lot of effort is devoted to make use of surrogate models for expensive optimization tasks, not many strong surrogate-assisted algorithms can address the challenging constrained problems. Efficient Global Optimization (EGO) is a Kriging-based surrogate-assisted algorithm. It was originally proposed to address unconstrained problems and later was modified to solve constrained problems. However, these type of algorithms still suffer from several issues, mainly: (1) early stagnation, (2) problems with multiple active constraints and (3) frequent crashes. In this work, we introduce a new EGO-based algorithm which tries to overcome these common issues with Kriging optimization algorithms. We apply the proposed algorithm on problems with dimension d ≤ 4 from the G-function suite [16] and on an airfoil shape example.

[1]  D. Krige.  A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[2]  I. H. Abbott,et al.  Theory of Wing Sections: Including a Summary of Airfoil Data , 1959 .

[3]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum and their Application , 1977, IFIP Congress.

[4]  R. M. Hicks,et al.  Wing Design by Numerical Optimization , 1977 .

[5]  M. Giles,et al.  Viscous-inviscid analysis of transonic and low Reynolds number airfoils , 1986 .

[6]  M. Drela.  XFOIL: An Analysis and Design System for Low Reynolds Number Airfoils , 1989 .

[7]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[8]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[9]  A. J. Booker,et al.  A rigorous framework for optimization of expensive functions by surrogates , 1998 .

[10]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[11]  Charles Audet,et al.  A surrogate-model-based method for constrained optimization , 2000 .

[12]  Panos Y. Papalambros,et al.  The Use of Surrogate Modeling Algorithms to Exploit Disparities in Function Computation Time within , 2001 .

[13]  M. Sasena,et al.  Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization , 2002 .

[14]  Kyriakos C. Giannakoglou,et al.  Design of optimal aerodynamic shapes using stochastic optimization methods and computational intelligence , 2002 .

[15]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[17]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[18]  Robert B. Gramacy,et al.  Optimization Under Unknown Constraints , 2010, 1004.4027.

[19]  Andy J. Keane,et al.  Review of efficient surrogate infill sampling criteria with constraint handling , 2010 .

[20]  James M. Parr,et al.  Infill sampling criteria for surrogate-based optimization with constraint handling , 2012 .

[21]  R. Haftka,et al.  Surrogate-Based Agents for Constrained Optimization , 2012, 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference<BR>20th AIAA/ASME/AHS Adaptive Structures Conference<BR>14th AIAA.

[22]  Giovanni Petrone,et al.  Optimization Under Uncertainty Using the Generalized Inverse Distribution Function , 2014, Modeling, Simulation and Optimization for Science and Technology.

[23]  Victor Picheny,et al.  A Stepwise uncertainty reduction approach to constrained global optimization , 2014, AISTATS.

[24]  R. Regis.  Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points , 2014 .

[25]  N. Hansen,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.

[26]  Emiliano Iuliano,et al.  Evolutionary Optimization of Benchmark Aerodynamic Cases using Physics-based Surrogate Models , 2015 .

[27]  Kalyanmoy Deb,et al.  A Generative Kriging Surrogate Model for Constrained and Unconstrained Multi-objective Optimization , 2016, GECCO.

[28]  Thomas Bäck,et al.  Online selection of surrogate models for constrained black-box optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[29]  Julien Marzat,et al.  Analysis of multi-objective Kriging-based methods for constrained global optimization , 2016, Comput. Optim. Appl..

[30]  A. Strauß.  Theory Of Wing Sections Including A Summary Of Airfoil Data , 2016 .