Tabu efficient global optimization with applications in additive manufacturing

Methods based on Gaussian stochastic process (GSP) models and expected improvement (EI) functions have been promising for box-constrained expensive optimization problems. These include robust design problems with environmental variables having set-type constraints. However, the methods that combine GSP and EI sub-optimizations suffer from the following problem, which limits their computational performance. Efficient global optimization (EGO) methods often repeat the same or nearly the same experimental points. We present a novel EGO-type constraint-handling method that maintains a so-called tabu list to avoid past points. Our method includes two types of penalties for the key “infill” optimization, which selects the next test runs. We benchmark our tabu EGO algorithm with five alternative approaches, including DIRECT methods using nine test problems and two engineering examples. The engineering examples are based on additive manufacturing process parameter optimization informed using point-based thermal simulations and robust-type quality constraints. Our test problems span unconstrained, simply constrained, and robust constrained problems. The comparative results imply that tabu EGO offers very promising computational performance for all types of black-box optimization in terms of convergence speed and the quality of the final solution.

[1]  Charles Audet,et al.  A surrogate-model-based method for constrained optimization , 2000 .

[2]  Fred W. Glover,et al.  Hybrid scatter tabu search for unconstrained global optimization , 2011, Ann. Oper. Res..

[3]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[4]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[5]  G. G. Wang,et al.  Mode-pursuing sampling method for global optimization on expensive black-box functions , 2004 .

[6]  Shahryar Rahnamayan,et al.  Constraint Importance Mode Pursuing Sampling for Continuous Global Optimization , 2010, DAC 2010.

[7]  Theodore T. Allen,et al.  Design and analysis of variable fidelity experimentation applied to engine valve heat treatment process design , 2005 .

[8]  M. Sasena,et al.  Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization , 2002 .

[9]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[10]  Patrick Siarry,et al.  Tabu Search applied to global optimization , 2000, Eur. J. Oper. Res..

[11]  Dimitris Bertsimas,et al.  Nonconvex Robust Optimization for Problems with Constraints , 2010, INFORMS J. Comput..

[12]  Matthijs Langelaar,et al.  Expected improvement based infill sampling for global robust optimization of constrained problems , 2017 .

[13]  William E. Frazier,et al.  Metal Additive Manufacturing: A Review , 2014, Journal of Materials Engineering and Performance.

[14]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[15]  G. Matheron Principles of geostatistics , 1963 .

[16]  Edwin J. Schwalbach,et al.  A discrete source model of powder bed fusion additive manufacturing thermal history , 2019, Additive Manufacturing.

[17]  Theodore T. Allen,et al.  Exploratory text data analysis for quality hypothesis generation , 2018, Quality Engineering.

[18]  Donald R. Jones,et al.  Direct Global Optimization Algorithm , 2009, Encyclopedia of Optimization.

[19]  R. A. Miller,et al.  Sequential kriging optimization using multiple-fidelity evaluations , 2006 .

[20]  Haiping Ma,et al.  Evolutionary Computation with Biogeography-based Optimization , 2017 .

[21]  Layne T. Watson,et al.  Efficient global optimization algorithm assisted by multiple surrogate techniques , 2012, Journal of Global Optimization.

[22]  Shengli Xu,et al.  Constrained global optimization via a DIRECT-type constraint-handling technique and an adaptive metamodeling strategy , 2017 .

[23]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[24]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[25]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[26]  Wallace G. Ferreira,et al.  Ensemble of metamodels: extensions of the least squares approach to efficient global optimization , 2017 .

[27]  N. Zheng,et al.  Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models , 2006, J. Glob. Optim..

[28]  Geng Lin,et al.  A hybrid binary particle swarm optimization with tabu search for the set-union knapsack problem , 2019, Expert Syst. Appl..

[29]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[30]  A. Forrester,et al.  Design and analysis of 'noisy' computer experiments , 2006 .

[31]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[32]  Rommel G. Regis,et al.  Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions , 2011, Comput. Oper. Res..

[33]  Shapour Azarm,et al.  A Kriging Metamodel Assisted Multi-Objective Genetic Algorithm for Design Optimization , 2008 .