Thin-Plate Spline RBF surrogate model for global optimization algorithms

Improving performance and reducing costs are major challenges in many engineering design problems. The processes or accurate models are usually time-consuming and computationally expensive; therefore, the objective function requires a large number of evaluations. This paper considers surrogate modeling to approximate the expensive function and to ensure the quality of results in a reduced CPU time for mono-objective optimization. The Basic idea of surrogate models, also known as a meta-model, is to build a model from a sampled data, then, the outputs of other design data can be predicted by the approximated model instead of using the heavy one. Once the surrogate model is built, an optimization method is used to look for new design points until convergence. In this work, we propose a surrogate-based optimization algorithm using backtracking search algorithm optimization, and the thin spline basis function to build the surrogate model. During the construction of the surrogate, a minimization problem of error is carried out by updating the position of the node that produces the maximum error. Experiments are carried out on many test functions.

[1]  G. Gary Wang,et al.  ADAPTIVE RESPONSE SURFACE METHOD - A GLOBAL OPTIMIZATION SCHEME FOR APPROXIMATION-BASED DESIGN PROBLEMS , 2001 .

[2]  Ying Tan,et al.  Surrogate-assisted hierarchical particle swarm optimization , 2018, Inf. Sci..

[3]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[4]  Haoquan Liang,et al.  Comment on “Metamodeling Method Using Dynamic Kriging for Design Optimization” , 2013 .

[5]  Liang Gao,et al.  Ensemble of surrogates assisted particle swarm optimization of medium scale expensive problems , 2019, Appl. Soft Comput..

[6]  Abderrahmane Habbal,et al.  New hybrid algorithm based on nonmonotone spectral gradient and simultaneous perturbation , 2019, Int. J. Math. Model. Numer. Optimisation.

[7]  Shmuel Rippa,et al.  An algorithm for selecting a good value for the parameter c in radial basis function interpolation , 1999, Adv. Comput. Math..

[8]  Xinyu Li,et al.  Efficient Generalized Surrogate-Assisted Evolutionary Algorithm for High-Dimensional Expensive Problems , 2020, IEEE Transactions on Evolutionary Computation.

[9]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[10]  Caro Lucas,et al.  Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition , 2007, 2007 IEEE Congress on Evolutionary Computation.

[11]  Scott A. Sarra,et al.  A random variable shape parameter strategy for radial basis function approximation methods , 2009 .

[12]  Ky Khac Vu,et al.  Surrogate-based methods for black-box optimization , 2017, Int. Trans. Oper. Res..

[13]  R. Courant Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[14]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[15]  V. Vapnik The Support Vector Method of Function Estimation , 1998 .

[16]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[17]  Leifur Leifsson,et al.  Surrogate-Based Methods , 2011, Computational Optimization, Methods and Algorithms.

[18]  R. L. Hardy Multiquadric equations of topography and other irregular surfaces , 1971 .

[19]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[20]  Alexander I. J. Forrester,et al.  Multi-fidelity optimization via surrogate modelling , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[21]  Jianchao Zeng,et al.  Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems , 2017, IEEE Transactions on Evolutionary Computation.

[22]  Robert Schaback,et al.  Error estimates and condition numbers for radial basis function interpolation , 1995, Adv. Comput. Math..

[23]  Alberto Costa,et al.  RBFOpt: an open-source library for black-box optimization with costly function evaluations , 2018, Mathematical Programming Computation.

[24]  Pinar Çivicioglu,et al.  Backtracking Search Optimization Algorithm for numerical optimization problems , 2013, Appl. Math. Comput..