Radial Basis Surrogate Model Integrated to Evolutionary Algorithm for Solving Computation Intensive Black-Box Problems

For design optimization with high-dimensional expensive problems, an effective and efficient optimization methodology is desired. This work proposes a series of modification to the Differential Evolution (DE) algorithm for solving computation Intensive Black-Box Problems. The proposed methodology is called Radial Basis Meta-Model Algorithm Assisted Differential Evolutionary (RBF-DE), which is a global optimization algorithm based on the meta-modeling techniques. A meta-modeling assisted DE is proposed to solve computationally expensive optimization problems. The Radial Basis Function (RBF) model is used as a surrogate model to approximate the expensive objective function, while DE employs a mechanism to dynamically select the best performing combination of parameters such as differential rate, cross over probability, and population size. The proposed algorithm is tested on benchmark functions and real life practical applications and problems. The test results demonstrate that the proposed algorithm is promising and performs well compared to other optimization algorithms. The proposed algorithm is capable of converging to acceptable and good solutions in terms of accuracy, number of evaluations, and time needed to converge. Keywords—Differential evolution, engineering design, expensive computations, meta-modeling, radial basis function, optimization.

[1]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[2]  S. Rippa,et al.  Numerical Procedures for Surface Fitting of Scattered Data by Radial Functions , 1986 .

[3]  N. Cressie.  The origins of kriging , 1990 .

[4]  R. L. Hardy.  Multiquadric equations of topography and other irregular surfaces , 1971 .

[5]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[6]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[7]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[8]  T. W. Layne,et al.  A Comparison of Approximation Modeling Techniques: Polynomial Versus Interpolating Models , 1998 .

[9]  P. Rocca,et al.  Differential Evolution as Applied to Electromagnetics , 2011, IEEE Antennas and Propagation Magazine.

[10]  C. Darwin.  On the Origin of Species by Means of Natural Selection: Or, The Preservation of Favoured Races in the Struggle for Life , 2019 .

[11]  D. G. Regulwar,et al.  Differential Evolution Algorithm with Application to Optimal Operation of Multipurpose Reservoir , 2010 .

[12]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[13]  Aleksandrs Korjakins,et al.  Surrogate Models for Optimum Design of Stiffened Composite Shells , 2004 .

[14]  R. H. Myers,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[15]  Marte Ramõ ´ rez-Ortegon.  Circle detection using discrete differential evolution optimization , 2011 .

[16]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[17]  Omar Kettani,et al.  A Quantum Differential Evolutionary Algorithm for the Independent Set Problem , 2012 .

[18]  M. Sasena,et al.  Global optimization of problems with disconnected feasible regions via surrogate modeling , 2002 .

[19]  Cristina H. Amon,et al.  An engineering design methodology with multistage Bayesian surrogates and optimal sampling , 1996 .

[20]  Adel Younis,et al.  Space exploration and region elimination global optimization algorithms for multidisciplinary design optimization , 2010 .

[21]  I. Kaymaz,et al.  A response surface method based on weighted regression for structural reliability analysis , 2005 .

[22]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[23]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[24]  Richard K. Beatson,et al.  Fast fitting of radial basis functions: Methods based on preconditioned GMRES iteration , 1999, Adv. Comput. Math..

[25]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[26]  Vassilis P. Plagianakos,et al.  Parallel evolutionary training algorithms for “hardware-friendly” neural networks , 2002, Natural Computing.

[27]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..