A surrogate-assisted evolution strategy for constrained multi-objective optimization

New surrogate-assisted ES for constrained multi-objective optimization is developed.Surrogates are used to identify the most promising among many trial offspring.A radial basis function (RBF) model is used to implement the method.Method is tested on benchmark problems and manufacturing and robotics applications.Proposed method generally outperforms an ES and NSGA-II on the problems used. In many real-world optimization problems, several conflicting objectives must be achieved and optimized simultaneously and the solutions are often required to satisfy certain restrictions or constraints. Moreover, in some applications, the numerical values of the objectives and constraints are obtained from computationally expensive simulations. Many multi-objective optimization algorithms for continuous optimization have been proposed in the literature and some have been incorporated or used in conjunction with expert and intelligent systems. However, relatively few of these multi-objective algorithms handle constraints, and even fewer, use surrogates to approximate the objective or constraint functions when these functions are computationally expensive. This paper proposes a surrogate-assisted evolution strategy (ES) that can be used for constrained multi-objective optimization of expensive black-box objective functions subject to expensive black-box inequality constraints. Such an algorithm can be incorporated into an intelligent system that finds approximate Pareto optimal solutions to simulation-based constrained multi-objective optimization problems in various applications including engineering design optimization, production management and manufacturing. The main idea in the proposed algorithm is to generate a large number of trial offspring in each generation and use the surrogates to predict the objective and constraint function values of these trial offspring. Then the algorithm performs an approximate non-dominated sort of the trial offspring based on the predicted objective and constraint function values, and then it selects the most promising offspring (those with the smallest predicted ranks from the non-dominated sort) to become the actual offspring for the current generation that will be evaluated using the expensive objective and constraint functions. The proposed method is implemented using cubic radial basis function (RBF) surrogate models to assist the ES. The resulting RBF-assisted ES is compared with the original ES and to NSGA-II on 20 test problems involving 2-15 decision variables, 2-5 objectives and up to 13 inequality constraints. These problems include well-known benchmark problems and application problems in manufacturing and robotics. The numerical results showed that the RBF-assisted ES generally outperformed the original ES and NSGA-II on the problems used when the computational budget is relatively limited. These results suggest that the proposed surrogate-assisted ES is promising for computationally expensive constrained multi-objective optimization.

[1]  R. Saravanan,et al.  Evolutionary multi criteria design optimization of robot grippers , 2009, Appl. Soft Comput..

[2]  Kalyanmoy Deb,et al.  Controlled Elitist Non-dominated Sorting Genetic Algorithms for Better Convergence , 2001, EMO.

[3]  Wolfgang Ponweiser,et al.  On Expected-Improvement Criteria for Model-based Multi-objective Optimization , 2010, PPSN.

[4]  Andrzej Osyczka,et al.  Evolutionary Algorithms for Single and Multicriteria Design Optimization , 2001 .

[5]  Hirotaka Nakayama,et al.  Meta-Modeling in Multiobjective Optimization , 2008, Multiobjective Optimization.

[6]  Taimoor Akhtar,et al.  Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection , 2016, J. Glob. Optim..

[7]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[8]  Howie Choset,et al.  Expensive multiobjective optimization for robotics , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Erdem Acar,et al.  Effect of error metrics on optimum weight factor selection for ensemble of metamodels , 2015, Expert Syst. Appl..

[10]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[11]  Tom Dhaene,et al.  A constrained multi-objective surrogate-based optimization algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[12]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[13]  Christine A. Shoemaker,et al.  ORBIT: Optimization by Radial Basis Function Interpolation in Trust-Regions , 2008, SIAM J. Sci. Comput..

[14]  Sujin Bureerat,et al.  Optimum plate-fin heat sinks by using a multi-objective evolutionary algorithm , 2010 .

[15]  Singiresu S. Rao Engineering Optimization : Theory and Practice , 2010 .

[16]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[17]  Liang Shi,et al.  ASAGA: an adaptive surrogate-assisted genetic algorithm , 2008, GECCO '08.

[18]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[19]  Tapabrata Ray,et al.  A surrogate assisted parallel multiobjective evolutionary algorithm for robust engineering design , 2006 .

[20]  Sujin Bureerat,et al.  Multi-objective topology optimization using evolutionary algorithms , 2011 .

[21]  Efrén Mezura-Montes,et al.  Empirical analysis of a modified Artificial Bee Colony for constrained numerical optimization , 2012, Appl. Math. Comput..

[22]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[23]  Maumita Bhattacharya,et al.  Surrogate based EA for expensive optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[24]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[25]  Rommel G. Regis,et al.  An Initialization Strategy for High-Dimensional Surrogate-Based Expensive Black-Box Optimization , 2013 .

[26]  Ramón Quiza Sardiñas,et al.  Genetic algorithm-based multi-objective optimization of cutting parameters in turning processes , 2006, Eng. Appl. Artif. Intell..

[27]  Sancho Salcedo-Sanz,et al.  Efficient aerodynamic design through evolutionary programming and support vector regression algorithms , 2012, Expert Syst. Appl..

[28]  Kalyanmoy Deb,et al.  Multi-objective design and analysis of robot gripper configurations using an evolutionary-classical approach , 2011, GECCO '11.

[29]  Tom Dhaene,et al.  Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization , 2014, J. Glob. Optim..

[30]  Sujin Bureerat,et al.  Comparative Performance of Surrogate-Assisted MOEAs for Geometrical Design of Pin-Fin Heat Sinks , 2012, J. Appl. Math..

[31]  A. Osyczka,et al.  Computer aided multicriterion optimization system for computationally expensive functions , 1994 .

[32]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[33]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[34]  Lothar Thiele,et al.  An evolutionary algorithm for multiobjective optimization: the strength Pareto approach , 1998 .

[35]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[36]  Erik D. Goodman,et al.  A New Repair Operator for Multi-objective Evolutionary Algorithm in Constrained Optimization Problems , 2015, ArXiv.

[37]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[38]  Dongkon Lee,et al.  A knowledge-based expert system as a pre-post processor in engineering optimization , 1996 .

[39]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[40]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[41]  Bernd Noche,et al.  Simulation-based optimization for a capacitated multi-echelon production-inventory system , 2015, J. Simulation.

[42]  Hans-Martin Gutmann,et al.  A Radial Basis Function Method for Global Optimization , 2001, J. Glob. Optim..

[43]  Charles Audet,et al.  A mesh adaptive direct search algorithm for multiobjective optimization , 2009, Eur. J. Oper. Res..

[44]  Luís N. Vicente,et al.  Direct Multisearch for Multiobjective Optimization , 2011, SIAM J. Optim..

[45]  Hui Li,et al.  Difficulty Controllable and Scalable Constrained Multi-objective Test Problems , 2015, 2015 International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration.

[46]  Jong-hyun Ryu,et al.  A Derivative-Free Trust-Region Method for Biobjective Optimization , 2014, SIAM J. Optim..

[47]  Rommel G. Regis,et al.  Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions , 2011, Comput. Oper. Res..

[48]  Kwang-Yong Kim,et al.  Enhanced multi‐objective optimization of a dimpled channel through evolutionary algorithms and multiple surrogate methods , 2011 .

[49]  Franci Cus,et al.  Optimization of cutting process by GA approach , 2003 .

[50]  Fan Sun,et al.  Parameter estimation of a pressure swing adsorption model for air separation using multi-objective optimisation and support vector regression model , 2013, Expert Syst. Appl..

[51]  Richard F. Hartl,et al.  Simulation-based optimization methods for setting production planning parameters , 2014 .

[52]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[53]  Emilio Corchado,et al.  A novel hybrid intelligent system for multi-objective machine parameter optimization , 2013, Pattern Analysis and Applications.

[54]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[55]  Christine A. Shoemaker,et al.  Local function approximation in evolutionary algorithms for the optimization of costly functions , 2004, IEEE Transactions on Evolutionary Computation.

[56]  Renata Kasperska,et al.  Polyoptimal design of sandwich cylindrical panels with the application of an expert system , 2006 .

[57]  Tapabrata Ray,et al.  Multi-objective design optimisation using multiple adaptive spatially distributed surrogates , 2009 .