A Review of Techniques for Handling Expensive Functions in Evolutionary Multi-Objective Optimization

Evolutionary algorithms have been very popular for solving multiobjective optimization problems, mainly because of their ease of use, and their wide applicability. However, multi-objective evolutionary algorithms (MOEAs) tend to consume an important number of objective function evaluations, in order to achieve a reasonably good approximation of the Pareto front. This is a major concern when attempting to use MOEAs for real-world applications, since we can normally afford only a fairly limited number of fitness function evaluations in such cases. Despite these concerns, relatively few efforts have been reported in the literature to reduce the computational cost of MOEAs. It has been until relatively recently, that researchers have developed techniques to achieve an effective reduction of fitness function evaluations by exploiting knowledge acquired during the search. In this chapter, we analyze different proposals currently available in the specialized literature to deal with expensive functions in evolutionary multi-objective optimization. Additionally, we review some real-world applications of these methods, which can be seen as case studies in which such techniques led to a substantial reduction in the computational cost of the MOEA adopted. Finally, we also indicate some of the potential paths for future research in this area.

[1]  Kyriakos C. Giannakoglou,et al.  A multilevel approach to single- and multiobjective aerodynamic optimization , 2008 .

[2]  Andreas Zell,et al.  Model-Assisted Steady-State Evolution Strategies , 2003, GECCO.

[3]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .

[4]  R. L. Hardy Multiquadric equations of topography and other irregular surfaces , 1971 .

[5]  C. Coello,et al.  Multiobjective optimization using a micro-genetic algorithm , 2001 .

[6]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[7]  Juan J. Alonso,et al.  Mutiobjective Optimization Using Approximation Model-Based Genetic Algorithms , 2004 .

[8]  Hirotaka Nakayama,et al.  Support Vector Regression Based on Goal Programming and Multi-objective Programming , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[9]  Carlos A. Coello Coello,et al.  A study of fitness inheritance and approximation techniques for multi-objective particle swarm optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[10]  Bernhard Sendhoff,et al.  Structure optimization of neural networks for evolutionary design optimization , 2005, Soft Comput..

[11]  T. W. Layne,et al.  A Comparison of Approximation Modeling Techniques: Polynomial Versus Interpolating Models , 1998 .

[12]  Mikkel T. Jensen,et al.  Reducing the run-time complexity of multiobjective EAs: The NSGA-II and other algorithms , 2003, IEEE Trans. Evol. Comput..

[13]  Hirotaka Nakayama,et al.  Meta-Modeling in Multiobjective Optimization , 2008, Multiobjective Optimization.

[14]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[15]  Thomas Bäck,et al.  Parallel Problem Solving from Nature — PPSN V , 1998, Lecture Notes in Computer Science.

[16]  Man Mohan Rai,et al.  Robust Optimal Design With Differential Evolution , 2004 .

[17]  Marc Schoenauer,et al.  Surrogate Deterministic Mutation: Preliminary Results , 2001, Artificial Evolution.

[18]  Luis F. Gonzalez,et al.  Robust design optimisation using multi-objectiveevolutionary algorithms , 2008 .

[19]  Edmund K. Burke,et al.  Parallel Problem Solving from Nature - PPSN IX: 9th International Conference, Reykjavik, Iceland, September 9-13, 2006, Proceedings , 2006, PPSN.

[20]  Hirotaka Nakayama,et al.  Satisficing Trade-off Method for Multiobjective Programming , 1984 .

[21]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[22]  Meng-Sing Liou,et al.  Multi-Objective Optimization of Transonic Compressor Blade Using Evolutionary Algorithm , 2005 .

[23]  Juan J. Alonso,et al.  Aircraft design optimization , 2009, Math. Comput. Simul..

[24]  Ramana V. Grandhi,et al.  Improved Distributed Hypercube Sampling , 2002 .

[25]  Shigeru Obayashi,et al.  Multidisciplinary design optimization of wing shape for a small jet aircraft using kriging model , 2006 .

[26]  Wahid Ghaly,et al.  A Strategy for Multi-Objective Shape Optimization for Turbine Stages in Three-Dimensional Flow , 2008 .

[27]  Manfred Grauer,et al.  Interactive Decision Analysis , 1984 .

[28]  Shigeru Obayashi,et al.  Optimization of Combustion Chamber for Diesel Engine Using Kriging Model , 2006 .

[29]  Tapabrata Ray,et al.  Performance of kriging and cokriging based surrogate models within the unified framework for surrogate assisted optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[30]  Horst Baier,et al.  A Multi -objective Evolutionary Algorithm with integrated Response Surface Functionalt ities for Configuration Optimization with Di screte Variables , 2004 .

[31]  Min-Jea Tahk,et al.  Acceleration of the convergence speed of evolutionary algorithms using multi-layer neural networks , 2003 .

[32]  R. Fletcher Practical Methods of Optimization , 1988 .

[33]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[34]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[35]  Kalyanmoy Deb,et al.  Multiobjective optimization , 1997 .

[36]  Andreas Zell,et al.  Evolution strategies assisted by Gaussian processes with improved preselection criterion , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[37]  K. Srinivas,et al.  Aerodynamic/RCS shape optimisation of unmanned aerial vehicles using hierarchical asynchronous parallel evolutionary algorithms , 2006 .

[38]  Carlos A. Coello Coello,et al.  A Micro-Genetic Algorithm for Multiobjective Optimization , 2001, EMO.

[39]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[40]  David E. Goldberg,et al.  Fitness Inheritance In Multi-objective Optimization , 2002, GECCO.

[41]  Carlos A. Coello Coello,et al.  Solving Hard Multiobjective Optimization Problems Using epsilon-Constraint with Cultured Differential Evolution , 2006, PPSN.

[42]  Edmondo A. Minisci,et al.  Multi-objective evolutionary optimization of subsonic airfoils by kriging approximation and evolution control , 2005, 2005 IEEE Congress on Evolutionary Computation.

[43]  Meng-Sing Liou,et al.  Multiobjective optimization using coupled response surface model and evolutionary algorithm , 2004 .

[44]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[45]  Jacques Periaux,et al.  Multi-objective robust design optimisation using hierarchical asynchronous parallel asynchronous evolutionary algorithms , 2005 .

[46]  Juan J. Alonso,et al.  Supersonic Business Jet Design using a Knowledge-Based Genetic Algorithm with an Adaptive, Unstructured Grid Methodology , 2003 .

[47]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[48]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[49]  Kazuhiro Nakahashi,et al.  Navier-Stokes optimization of supersonic wings with four design objectives using evolutionary algorithm , 2001 .

[50]  Stephane Pierret,et al.  Turbomachinery Blade Design Using a Navier–Stokes Solver and Artificial Neural Network , 1998 .

[51]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[52]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[53]  Kazuhiro Nakahashi,et al.  High-Fidelity Multidisciplinary Design Optimization of Wing Shape for Regional Jet Aircraft , 2005, EMO.

[54]  Bernard De Baets,et al.  Is Fitness Inheritance Useful for Real-World Applications? , 2003, EMO.

[55]  Hirotaka Nakayama,et al.  Approximate Optimization Using Computaional Intelligence and its Application to Reinforcement of Cable-stayed Bridges , 2006, Integrated Intelligent Systems for Engineering Design.

[56]  Kazuhiro Nakahashi,et al.  Navier-Stokes Optimization of Supersonic Wings with Four Objectives Using Evolutionary Algorithm , 2002 .

[57]  P. Cinnella,et al.  Optimal Airfoil Shapes for Viscous Transonic Flows of Dense Gases , 2006 .

[58]  Thomas Bäck,et al.  Metamodel-Assisted Evolution Strategies , 2002, PPSN.

[59]  Andy J. Keane,et al.  Surrogate-based aerodynamic shape optimization of a civil aircraft engine nacelle , 2007 .

[60]  Raphael T. Haftka,et al.  Response surface approximation of Pareto optimal front in multi-objective optimization , 2007 .

[61]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[62]  R. Haftka,et al.  Multiple Surrogates for the Shape Optimization of Bluff Body-Facilitated Mixing , 2005 .

[63]  Seongim Choi,et al.  Design of Low-boom Supersonic Business Jet with Evolutionary Algorithms Using Adaptive Unstructured Mesh , 2004 .

[64]  Shigeru Obayashi,et al.  Self-organizing map of Pareto solutions obtained from multiobjective supersonic wing design , 2002 .

[65]  Robert E. Smith,et al.  Fitness inheritance in genetic algorithms , 1995, SAC '95.

[66]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[67]  Luis F. Gonzalez,et al.  A Generic Framework for the Design Optimisation of Multidisciplinary UAV Intelligent Systems using Evolutionary Computing , 2006 .

[68]  Kok Wai Wong,et al.  Surrogate-Assisted Evolutionary Optimization Frameworks for High-Fidelity Engineering Design Problems , 2005 .

[69]  Andy J. Keane,et al.  Robust structural design of a simplified jet engine model, using multiobjective optimization , 2006 .

[70]  Akira Todoroki,et al.  Dimensions and Laminates Optimization of hat-stiffened Composite Panel with Buckling Load Constraint using Multi-objective GA , 2007 .

[71]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[72]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[73]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .

[74]  T. Simpson,et al.  Comparative studies of metamodeling techniques under multiple modeling criteria , 2000 .

[75]  Khaled Rasheed,et al.  Comparison of methods for developing dynamic reduced models for design optimization , 2002, Soft Comput..

[76]  Shigeru Obayashi,et al.  Data Mining for Multidisciplinary Design Space of Regional-Jet Wing , 2007, J. Aerosp. Comput. Inf. Commun..

[77]  Bryan Glaz,et al.  Application of a Weighted Average Surrogate Approach to Helicopter Rotor Blade Vibration Reduction , 2007 .

[78]  Man Mohan Rai,et al.  ROBUST OPTIMAL AERODYNAMIC DESIGN USING EVOLUTIONARY METHODS AND NEURAL NETWORKS , 2004 .

[79]  Alain Ratle,et al.  Accelerating the Convergence of Evolutionary Algorithms by Fitness Landscape Approximation , 1998, PPSN.

[80]  Akira Todoroki,et al.  Modified Efficient Global Optimization for a Hat-Stiffened Composite Panel with Buckling Constraint , 2008 .

[81]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[82]  Shigeru Obayashi,et al.  Improvement of Nonlinear Lateral Characteristics of Lifting-Body Type Reentry Vehicle Using Optimization Algorithm , 2007 .

[83]  Edmondo A. Minisci,et al.  MOPED: A Multi-objective Parzen-Based Estimation of Distribution Algorithm for Continuous Problems , 2003, EMO.

[84]  Luis F. Gonzalez,et al.  Robust evolutionary algorithms for UAV/UCAV aerodynamic andRCS design optimisation , 2008 .

[85]  Yaochu Jin,et al.  Knowledge incorporation in evolutionary computation , 2005 .

[86]  Juan Julián Merelo Guervós,et al.  Parallel Problem Solving from Nature — PPSN VII , 2002, Lecture Notes in Computer Science.

[87]  Mattia Barbarino,et al.  Multi-objective Aeroacoustic Optimization of an Aircraft Propeller , 2008 .

[88]  Pietro Marco Congedo,et al.  Airfoil Shape Optimization for Transonic Flows of Bethe-Zel'dovich-Thompson Fluids , 2007 .