Multi-Objective Optimization with Controlled Model Assisted Evolution Strategies

Evolutionary algorithms perform robust search in complex and high dimensional search spaces, but require a large number of fitness evaluations to approximate optimal solutions. These characteristics limit their potential for hardware in the loop optimization and problems that require extensive simulations and calculations. Evolutionary algorithms do not maintain their knowledge about the fitness function as they only store solutions of the current generation. In contrast, model assisted evolutionary algorithms utilize the information contained in previously evaluated solutions in terms of a data based model. The convergence of the evolutionary algorithm is improved as some selection decisions rely on the model rather than to invoke expensive evaluations of the true fitness function. The novelty of our scheme stems from the preselection of solutions based on an instance based fitness model, in which the selection pressure is adjusted to the quality of model. This so-called -control adapts the number of true fitness evaluations to the monitored model quality. Our method extends the previous approaches for model assisted scalar optimization to multi-objective problems by a proper redefinition of model quality and preselection pressure control. The analysis on multi-objective benchmark optimization problems not only confirms the superior convergence of the model assisted evolution strategy in comparison with a multi-objective evolution strategy but also the positive effect of regulated preselection in contrast to merely static preselection.

[1]  Frank Kursawe,et al.  A Variant of Evolution Strategies for Vector Optimization , 1990, PPSN.

[2]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[3]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[4]  Jonathan E. Fieldsend,et al.  Using unconstrained elite archives for multiobjective optimization , 2003, IEEE Trans. Evol. Comput..

[5]  Andreas Zell,et al.  Evolution strategies with controlled model assistance , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[6]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[7]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[8]  Michael Emmerich,et al.  Metamodel Assisted Multiobjective Optimisation Strategies and their Application in Airfoil Design , 2004 .

[9]  Andreas Zell,et al.  Evolution strategies assisted by Gaussian processes with improved preselection criterion , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[11]  Bernhard Sendhoff,et al.  Efficient evolutionary optimization using individual-based evolution control and neural networks: A comparative study , 2005, ESANN.

[12]  Yaochu Jin,et al.  Quality Measures for Approximate Models in Evolutionary Computation , 2003 .

[13]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[14]  C. Poloni,et al.  Hybridization of a multi-objective genetic algorithm, a neural network and a classical optimizer for a complex design problem in fluid dynamics , 2000 .

[15]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[16]  Andy J. Keane,et al.  Statistical Improvement Criteria for Use in Multiobjective Design Optimization , 2006 .

[17]  Yew-Soon Ong,et al.  A study on polynomial regression and Gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[18]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[19]  Carlos A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Comput. Intell. Mag..

[20]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[21]  F. Hoffmann,et al.  Evolutionary hardware-in-the-loop optimization of a controller for cascaded hydraulic valves , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[22]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[23]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[24]  F. Hoffmann,et al.  Controlled Model Assisted Evolution Strategy with Adaptive Preselection , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[25]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[26]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[27]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[28]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[29]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..