Evolutionary algorithms for multiobjective optimization: methods and applications

Multiple, often conflicting objectives arise naturally in most real-world optimization scenarios. As evolutionary algorithms possess several characteristics due to which they are well suited to this type of problem, evolution-based methods have been used for multiobjective optimization for more than a decade. Meanwhile evolutionary multiobjective optimization has become established as a separate subdiscipline combining the fields of evolutionary computation and classical multiple criteria decision making. In this paper, the basic principles of evolutionary multiobjective optimization are discussed from an algorithm design perspective. The focus is on the major issues such as fitness assignment, diversity preservation, and elitism in general rather than on particular algorithms. Different techniques to implement these strongly related concepts will be discussed, and further important aspects such as constraint handling and preference articulation are treated as well. Finally, two applications will presented and some recent trends in the field will be outlined.

[1]  J. Marchal Cours d'economie politique , 1950 .

[2]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[5]  C. Hwang Multiple Objective Decision Making - Methods and Applications: A State-of-the-Art Survey , 1979 .

[6]  Joel N. Morse,et al.  Reducing the size of the nondominated set: Pruning by clustering , 1980, Comput. Oper. Res..

[7]  J. Koski Multicriterion Optimization in Structural Design , 1981 .

[8]  John M. Chambers,et al.  Graphical Methods for Data Analysis , 1983 .

[9]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[10]  Michael P. Fourman,et al.  Compaction of Symbolic Layout Using Genetic Algorithms , 1985, ICGA.

[11]  J. E. Baker Adaptive Selection Methods for Genetic Algorithms , 1985, ICGA.

[12]  J. D. Schaffer,et al.  Multiple Objective Optimization with Vector Evaluated Genetic Algorithms , 1985, ICGA.

[13]  Jr. Earl E. Swartzlander,et al.  VLSI Signal Processing Systems , 1985 .

[14]  Hirotaka Nakayama,et al.  Theory of Multiobjective Optimization , 1985 .

[15]  Jared L. Cohon,et al.  6 – Multicriteria programming: brief review and application , 1985 .

[16]  J. Gero,et al.  REDUCING THE PARETO OPTIMAL SET IN MULTICRITERIA OPTIMIZATION(With Applications to Pareto Optimal Dynamic Programming) , 1985 .

[17]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[18]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[20]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[23]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[24]  李幼升,et al.  Ph , 1989 .

[25]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[26]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[27]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[28]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[29]  Alan S. Perelson,et al.  Genetic Algorithms and the Immune System , 1990, PPSN.

[30]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[31]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[32]  M. Engels,et al.  GRAPE: a CASE tool for digital signal parallel processing , 1990, IEEE ASSP Magazine.

[33]  Frank Kursawe,et al.  A Variant of Evolution Strategies for Vector Optimization , 1990, PPSN.

[34]  Prabhat Hajela,et al.  Genetic search strategies in multicriterion optimal design , 1991 .

[35]  P. Vaidyanathan Multirate Systems And Filter Banks , 1992 .

[36]  P. Hajela,et al.  Genetic search strategies in multicriterion optimal design , 1991 .

[37]  Alan S. Perelson,et al.  Population Diversity in an Immune System Model: Implications for Genetic Search , 1992, FOGA.

[38]  Heinrich Meyr,et al.  High level software synthesis for signal processing systems , 1992, [1992] Proceedings of the International Conference on Application Specific Array Processors.

[39]  Giovanni De Micheli,et al.  Design Space Exploration , 1992 .

[40]  J. Ringuest Multiobjective Optimization: Behavioral and Computational Considerations , 1992 .

[41]  Fred W. Glover,et al.  A user's guide to tabu search , 1993, Ann. Oper. Res..

[42]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[43]  Alan S. Perelson,et al.  Searching for Diverse, Cooperative Populations with Genetic Algorithms , 1993, Evolutionary Computation.

[44]  Jeffrey Horn,et al.  Multiobjective Optimization Using the Niched Pareto Genetic Algorithm , 1993 .

[45]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[46]  Alan S. Perelson,et al.  Using Genetic Algorithms to Explore Pattern Recognition in the Immune System , 1993, Evolutionary Computation.

[47]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[48]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[49]  Edward A. Lee,et al.  Minimizing memory requirements for chain-structured synchronous dataflow programs , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[50]  Edward A. Lee,et al.  Ptolemy: A Framework for Simulating and Prototyping Heterogenous Systems , 2001, Int. J. Comput. Simul..

[51]  Thomas Bäck,et al.  The zero/one multiple knapsack problem and genetic algorithms , 1994, SAC '94.

[52]  Zbigniew Michalewicz,et al.  Genetic Algorithms for the 0/1 Knapsack Problem , 1994, ISMIS.

[53]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[54]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[55]  C. Poloni Hybrid GA for Multi Objective Aerodynamic Shape Optimisation , 1995 .

[56]  Gert Goossens,et al.  Code Generation for Embedded Processors , 1995 .

[57]  R. Spillman Solving large knapsack problems with a genetic algorithm , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[58]  Heinrich Meyr,et al.  Scheduling for optimum data memory compaction in block diagram oriented software synthesis , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[59]  Jan Paredis,et al.  The Symbiotic Evolution of Solutions and Their Representations , 1995, International Conference on Genetic Algorithms.

[60]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[61]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[62]  Edward A. Lee,et al.  Optimal parenthesization of lexical orderings for DSP block diagrams , 1995, VLSI Signal Processing, VIII.

[63]  J. Eheart,et al.  Using Genetic Algorithms to Solve a Multiobjective Groundwater Monitoring Problem , 1995 .

[64]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[65]  Peter J. Fleming,et al.  Multiobjective genetic algorithms made easy: selection sharing and mating restriction , 1995 .

[66]  Garrison W. Greenwood,et al.  Fitness Functions for Multiple Objective Optimization Problems: Combining Preferences with Pareto Rankings , 1996, FOGA.

[67]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[68]  Murray B. Anderson,et al.  Launch conditions and aerodynamic data extraction by an elitist pareto genetic algorithm , 1996 .

[69]  Edward A. Lee,et al.  Software Synthesis from Dataflow Graphs , 1996 .

[70]  Hajime Kita,et al.  Multi-objective optimization by genetic algorithms: a review , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[71]  Masatoshi Sakawa,et al.  An Interactive Fuzzy Satisficing Method for Multiobjective Multidimensional 0-1 Knapsack Problems Through Genetic Algorithms , 1996, International Conference on Evolutionary Computation.

[72]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[73]  Ernest S. Kuh,et al.  Design space exploration using the genetic algorithm , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[74]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[75]  Hisao Ishibuchi,et al.  Multi-objective genetic local search algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[76]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[77]  H. Ishibuchi,et al.  Multi-objective genetic algorithm and its applications to flowshop scheduling , 1996 .

[78]  Lothar Thiele,et al.  A Comparison of Selection Schemes Used in Evolutionary Algorithms , 1996, Evolutionary Computation.

[79]  Wolfgang Banzhaf,et al.  Genetic Programming: An Introduction , 1997 .

[80]  Pratyush Sen,et al.  A Multiple Criteria Genetic Algorithm for Containership Loading , 1997, ICGA.

[81]  Manuel Valenzuela-Rendón,et al.  A Non-Generational Genetic Algorithm for Multiobjective Optimization , 1997, ICGA.

[82]  S. Ranji Ranjithan,et al.  The Neighborhood Constraint Method: A Genetic Algorithm-Based Multiobjective Optimization Technique , 1997, ICGA.

[83]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[84]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[85]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[86]  A. Eiben,et al.  A multi-sexual genetic algorithm for multiobjective optimization , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[87]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[88]  Tobias Blickle,et al.  Theory of evolutionary algorithms and application to system synthesis , 1997 .

[89]  António Gaspar-Cunha,et al.  Use of Genetic Algorithms in Multicriteria Optimization to Solve Industrial Problems , 1997, ICGA.

[90]  G. Rudolph On a multi-objective evolutionary algorithm and its convergence to the Pareto set , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[91]  Jürgen Teich,et al.  System-Level Synthesis Using Evolutionary Algorithms , 1998, Des. Autom. Embed. Syst..

[92]  Lothar Thiele,et al.  An evolutionary algorithm for multiobjective optimization: the strength Pareto approach , 1998 .

[93]  Shigeru Obayashi,et al.  Niching and Elitist Models for MOGAs , 1998, PPSN.

[94]  Geoffrey T. Parks,et al.  Selective Breeding in a Multiobjective Genetic Algorithm , 1998, PPSN.

[95]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[96]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. II. Application example , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[97]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[98]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. I. A unified formulation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[99]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[100]  David A. Van Veldhuizen,et al.  Evolutionary Computation and Convergence to a Pareto Front , 1998 .

[101]  Jürgen Teich,et al.  Buffer Memory Optimization in DSP Applications - An Evolutionary Approach , 1998, PPSN.

[102]  Jürgen Teich,et al.  3D exploration of software schedules for DSP algorithms , 1999, CODES '99.

[103]  David Corne,et al.  Assessing the Performance of the Pareto Archived Evolution Strategy , 1999 .

[104]  Jürgen Teich,et al.  Evolutionary algorithm based exploration of software schedules for digital signal processors , 1999 .

[105]  Carlos A. Coello Coello,et al.  An updated survey of evolutionary multiobjective optimization techniques: state of the art and future trends , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[106]  Kalyanmoy Deb,et al.  Evolutionary Algorithms for Multi-Criterion Optimization in Engineering Design , 1999 .

[107]  H. Schwefel,et al.  Approximating the Pareto Set: Concepts, Diversity Issues, and Performance Assessment , 1999 .

[108]  Peter J. Fleming,et al.  Assessing the performance of multiobjective genetic algorithms for optimization of a batch process scheduling problem , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[109]  Jürgen Teich,et al.  Optimized software synthesis for DSP using randomization techniques: (revised version of TIK Report 32) , 1999 .

[110]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[111]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[112]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[113]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[114]  L. Hennig,et al.  Dynamic properties of endogenous phytochrome A in Arabidopsis seedlings. , 1999, Plant physiology.

[115]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[116]  L. Hennig,et al.  Degradation of phytochrome A and the high irradiance response in Arabidopsis: a kinetic analysis , 2000 .

[117]  C. Coello,et al.  CONSTRAINT-HANDLING USING AN EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION TECHNIQUE , 2000 .

[118]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[119]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[120]  Jürgen Teich,et al.  Evolutionary algorithms for the synthesis of embedded software , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[121]  Jürgen Teich,et al.  Multidimensional Exploration of Software Implementations for DSP Algorithms , 2000, J. VLSI Signal Process..

[122]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .

[123]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[124]  Günter Rudolph,et al.  Convergence properties of some multi-objective evolutionary algorithms , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[125]  Lothar Thiele,et al.  Multiobjective genetic programming: reducing bloat using SPEA2 , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[126]  Jonathan A. Wright,et al.  An Infeasibility Objective for Use in Constrained Pareto Optimization , 2001, EMO.

[127]  Marco Laumanns,et al.  On the convergence and diversity-preservation properties of multi-objective evolutionary algorithms , 2001 .

[128]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .