Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons

Evolutionary techniques for multi-objective(MO) optimization are currently gainingsignificant attention from researchers invarious fields due to their effectiveness androbustness in searching for a set of trade-offsolutions. Unlike conventional methods thataggregate multiple attributes to form acomposite scalar objective function,evolutionary algorithms with modifiedreproduction schemes for MO optimization arecapable of treating each objective componentseparately and lead the search in discoveringthe global Pareto-optimal front. The rapidadvances of multi-objective evolutionaryalgorithms, however, poses the difficulty ofkeeping track of the developments in this fieldas well as selecting an existing approach thatbest suits the optimization problem in-hand.This paper thus provides a survey on variousevolutionary methods for MO optimization. Manywell-known multi-objective evolutionaryalgorithms have been experimented with andcompared extensively on four benchmark problemswith different MO optimization difficulties.Besides considering the usual performancemeasures in MO optimization, e.g., the spreadacross the Pareto-optimal front and the abilityto attain the global trade-offs, the paper alsopresents a few metrics to examinethe strength and weakness of each evolutionaryapproach both quantitatively and qualitatively.Simulation results for the comparisons areanalyzed, summarized and commented.

[1]  Andrzej Jaszkiewicz,et al.  Genetic local search for multi-objective combinatorial optimization , 2022 .

[2]  D. A. Conway.  Management Goals and Accounting for Control , 1966 .

[3]  C. Mariano,et al.  MOAQ an Ant-Q algorithm for multiple objective optimization problems , 1999 .

[4]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[5]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[6]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[7]  Masatoshi Sakawa,et al.  An Interactive Fuzzy Satisficing Method for Multiobjective Multidimensional 0-1 Knapsack Problems Through Genetic Algorithms , 1996, International Conference on Evolutionary Computation.

[8]  Tong Heng Lee,et al.  Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[9]  Aharon Ben-Tal,et al.  Characterization of Pareto and Lexicographic Optimal Solutions , 1980 .

[10]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[11]  Michael P. Fourman,et al.  Compaction of Symbolic Layout Using Genetic Algorithms , 1985, ICGA.

[12]  John J. Grefenstette,et al.  Genetic algorithms in noisy environments , 1988, Machine Learning.

[13]  John M. Chambers,et al.  Graphical Methods for Data Analysis , 1983 .

[14]  Witold Pedrycz,et al.  Application of genetic algorithms for control design in power systems , 1998 .

[15]  Jin-Jang Leou,et al.  A genetic algorithm approach to Chinese handwriting normalization , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[16]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[17]  Peter J. Fleming,et al.  Assessing the performance of multiobjective genetic algorithms for optimization of a batch process scheduling problem , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[18]  S. Ranjithan,et al.  Using genetic algorithms to solve a multiple objective groundwater pollution containment problem , 1994 .

[19]  Kalyanmoy Deb,et al.  Construction of Test Problems for Multi-Objective Optimization , 1999, GECCO.

[20]  Keith J. Burnham,et al.  On improving physical selectivity in the treatment of cancer: A systems modelling and optimisation approach , 1997 .

[21]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[22]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[23]  Michael Kolonko,et al.  Multidimensional Optimization with a Fuzzy Genetic Algorithm , 1998, J. Heuristics.

[24]  Tomoyuki Hiroyasu,et al.  Distributed genetic algorithms with a new sharing approach in multiobjective optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[25]  DebKalyanmoy.  Multi-objective genetic algorithms , 1999 .

[26]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[27]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  Garrison W. Greenwood,et al.  Fitness Functions for Multiple Objective Optimization Problems: Combining Preferences with Pareto Rankings , 1996, FOGA.

[29]  Carlos A. Coello Coello,et al.  An updated survey of GA-based multiobjective optimization techniques , 2000, CSUR.

[30]  Jeffrey Horn,et al.  Multiobjective Optimization Using the Niched Pareto Genetic Algorithm , 1993 .

[31]  Tong Heng Lee,et al.  Evolutionary algorithms with dynamic population size and local exploration for multiobjective optimization , 2001, IEEE Trans. Evol. Comput..

[32]  Teodor Marcu.  A Multiobjective Evolutionary Approach to Pattern Recognition for Robust Diagnosis of Process Faults , 1997 .

[33]  C. E. Mariano,et al.  Distributed reinforcement learning for multiple objective optimization problems , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[34]  Kalyanmoy Deb,et al.  Optimization for Engineering Design: Algorithms and Examples , 2004 .

[35]  Jean Pierre Brans,et al.  HOW TO SELECT AND HOW TO RANK PROJECTS: THE PROMETHEE METHOD , 1986 .

[36]  Tong Heng Lee,et al.  Tabu-Based Exploratory Evolutionary Algorithm for Effective Multi-objective Optimization , 2001, EMO.

[37]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[38]  Hajime Kita,et al.  Multi-Objective Optimization by Means of the Thermodynamical Genetic Algorithm , 1996, PPSN.

[39]  Brahim Rekiek,et al.  Dealing With User's Preferences in Hybrid Assembly Lines Design , 2000 .

[40]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[41]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[42]  C. TanK.,et al.  Evolutionary Algorithms for Multi-Objective Optimization , 2002 .

[43]  K. Stanislaw,et al.  A new constraint tournament selection method for multicriteria optimization using genetic algorithm , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[44]  Michael J. Shaw,et al.  Genetic algorithms with dynamic niche sharing for multimodal function optimization , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[45]  Dipankar Dasgupta,et al.  Nonstationary Function Optimization using the Structured Genetic Algorithm , 1992, PPSN.

[46]  Christian Fonteix,et al.  Multicriteria optimization using a genetic algorithm for determining a Pareto set , 1996, Int. J. Syst. Sci..

[47]  H. Tanaka,et al.  Individual aging in genetic algorithms , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[48]  Jeffrey Horn,et al.  Multicriterion decision making , 1997 .

[49]  Gunar E. Liepins,et al.  Some Guidelines for Genetic Algorithms with Penalty Functions , 1989, ICGA.

[50]  L. Darrell Whitley,et al.  Fundamental Principles of Deception in Genetic Search , 1990, FOGA.

[51]  E. F. Khor,et al.  Evolutionary algorithms with goal and priority information for multi-objective optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[52]  E. F. Khor,et al.  An Evolutionary Algorithm with Advanced Goal and Priority Specification for Multi-objective Optimization , 2011, J. Artif. Intell. Res..

[53]  Sadiq M. Sait,et al.  Fuzzy simulated evolution algorithm for multi-objective optimization of VLSI placement , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[54]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[55]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[56]  Andrzej Osyczka,et al.  7 – Multicriteria optimization for engineering design , 1985 .

[57]  Yuval Davidor,et al.  Epistasis Variance: A Viewpoint on GA-Hardness , 1990, FOGA.

[58]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[59]  M. Ehrgott.  Multiobjective Optimization , 2008, AI Mag..

[60]  Juhani Koski,et al.  Multicriteria Design Optimization , 1990 .

[61]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[62]  A. Eiben,et al.  A multi-sexual genetic algorithm for multiobjective optimization , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[63]  Prabhat Hajela,et al.  Genetic search strategies in multicriterion optimal design , 1991 .

[64]  Philippe Collard,et al.  Time dependent optimization with a folding genetic algorithm , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[65]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[66]  Benjamin W. Wah,et al.  Dynamic Control of Genetic Algorithms in a Noisy Environment , 1993, ICGA.

[67]  Manuel Valenzuela-Rendón,et al.  A Non-Generational Genetic Algorithm for Multiobjective Optimization , 1997, ICGA.

[68]  Martina Gorges-Schleuter,et al.  Application of Genetic Algorithms to Task Planning and Learning , 1992, Parallel Problem Solving from Nature.

[69]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[70]  Alan S. Perelson,et al.  Using Genetic Algorithms to Explore Pattern Recognition in the Immune System , 1993, Evolutionary Computation.

[71]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. I. A unified formulation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[72]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithm test suites , 1999, SAC '99.

[73]  David A. Van Veldhuizen,et al.  Evolutionary Computation and Convergence to a Pareto Front , 1998 .

[74]  Michael G.H. Bell,et al.  Optimisation of a fuzzy logic traffic signal controller by a multiobjective genetic algorithm , 1998 .

[75]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[76]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[77]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[78]  Joshua D. Knowles,et al.  M-PAES: a memetic algorithm for multiobjective optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[79]  Kalyanmoy Deb,et al.  Evolutionary Algorithms for Multi-Criterion Optimization in Engineering Design , 1999 .

[80]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[81]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[82]  Gary B. Lamont,et al.  Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art , 2000, Evolutionary Computation.

[83]  Bernd Freisleben,et al.  On the effectiveness of evolutionary search in high-dimensional NK-landscapes , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[84]  Samir W. Mahfoud.  Niching methods for genetic algorithms , 1996 .

[85]  Philippe Collard,et al.  Genetic operators in a dual genetic algorithm , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[86]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[87]  Hillol Kargupta,et al.  Signal-to-noise, Crosstalk, and Long Range Problem Difficulty in Genetic Algorithms , 1995, ICGA.

[88]  Robin Allenson,et al.  Genetic Algorithms with Gender for Multi-function Optimisation , 1992 .

[89]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[90]  Peter J. Fleming,et al.  Multiobjective genetic algorithms made easy: selection sharing and mating restriction , 1995 .

[91]  David E. Goldberg,et al.  Genetic Algorithms, Selection Schemes, and the Varying Effects of Noise , 1996, Evolutionary Computation.

[92]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[93]  Edwin K. P. Chong,et al.  Genetic algorithms in noisy environment , 1994, Proceedings of 1994 9th IEEE International Symposium on Intelligent Control.

[94]  A CoelloCarlos.  An updated survey of GA-based multiobjective optimization techniques , 2000 .

[95]  E. M. L. Beale.  Introduction to Optimization , 1988 .

[96]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[97]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[98]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[99]  V. Vemuri,et al.  A new genetic algorithm for multi-objective optimization in water resource management , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[100]  Andrzej Ameljańczyk,et al.  Multicriteria Optimization in Engineering Design , 1994 .

[101]  A. Charnes,et al.  Management Models and Industrial Applications of Linear Programming , 1961 .

[102]  H. Ishibuchi,et al.  MOGA: multi-objective genetic algorithms , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[103]  H. Adeli,et al.  Augmented Lagrangian genetic algorithm for structural optimization , 1994 .

[104]  Alan D. Christiansen,et al.  An empirical study of evolutionary techniques for multiobjective optimization in engineering design , 1996 .

[105]  Abraham Charnes,et al.  Management Models and Industrial Applications of Linear Programming , 1961 .

[106]  Tong Heng Lee,et al.  A multiobjective evolutionary algorithm toolbox for computer-aided multiobjective optimization , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[107]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[108]  Tetsuo Morimoto,et al.  Optimal control of physiological processes of plants in a green plant factory , 1995 .

[109]  I. C. Parmee,et al.  Genetic algorithm-based multi-objective optimisation and conceptual engineering design , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[110]  Peter J. Angeline,et al.  The Effects of Noise on Self-Adaptive Evolutionary Optimization , 1996, Evolutionary Programming.

[111]  David E. Goldberg,et al.  Genetic Algorithm Difficulty and the Modality of Fitness Landscapes , 1994, FOGA.

[112]  N. Dopuch,et al.  Management Goals and Accounting for Control. , 1967 .

[113]  Kay Chen Tan,et al.  Evolutionary algorithm with dynamic population size for multi-objective optimization , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[114]  M. Sefrioui,et al.  Nash genetic algorithms: examples and applications , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[115]  D. E. Goldberg,et al.  Simple Genetic Algorithms and the Minimal, Deceptive Problem , 1987 .

[116]  Peter J. Bentley,et al.  Finding Acceptable Solutions in the Pareto-Optimal Range using Multiobjective Genetic Algorithms , 1998 .