Methods That Optimize Multi-Objective Problems: A Survey and Experimental Evaluation

Most current multi-optimization survey papers classify methods into broad objective categories and do not draw clear boundaries between the specific techniques employed by these methods. This may lead to the misclassification of unrelated methods/techniques into the same objective category. Moreover, most of these survey papers classify algorithms as independent of the specific techniques they employ. Toward this end, we introduce in this survey paper a methodology-based taxonomy that classifies multi-optimization methods into hierarchically nested, fine-grained, and specific classes. We provide a methodological taxonomy to classify methods into the following hierarchical fashion: objective categories objective functionsoptimization methodsoptimization sub-methods. We introduce a comprehensive survey on the methods that are contained under each optimization method, the optimization methods contained under each objective function, and objective functions contained under each objective category. We selected the objective functions that should be maximized for solving most real-word multi-objective optimization problems, which are pairs of the following: partitions separability, internal density, dynamic similarity, and structural similarity. For each optimization method, we surveyed the various algorithms in literature that pertain to the method. We experimentally compared and ranked the optimization methods that fall under each objective function, the objective functions that fall under each objective category, and the objective categories used for solving a specific optimization problem.

[1]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[2]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[3]  Heike Trautmann,et al.  On the properties of the R2 indicator , 2012, GECCO '12.

[4]  Mohammad-Reza Feizi-Derakhshi,et al.  An Enhanced Multi-Objective Biogeography-Based Optimization Algorithm for Automatic Detection of Overlapping Communities in a Social Network with Node Attributes , 2018, ArXiv.

[5]  Carlos A. Coello Coello,et al.  Coevolutionary Multiobjective Evolutionary Algorithms: Survey of the State-of-the-Art , 2018, IEEE Transactions on Evolutionary Computation.

[6]  Kalyanmoy Deb,et al.  Integrating User Preferences into Evolutionary Multi-Objective Optimization , 2005 .

[7]  Hisao Ishibuchi,et al.  A Review of Evolutionary Multi-modal Multi-objective Optimization , 2020, arXiv.org.

[8]  Marco Laumanns,et al.  Stochastic convergence of random search methods to fixed size Pareto front approximations , 2011, Eur. J. Oper. Res..

[9]  Rohan Agrawal,et al.  Bi-Objective Community Detection (BOCD) in Networks Using Genetic Algorithm , 2011, IC3.

[10]  Vimal L. Vachhani,et al.  Survey of multi objective evolutionary algorithms , 2015, 2015 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2015].

[11]  Kalyanmoy Deb,et al.  A review of hybrid evolutionary multiple criteria decision making methods , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[12]  Eckart Zitzler,et al.  Integrating decision space diversity into hypervolume-based multiobjective search , 2010, GECCO '10.

[13]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Noninteractive Approaches , 2008, Multiobjective Optimization.

[14]  Xiaoyan Sun,et al.  Many-objective evolutionary optimization based on reference points , 2017, Appl. Soft Comput..

[15]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[17]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[18]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[19]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[20]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[21]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Computational Optimization and Applications.

[22]  Ananthram Swami,et al.  A Survey on Modeling and Optimizing Multi-Objective Systems , 2017, IEEE Communications Surveys & Tutorials.

[23]  Kalyanmoy Deb,et al.  A Local Search Based Evolutionary Multi-objective Optimization Approach for Fast and Accurate Convergence , 2008, PPSN.

[24]  Peter J. Fleming,et al.  Generalized decomposition and cross entropy methods for many-objective optimization , 2014, Inf. Sci..

[25]  Gexiang Zhang,et al.  A Many-Objective Evolutionary Algorithm With Enhanced Mating and Environmental Selections , 2015, IEEE Transactions on Evolutionary Computation.

[26]  Bernabé Dorronsoro,et al.  A Survey of Decomposition Methods for Multi-objective Optimization , 2014, Recent Advances on Hybrid Approaches for Designing Intelligent Systems.

[27]  M. Farina,et al.  On the optimal solution definition for many-criteria optimization problems , 2002, 2002 Annual Meeting of the North American Fuzzy Information Processing Society Proceedings. NAFIPS-FLINT 2002 (Cat. No. 02TH8622).

[28]  Markus Wagner,et al.  Evolutionary many-objective optimization: A quick-start guide , 2015 .

[29]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[30]  Rui Fan,et al.  A new multi-objective particle swarm optimisation algorithm based on R2 indicator selection mechanism , 2019, Int. J. Syst. Sci..

[31]  Byung Ro Moon,et al.  Multiobjective evolutionary algorithms for dynamic social network clustering , 2010, GECCO '10.

[32]  Kalyanmoy Deb,et al.  Handling many-objective problems using an improved NSGA-II procedure , 2012, 2012 IEEE Congress on Evolutionary Computation.

[33]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[34]  Clara Pizzuti,et al.  A Multiobjective Genetic Algorithm to Find Communities in Complex Networks , 2012, IEEE Transactions on Evolutionary Computation.

[35]  Patrick M. Reed,et al.  Many-objective reconfiguration of operational satellite constellations with the Large-Cluster Epsilon Non-dominated Sorting Genetic Algorithm-II , 2009, 2009 IEEE Congress on Evolutionary Computation.

[36]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[37]  Michael T. M. Emmerich,et al.  Cone-Based Hypervolume Indicators: Construction, Properties, and Efficient Computation , 2013, EMO.

[38]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[39]  Panayiotis Andreou,et al.  Multi-objective Query Optimization in Smartphone Social Networks , 2011, 2011 IEEE 12th International Conference on Mobile Data Management.

[40]  Byran J. Smucker,et al.  On using the hypervolume indicator to compare Pareto fronts: Applications to multi-criteria optimal experimental design , 2015 .

[41]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[42]  Gary G. Yen,et al.  Comparison of visualization approaches in many-objective optimization , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[43]  Jasper A Vrugt,et al.  Improved evolutionary optimization from genetically adaptive multimethod search , 2007, Proceedings of the National Academy of Sciences.

[44]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[45]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[46]  Kalyanmoy Deb,et al.  Towards a Quick Computation of Well-Spread Pareto-Optimal Solutions , 2003, EMO.

[47]  Qian Xu,et al.  A Short Survey and Challenges for Multiobjective Evolutionary Algorithms Based on Decomposition , 2019, 2019 International Conference on Computer, Information and Telecommunication Systems (CITS).

[48]  Carlos A. Coello Coello,et al.  A ranking method based on the R2 indicator for many-objective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[49]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[50]  Peter J. Fleming,et al.  Diversity Management in Evolutionary Many-Objective Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[51]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[52]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[53]  Frederico G. Guimarães,et al.  Pareto Cone ε-Dominance: Improving Convergence and Diversity in Multiobjective Evolutionary Algorithms , 2011, EMO.

[54]  Jiawei Zhang,et al.  A Survey of Multiobjective Evolutionary Algorithms , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[55]  Xiaoyan Sun,et al.  A reference points-based evolutionary algorithm for many-objective optimization , 2014, GECCO.

[56]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[57]  Ujjwal Maulik,et al.  Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part II , 2014, IEEE Transactions on Evolutionary Computation.

[58]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[59]  Peng Wu,et al.  Multi-Objective Community Detection Based on Memetic Algorithm , 2015, PloS one.

[60]  Michael Dellnitz,et al.  A Survey of Recent Trends in Multiobjective Optimal Control—Surrogate Models, Feedback Control and Objective Reduction , 2018, Mathematical and Computational Applications.

[61]  Fang Li,et al.  Multi-objective evolutionary algorithms embedded with machine learning — A survey , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[62]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[63]  Heike Trautmann,et al.  Preference Articulation by Means of the R2 Indicator , 2013, EMO.

[64]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[65]  Kalyanmoy Deb,et al.  Running performance metrics for evolutionary multi-objective optimizations , 2002 .

[66]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[67]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[68]  Wenyin Gong,et al.  A Novel Differential Evolution Algorithm Based on epsilon -Domination and Orthogonal Design Method for Multiobjective Optimization , 2007, EMO.

[69]  Paul D. Yoo,et al.  Detecting Overlapping Communities of Nodes with Multiple Attributes from Heterogeneous Networks , 2019, CollaborateCom.

[70]  Lamjed Ben Said,et al.  Many-objective Optimization Using Evolutionary Algorithms: A Survey , 2017, Recent Advances in Evolutionary Multi-objective Optimization.

[71]  Lothar Thiele,et al.  A Preference-Based Evolutionary Algorithm for Multi-Objective Optimization , 2009, Evolutionary Computation.

[72]  Ujjwal Maulik,et al.  Multiobjective Genetic Fuzzy Clustering of Categorical Attributes , 2007, 10th International Conference on Information Technology (ICIT 2007).

[73]  Fei Li,et al.  A two-stage R2 indicator based evolutionary algorithm for many-objective optimization , 2018, Appl. Soft Comput..

[74]  Hisao Ishibuchi,et al.  Two-objective solution set optimization to maximize hypervolume and decision space diversity in multiobjective optimization , 2012, The 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems.

[75]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[76]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[77]  Carlos A. Coello Coello,et al.  MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator , 2013, 2013 IEEE Congress on Evolutionary Computation.

[78]  Qingfu Zhang,et al.  Interrelationship-Based Selection for Decomposition Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[79]  Yann Dujardin,et al.  Solving multi-objective optimization problems in conservation with the reference point method , 2016, PloS one.

[80]  Xiaodong Li,et al.  Reference point based multi-objective optimization through decomposition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[81]  Sam Kwong,et al.  Multi-Objective Evolutionary Clustering using Variable-Length Real Jumping Genes Genetic Algorithm , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[82]  Nyoman Gunantara,et al.  A review of multi-objective optimization: Methods and its applications , 2018 .

[83]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[84]  Bernhard Sendhoff,et al.  Incorporation Of Fuzzy Preferences Into Evolutionary Multiobjective Optimization , 2002, GECCO.

[85]  Lamjed Ben Said,et al.  Multi-objective Optimization with Dynamic Constraints and Objectives: New Challenges for Evolutionary Algorithms , 2015, GECCO.

[86]  R. Lyndon While,et al.  A Scalable Multi-objective Test Problem Toolkit , 2005, EMO.

[87]  Thorsten Dickhaus,et al.  Simultaneous Statistical Inference , 2014, Springer Berlin Heidelberg.

[88]  Carlos A. Coello Coello,et al.  Improved Metaheuristic Based on the R2 Indicator for Many-Objective Optimization , 2015, GECCO.

[89]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[90]  Bin Wu,et al.  Multi-objective community detection in complex networks , 2012, Appl. Soft Comput..

[91]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[92]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[93]  Heike Trautmann,et al.  R2-EMOA: Focused Multiobjective Search Using R2-Indicator-Based Selection , 2013, LION.

[94]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[95]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[96]  Kalyanmoy Deb,et al.  An Improved Adaptive Approach for Elitist Nondominated Sorting Genetic Algorithm for Many-Objective Optimization , 2013, EMO.

[97]  Jun Du,et al.  Combining advantages of new chromosome representation scheme and multi-objective genetic algorithms for better clustering , 2006, Intell. Data Anal..

[98]  Ian C. Parmee,et al.  Evolutionary Design and Multi-objective Optimisation , 1998 .

[99]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[100]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[101]  Tapabrata Ray,et al.  A Decomposition Based Evolutionary Algorithm for Many Objective Optimization with Systematic Sampling and Adaptive Epsilon Control , 2013, EMO.

[102]  Huan Liu,et al.  Multi-Objective Neighborhood Search Algorithm Based on Decomposition for Multi-Objective Minimum Weighted Vertex Cover Problem , 2019, Sustainability.

[103]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).