Gap finding and validation in evolutionary multi- and many-objective optimization

Over 30 years, evolutionary multi- and many-objective optimization (EMO/EMaO) algorithms have been extensively applied to find well-distributed Pareto-optimal (PO) solutions in a single run. However, in real-world problems, the PO front may not always be a single continuous hyper-surface, rather several irregularities may exist involving disjointed surfaces, holes within the surface, or patches of mixed-dimensional surfaces. When a set of trade-off solutions are obtained by EMO/EMaO algorithms, there may exist less dense or no solutions (we refer as 'gaps') in certain parts of the front. This can happen for at least two reasons: (i) gaps naturally exist in the PO front, or (ii) no natural gaps exists, but the chosen EMO/EMaO algorithm is not able to find any solution in the apparent gaps. To make a confident judgement, we propose a three-step procedure here. First, we suggest a computational procedure to identify gaps, if any, in the EMO/EMaO-obtained PO front. Second, we propose a computational method to identify well-distributed gap-points in the gap regions. Third, we apply a focused EMO/EMaO algorithm to search for possible representative trade-off points in the gaps. We then propose two metrics to qualitatively establish whether a gap truly exists in the obtained dataset, and if yes, whether the gap naturally exists on the true Pareto-set. Procedures are supported by results on two to five-objective test problems and on a five-objective scheduling problem from a steel-making industry.

[1]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[2]  Valentina Colla,et al.  Multi-objective optimization applied to retrofit analysis: A case study for the iron and steel industry , 2015 .

[3]  Gary B. Lamont,et al.  Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art , 2000, Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[5]  Qingfu Zhang,et al.  Biased Multiobjective Optimization and Decomposition Algorithm , 2017, IEEE Transactions on Cybernetics.

[6]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[7]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[8]  Marco Laumanns,et al.  Computing Gap Free Pareto Front Approximations with Stochastic Search Algorithms , 2010, Evolutionary Computation.

[9]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[10]  Kalyanmoy Deb,et al.  Reference Point Based NSGA-III for Preferred Solutions , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[11]  Hussein A. Abbass,et al.  An Inexpensive Cognitive Approach for Bi-objective Optimization Using Bliss Points and Interaction , 2004, PPSN.

[12]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[13]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[14]  P. Rousseeuw,et al.  Displaying a clustering with CLUSPLOT , 1999 .

[15]  Mia Hubert,et al.  Clustering in an object-oriented environment , 1997 .

[16]  Javier Puente,et al.  Solving multi-objective rescheduling problems in dynamic permutation flow shop environments with disruptions , 2018, Int. J. Prod. Res..

[17]  Silvino Fernandez,et al.  Scheduling a Galvanizing Line by Ant Colony Optimization , 2014, ANTS Conference.

[18]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[19]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[20]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[21]  Malika Charrad,et al.  NbClust: An R Package for Determining the Relevant Number of Clusters in a Data Set , 2014 .

[22]  Kalyanmoy Deb,et al.  Pymoo: Multi-Objective Optimization in Python , 2020, IEEE Access.

[23]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[24]  Peter J. Rousseeuw,et al.  Clustering by means of medoids , 1987 .

[25]  Qing Liu,et al.  Optimal Charge Planning Model of Steelmaking Based on Multi-Objective Evolutionary Algorithm , 2018, Metals.

[26]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .