Achieving super-linear performance in parallel multi-objective evolutionary algorithms by means of cooperative coevolution

This article introduces three new multi-objective cooperative coevolutionary variants of three state-of-the-art multi-objective evolutionary algorithms, namely, Non-dominated Sorting Genetic Algorithm II (NSGA-II), Strength Pareto Evolutionary Algorithm 2 (SPEA2) and Multi-objective Cellular Genetic Algorithm (MOCell). In such a coevolutionary architecture, the population is split into several subpopulations or islands, each of them being in charge of optimizing a subset of the global solution by using the original multi-objective algorithm. Evaluation of complete solutions is achieved through cooperation, i.e., all subpopulations share a subset of their current partial solutions. Our purpose is to study how the performance of the cooperative coevolutionary multi-objective approaches can be drastically increased with respect to their corresponding original versions. This is specially interesting for solving complex problems involving a large number of variables, since the problem decomposition performed by the model at the island level allows for much faster executions (the number of variables to handle in every island is divided by the number of islands). We conduct a study on a real-world problem related to grid computing, the bi-objective robust scheduling problem of independent tasks. The goal in this problem is to minimize makespan (i.e., the time when the latest machine finishes its assigned tasks) and to maximize the robustness of the schedule (i.e., its tolerance to unexpected changes on the estimated time to complete the tasks). We propose a parallel, multithreaded implementation of the coevolutionary algorithms and we have analyzed the results obtained in terms of both the quality of the Pareto front approximations yielded by the techniques as well as the resulting speedups when running them on a multicore machine.

[1]  Pascal Bouvry,et al.  Overcoming partitioning in large ad hoc networks using genetic algorithms , 2009, GECCO '09.

[2]  Kay Chen Tan,et al.  A distributed Cooperative coevolutionary algorithm for multiobjective optimization , 2006, IEEE Transactions on Evolutionary Computation.

[3]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[4]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[5]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[6]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[7]  Enrique Alba,et al.  Efficient Batch Job Scheduling in Grids using Cellular Memetic Algorithms , 2007, IPDPS.

[8]  Kittipong Boonlong,et al.  Co-Operative Co-Evolutionary Genetic Algorithms for Multi-Objective Topology Design , 2005 .

[9]  Helio J. C. Barbosa,et al.  An interactive genetic algorithm with co-evolution of weights for multiobjective problems , 2001 .

[10]  Enrique Alba,et al.  Cellular genetic algorithms , 2014, GECCO.

[11]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[12]  Gary L. Haith,et al.  Comparing a coevolutionary genetic algorithm for multiobjective optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[13]  Jan Paredis,et al.  Coevolutionary Life-Time Learning , 1996, PPSN.

[14]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[15]  Pascal Bouvry,et al.  hLCGA: A Hybrid Competitive Coevolutionary Genetic Algorithm , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[16]  Carlos A. Coello Coello,et al.  A coevolutionary multi-objective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[17]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[18]  Enrique Alba,et al.  Efficient Batch Job Scheduling in Grids Using Cellular Memetic Algorithms , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[19]  Francisco Luna,et al.  MOCell: A cellular genetic algorithm for multiobjective optimization , 2009 .

[20]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[21]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[22]  Nachol Chaiyaratana,et al.  Multi-objective Co-operative Co-evolutionary Genetic Algorithm , 2002, PPSN.

[23]  Kittipong Boonlong,et al.  Multi-objective Optimisation by Co-operative Co-evolution , 2004, PPSN.

[24]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[25]  Kotaro Hirasawa,et al.  Genetic Symbiosis Algorithm for Multiobjective Optimization Problems , 2001 .

[26]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[27]  Ian C. Parmee,et al.  Preliminary airframe design using co-evolutionary multiobjective genetic algorithms , 1999 .

[28]  Xiaodong Li,et al.  A Cooperative Coevolutionary Multiobjective Algorithm Using Non-dominated Sorting , 2004, GECCO.

[29]  Kay Chen Tan,et al.  A Coevolutionary Paradigm for Dynamic Multi-Objective Optimization , 2009 .

[30]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[31]  Kotaro Hirasawa,et al.  Genetic symbiosis algorithm for multiobjective optimization problem , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).