PEA: Parallel Evolutionary Algorithm by Separating Convergence and Diversity for Large-Scale Multi-Objective Optimization

Running evolutionary algorithms in parallel is an intuitive way to speed up the process of solving large-scale multi-objective optimization problems, which have hundreds or thousands of decision variables. However, the framework of the existing multi-objective evolutionary algorithms seriously limits their parallelization. During each iteration, the environmental selection operators present in the existing framework need to collect and compare all the candidate solutions to balance the convergence and diversity, thus dividing the whole evolutionary process into a series of dependent sub-processes and resulting in frequent data transmission. To address this issue, we propose a novel parallel framework that separates the environmental selection operator from the entire evolutionary process, evidently removing the dependencies among sub-processes and reducing the data transmission. On the basis of the parallel framework, a new parallel evolutionary algorithm, namely PEA, is designed. In PEA, the convergence is achieved by a series of independent sub-populations, and the diversity is merely emphasized at the converged solutions from each subpopulation, which is helpful for avoiding that the environmental selection operator limits the parallelization of the algorithm. Moreover, a new environmental selection strategy is proposed to improve the diversity without considering the convergence. To assess the performance of the proposed PEA, we compare it with five representative multi-objective evolutionary algorithms in terms of both the convergence and diversity. The performance of the parallel framework is also analyzed by comparing with two existing parallel models. The experimental results demonstrate the superiority of the proposed parallel algorithms in terms of the convergence, diversity, and speedup.

[1]  Xin Liu,et al.  A Distributed Parallel Cooperative Coevolutionary Multiobjective Evolutionary Algorithm for Large-Scale Optimization , 2017, IEEE Transactions on Industrial Informatics.

[2]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[3]  Hisao Ishibuchi,et al.  A Framework for Large-Scale Multiobjective Optimization Based on Problem Transformation , 2018, IEEE Transactions on Evolutionary Computation.

[4]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[5]  Shengxiang Yang,et al.  Bi-goal evolution for many-objective optimization problems , 2015, Artif. Intell..

[6]  Qingfu Zhang,et al.  Distributed evolutionary algorithms and their models: A survey of the state-of-the-art , 2015, Appl. Soft Comput..

[7]  Michel Raynal,et al.  A Look at Basics of Distributed Computing , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[8]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[9]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[10]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[12]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[13]  Xiaodong Li,et al.  Self-adaptive multi-objective evolutionary algorithm based on decomposition for large-scale problems: A case study on reservoir flood control operation , 2016, Inf. Sci..

[14]  Na Wang,et al.  Parallel Algorithm for Core Maintenance in Dynamic Graphs , 2016, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[15]  Shaojie Tang,et al.  Networked Stochastic Multi-armed Bandits with Combinatorial Strategies , 2015, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[16]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[17]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[18]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[19]  Witold Pedrycz,et al.  Data Mining Methods for Knowledge Discovery , 1998, IEEE Trans. Neural Networks.

[20]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  Data mining methods for knowledge discovery in multi-objective optimization: Part A - Survey , 2017, Expert Syst. Appl..

[22]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[23]  Gary G. Yen,et al.  Many-Objective Evolutionary Algorithm: Objective Space Reduction and Diversity Improvement , 2016, IEEE Transactions on Evolutionary Computation.

[24]  Shaojie Tang,et al.  Practical Concurrent Wireless Charging Scheduling for Sensor Networks , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[25]  Markus Olhofer,et al.  Test Problems for Large-Scale Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Cybernetics.

[26]  Pascal Bouvry,et al.  A scalable parallel cooperative coevolutionary PSO algorithm for multi-objective optimization , 2018, J. Parallel Distributed Comput..

[27]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  Cong Wang,et al.  Improve Charging Capability for Wireless Rechargeable Sensor Networks Using Resonant Repeaters , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[29]  Xiaomin Zhu,et al.  Scheduling for Workflows with Security-Sensitive Intermediate Data by Selective Tasks Duplication in Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[30]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[31]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[32]  Qingfu Zhang,et al.  Distribution of Computational Effort in Parallel MOEA/D , 2011, LION.

[33]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[34]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[35]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[36]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[37]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[38]  Mietek A. Brdys,et al.  Grid Implementation of a Parallel Multiobjective Genetic Algorithm for Optimized Allocation of Chlorination Stations in Drinking Water Distribution Systems: Chojnice Case Study , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).