Late parallelization and feedback approaches for distributed computation of evolutionary multi-objective optimization algorithms

Distributing of the multi-objective evolutionary algorithms into various computational devices in a parallel fashion is a method for speeding up the execution time of the algorithms. When the processors are increased in number, the gain from parallelization decreases. For this reason, the aim of the parallelization method is not only to decrease the overall algorithm execution time, but also to obtain a higher gain from the use of parallel processors. Therefore, in this study two new parallelization approaches are proposed and discussed to increase the benefit from the computational devices. The proposed schemes are named as late parallelization and feedback approaches. These proposed approaches are based on four-layered structure, and each layer (i) has the $$2^i$$2i number of computational units where population at each unit is divided into two equal subpopulations at ordered layers. Consequently, the sum of the members at every layer equals to each other. Of these layer-based cognate schemes, in late parallelization, the layers are executed sequentially beginning with the first layer. Until the last layer is executed, a delay time is defined such that layers are executed more than one except the last layer. However, at feedback approach, the order of the layers is different and the last layer is connected with the front layer. So, the population is not only divided into subpopulations but also they are gathered with the in-osculation of the subpopulations. Finally, the performances of these approaches are evaluated on multi-objective test problems with respect to the statistical properties of the number of function evaluations.

[1]  C. Shunmuga Velayutham,et al.  Hybridizing Differential Evolution Variants Through Heterogeneous Mixing in a Distributed Framework , 2016 .

[2]  Albert Y. Zomaya,et al.  Solutions to Parallel and Distributed Computing Problems , 2001 .

[3]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[4]  Kalyanmoy Deb,et al.  Parallelizing multi-objective evolutionary algorithms: cone separation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[5]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[6]  Yang Yang,et al.  A distributed cooperative coevolutionary algorithm for multiobjective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[7]  Andrew Lewis,et al.  Parallel multi-objective optimization using Master-Slave model on heterogeneous resources , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[8]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[9]  Hartmut Schmeck,et al.  Parallel implementations of evolutionary algorithms , 2001 .

[10]  Dario Izzo,et al.  The asynchronous island model and NSGA-II: study of a new migration operator and its performance , 2013, GECCO '13.

[11]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[12]  Jan Richter,et al.  A distributed multiobjective approach to negotiations in semi-competitive environments , 2012, 2012 IEEE Congress on Evolutionary Computation.

[13]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Wenhong Tian,et al.  A distributed coevolutionary algorithm for multiobjective hybrid flowshop scheduling problems , 2014 .

[15]  G. Jeyakumar,et al.  Co-operative Co-evolution Based Hybridization of Differential Evolution and Particle Swarm Optimization Algorithms in Distributed Environment , 2016 .

[16]  C. Shunmuga Velayutham,et al.  Distributed mixed variant differential evolution algorithms for unconstrained global optimization , 2013, Memetic Comput..

[17]  Antoni Wibowo,et al.  Effective local evolutionary searches distributed on an island model solving bi-objective optimization problems , 2012, Applied Intelligence.

[18]  Qingfu Zhang,et al.  Distributed evolutionary algorithms and their models: A survey of the state-of-the-art , 2015, Appl. Soft Comput..

[19]  Olivier Boissier,et al.  Dafo, a Multi-agent Framework for Decomposable Functions Optimization , 2005, KES.

[20]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO '06.

[21]  Matjaz Depolli,et al.  Asynchronous Master-Slave Parallelization of Differential Evolution for Multi-Objective Optimization , 2013, Evolutionary Computation.

[22]  Kalyanmoy Deb,et al.  Reference point based distributed computing for multiobjective optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[23]  Kalyanmoy Deb,et al.  Distributed Computing of Pareto-Optimal Solutions with Evolutionary Algorithms , 2003, EMO.

[24]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[25]  Marc Parizeau,et al.  Analysis of a master-slave architecture for distributed evolutionary computations , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Georgios C. Anagnostopoulos,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2003, Lecture Notes in Computer Science.

[27]  S. N. Omkar,et al.  MPI-based parallel synchronous vector evaluated particle swarm optimization for multi-objective design optimization of composite structures , 2012, Eng. Appl. Artif. Intell..

[28]  C. Shunmuga Velayutham,et al.  Distributed heterogeneous mixing of differential and dynamic differential evolution variants for unconstrained global optimization , 2014, Soft Comput..