A study of master-slave approaches to parallelize NSGA-II

Many of the optimization problems from the real world are multiobjective in nature, and the reference algorithm for multiobjective optimization is NSGA-II. Frequently, these problems present a high complexity, so classical metaheuristic algorithms fail to solve them in a reasonable amount of time; in this context, parallelism is a choice to overcome this fact to some extent. In this paper we study three parallel approaches (a synchronous and two asynchronous strategies) for the NSGA-II algorithm based on the master-worker paradigm. The asynchronous schemes are designed to be used in grid systems, so they can make use of hundreds of machines. We have applied them to solve a real world problem which lies in optimizing a broadcasting protocol using a network simulator. Our experiences reveal that significant time reductions can be achieved with the distributed approaches by using a grid system of more than 300 processors.

[1]  Enrique Alba,et al.  DNA fragment assembly using a grid-based genetic algorithm , 2008, Comput. Oper. Res..

[2]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[3]  C.K. Sinclair,et al.  Use of Multiobjective Evolutionary Algorithms in High Brightness Electron Source Design , 2005, Proceedings of the 2005 Particle Accelerator Conference.

[4]  Juan J. Alonso,et al.  AIAA 2004 – 1758 Design of a Low-Boom Supersonic Business Jet Using Evolutionary Algorithms and an Adaptive Unstructured Mesh Method , 2004 .

[5]  Jeff T. Linderoth,et al.  An enabling framework for master-worker applications on the Computational Grid , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[6]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[7]  Charles Sinclair,et al.  Multivariate optimization of a high brightness dc gun photoinjector , 2005 .

[8]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[9]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[10]  Francine Berman,et al.  Overview of the Book: Grid Computing – Making the Global Infrastructure a Reality , 2003 .

[11]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[12]  Kalyanmoy Deb,et al.  Distributed Computing of Pareto-Optimal Solutions with Evolutionary Algorithms , 2003, EMO.

[13]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[14]  Enrique Alba,et al.  A cellular multi-objective genetic algorithm for optimal broadcasting strategy in metropolitan MANETs , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[15]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[16]  José C. Cunha,et al.  Grid Computing: Software Environments and Tools , 2005 .

[17]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[18]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[19]  Kalyanmoy Deb,et al.  Parallelizing multi-objective evolutionary algorithms: cone separation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[21]  Francisco Luna,et al.  jMetal: a Java Framework for Developing Multi-Objective Optimization Metaheuristics , 2006 .

[22]  Andreas Zell,et al.  Parallelization of Multi-objective Evolutionary Algorithms Using Clustering Algorithms , 2005, EMO.

[23]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[24]  Kalyanmoy Deb,et al.  Improved Pruning of Non-Dominated Solutions Based on Crowding Distance for Bi-Objective Optimization Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[25]  Tomoyuki Hiroyasu,et al.  Discussion of parallel model of multi-objective genetic algorithms on heterogeneous computational resources , 2007, GECCO '07.

[26]  U Aickelin,et al.  Handbook of metaheuristics (International series in operations research and management science) , 2005 .

[27]  Peter I. Cowling,et al.  The Trade Off Between Diversity and Quality for Multi-objective Workforce Scheduling , 2006, EvoCOP.

[28]  Miron Livny,et al.  Condor and the Grid , 2003 .