Coupling-aware graph partitioning algorithms: Preliminary study

In the field of scientific computing, load balancing is a major issue that determines the performance of parallel applications. Nowadays, simulations of real-life problems are becoming more and more complex, involving numerous coupled codes, representing different models. In this context, reaching high performance can be a great challenge. In this paper, we present graph partitioning techniques, called co-partitioning, that address the problem of load balancing for two coupled codes: the key idea is to perform a “coupling-aware” partitioning, instead of partitioning these codes independently, as it is usually done. Finally, we present a preliminary experimental study which compares our methods against the usual approach.

[1]  Mariana Vertenstein,et al.  Computational performance of ultra-high-resolution capability in the Community Earth System Model , 2012, Int. J. High Perform. Comput. Appl..

[2]  Vipin Kumar,et al.  Wavefront Diffusion and LMSR: Algorithms for Dynamic Repartitioning of Adaptive Meshes , 2001, IEEE Trans. Parallel Distributed Syst..

[3]  Dirk Roose,et al.  Dynamic load balancing with a spectral bisection algorithm for the constrained graph partitioning problem , 1995, HPCN Europe.

[4]  Tamara G. Kolda,et al.  Graph partitioning models for parallel computing , 2000, Parallel Comput..

[5]  Peter Sanders,et al.  Think Locally, Act Globally: Highly Balanced Graph Partitioning , 2013, SEA.

[6]  Leonid Oliker,et al.  PLUM: Parallel Load Balancing for Adaptive Unstructured Meshes , 1998, J. Parallel Distributed Comput..

[7]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[8]  S. Jaure,et al.  COMPARISONS OF COUPLING STRATEGIES FOR MASSIVELY PARALLEL CONJUGATE HEAT TRANSFER WITH LARGE EDDY SIMULATION , 2011 .

[9]  Karen Dragon Devine,et al.  Partitioning and Dynamic Load Balancing for the Numerical Solution of Partial Differential Equations , 2006 .

[10]  Thierry Poinsot,et al.  Coupling LES, radiation and structure in gas turbine simulations , 2010 .

[11]  Lynita K. Newswander,et al.  Metis , 2015 .

[12]  Berkant Barla Cambazoglu,et al.  Multi-level direct K-way hypergraph partitioning with multiple constraints and fixed vertices , 2008, J. Parallel Distributed Comput..

[13]  Vipin Kumar,et al.  Multilevel Algorithms for Multi-Constraint Graph Partitioning , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[14]  George Karypis,et al.  Multilevel k-way Partitioning Scheme for Irregular Graphs , 1998, J. Parallel Distributed Comput..

[15]  S. Valcke,et al.  The OASIS3 coupler: a European climate modelling community software , 2012 .

[16]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[17]  David S. Johnson,et al.  Computers and Inrracrobiliry: A Guide ro the Theory of NP-Completeness , 1979 .

[18]  Ümit V. Çatalyürek,et al.  A repartitioning hypergraph model for dynamic load balancing , 2009, J. Parallel Distributed Comput..

[19]  Vipin Kumar,et al.  Multilevel Diffusion Schemes for Repartitioning of Adaptive Meshes , 1997, J. Parallel Distributed Comput..

[20]  J. Larson.  Ten organising principles for coupling in multiphysics and multiscale models , 2009 .

[22]  Chris Walshaw,et al.  Multiphase mesh partitioning , 2000 .

[23]  Clement Vuchener.  Equilibrage de charges dynamique avec un nombre variable de processeurs basé sur des méthodes de partitionnement de graphe , 2014 .

[24]  Aurélien Esnard,et al.  Graph Repartitioning with both Dynamic Load and Dynamic Processor Allocation , 2013, PARCO.

[25]  Bruce Hendrickson,et al.  A Multi-Level Algorithm For Partitioning Graphs , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[26]  Berkant Barla Cambazoglu,et al.  Adaptive decomposition and remapping algorithms for object-space-parallel direct volume rendering of unstructured grids , 2007, J. Parallel Distributed Comput..

[27]  Mariana Vertenstein,et al.  A new flexible coupler for earth system modeling developed for CCSM4 and CESM1 , 2012, Int. J. High Perform. Comput. Appl..

[28]  Charles M. Fiduccia,et al.  A linear-time heuristic for improving network partitions , 1988, 25 years of DAC.

[29]  Aurélien Esnard,et al.  Dynamic load-balancing with variable number of processors based on graph repartitioning , 2012, 2012 19th International Conference on High Performance Computing.