Large‐scale density‐driven flow simulations using parallel unstructured Grid adaptation and local multigrid methods

Advanced parallel applications based on the message‐passing paradigm are difficult to design and implement, especially when solution adaptive techniques are used and three‐dimensional problems on complex geometries are faced, which yield the use of unstructured Grids. We present the building blocks for a parallel‐adaptive scheme for the solution of time‐dependent and nonlinear partial differential equations. To minimize computational requirements, h‐adaptivity is introduced via parallel, local Grid adaptation. Novel techniques to avoid hanging nodes are introduced, these assure conforming meshes of hybrid element type in three space dimensions. As a core of the adaptive scheme, local multigrid methods are used to solve the arising linear systems rapidly in parallel. Dynamic Grid changes from h‐adaptivity lead to load imbalance during run time, therefore dynamic load balancing and migration is performed to exploit the aggregated performance of large processor sets efficiently. Real‐world calculations arising from density‐driven flow problems in porous media are performed using the presented parallel‐adaptive solution strategy. The computations are analyzed with regard to speedup. Timings of Grid adaptation, dynamic load balancing/migration and numerical solution scheme show that large‐scale runs on 512 processors gain an overall parallel, numerical speedup of up to 278. A further reduction of the element count by h‐adaptivity by a factor of up to 195 shows the enormous capabilities of the presented parallel‐adaptive multigrid based solution scheme. Copyright © 2005 John Wiley & Sons, Ltd.

[1]  Jinchao Xu,et al.  Convergence estimates for multigrid algorithms without regularity assumptions , 1991 .

[2]  B. Rivière,et al.  Part II. Discontinuous Galerkin method applied to a single phase flow in porous media , 2000 .

[3]  P. Knabner,et al.  ADAPTIVE FINITE VOLUME DISCRETIZATION OF DENSITY DRIVEN FLOWS IN POROUS MEDIA , 1998 .

[4]  Leonid Oliker,et al.  Experiments with Repartitioning and Load Balancing Adaptive Meshes , 1999 .

[5]  E. Holzbecher Modeling Density-Driven Flow in Porous Media , 1998 .

[6]  G. Wittum,et al.  On Robust and Adaptive Multi-Grid Methods , 1994 .

[7]  Peter Bastian Locally Refined Solution of Unsymmetric and Nonlinear Problems , 1993 .

[8]  David S. Johnson,et al.  Some Simplified NP-Complete Graph Problems , 1976, Theor. Comput. Sci..

[9]  Peter Knabner,et al.  An error estimator for a finite volume discretization of density driven flow in porous media , 1998 .

[10]  Bruce Hendrickson,et al.  A Multi-Level Algorithm For Partitioning Graphs , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[11]  María Cecilia Rivara,et al.  Design and data structure of fully adaptive, multigrid, finite-element software , 1984, ACM Trans. Math. Softw..

[12]  Johan De Keyser,et al.  Grid partitioning by inertial recursive bisection , 1992 .

[13]  Brian W. Kernighan,et al.  An efficient heuristic procedure for partitioning graphs , 1970, Bell Syst. Tech. J..

[14]  Vipin Kumar,et al.  Multilevel Algorithms for Multi-Constraint Graph Partitioning , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[15]  R. Bank,et al.  The hierarchical basis multigrid method , 1988 .

[16]  Gabriel Wittum,et al.  Additive and multiplicative multi-grid — A comparison , 1998, Computing.

[17]  Stefan Lang Parallele numerische Simulation instationärer Probleme mit adaptiven Methoden auf unstrukturierten Gittern , 2001 .

[18]  G. Wittum,et al.  The saltpool benchmark problem – numerical simulation of saltwater upconing in a porous medium , 2002 .

[19]  Peter Bastian,et al.  Adaptive Multigrid Methods: The UG Concept , 1994 .

[20]  Anton Leijnse,et al.  Three-dimensional modeling of coupled flow and transport in porous media , 1992 .

[21]  Can C. Özturan,et al.  Parallel Automatic Adaptive Analysis , 1997, Parallel Comput..

[22]  Klaus Birken,et al.  Ein Modell zur effizienten Parallelisierung von Algorithmen auf komplexen, dynamischen Datenstrukturen , 1998 .

[23]  J. Pasciak,et al.  Parallel multilevel preconditioners , 1990 .

[24]  H. Yserentant Old and new convergence proofs for multigrid methods , 1993, Acta Numerica.

[25]  H. Rentz-Reichert,et al.  UG – A flexible software toolbox for solving partial differential equations , 1997 .

[26]  Peter Deuflhard,et al.  Concepts of an adaptive hierarchical finite element code , 1989, IMPACT Comput. Sci. Eng..

[27]  Peter Bastian,et al.  Parallele adaptive Mehrgitterverfahren , 1994 .

[28]  Bruce Hendrickson,et al.  The Chaco user`s guide. Version 1.0 , 1993 .

[29]  Horst D. Simon,et al.  Partitioning of unstructured problems for parallel processing , 1991 .

[30]  Joachim Schöberl,et al.  NETGEN An advancing front 2D/3D-mesh generator based on abstract rules , 1997 .