Towards adaptive mesh PDE simulations on petascale computers

The advent of the age of petascale computing brings unprecedented opportunities for breakthroughs in scientific understanding and engineering innovation. However, the raw performance made available by petascale systems is by itself not sufficient to solve many challenging modeling and simulation problems. For example, the complexity of solving evolutionary partial differential equations scales as n at best, where n is the number of mesh points in each spatial direction.1 Thus, the three-orders-of-magnitude improvement in peak speed of supercomputers over the past dozen years has meant just a factor of 5.6 improvement in spatio-temporal resolution—not even three successive refinements of mesh size. For many problems of scientific and engineering interest, there is a desire to increase resolution of current simulations by several orders of magnitude. As just one example, current longrange climate models operate at O(300) km resolution; yet, O(10) km grid spacing is desirable to obtain predictions of surface temperature and precipitation in sufficient detail to analyze the regional and local implications of climate change, and to resolve oceanic mesoscale eddies [9]. Thus, although supercomputing performance has outpaced Moore’s Law over the past several decades due to increased concurrency [9], the curse of dimensionality imposes much slower scientific returns; e.g. improvement in mesh resolution grows at best with the onefourth power of peak performance in the case of evolutionary PDEs. The work requirements of scientific simulations typically scale as n. The power α can be reduced through the use of optimal solvers such as multigrid for PDEs and fast multipole for integral equations and N-body problems. Once α has been reduced as much as possible, further reductions in work can be achieved only by reducing n itself. This can be achieved in two ways: through the use of adaptive mesh refinement/coarsening (AMR) strategies, and by invoking higher order approximations (in space and time). The former place mesh points only where needed to resolve solution features, while the latter

[1]  Abani K. Patra,et al.  Simple data management, scheduling and solution strategies for managing the irregularities in parallel adaptive hp finite element simulations , 2000, Parallel Comput..

[2]  Hari Sundar,et al.  Bottom-Up Construction and 2: 1 Balance Refinement of Linear Octrees in Parallel , 2008, SIAM J. Sci. Comput..

[3]  W. Bangerth,et al.  deal.II—A general-purpose object-oriented finite element library , 2007, TOMS.

[4]  Charles D. Norton,et al.  Developing parallel GeoFEST(P) using the PYRAMID AMR library , 2004 .

[5]  Richard D. Hornung,et al.  Enhancing scalability of parallel structured AMR calculations , 2003, ICS '03.

[6]  Mary F. Wheeler,et al.  Mesh Adaptation Strategies for Discontinuous Galerkin Methods Applied to Reactive Transport Problems , 2004 .

[7]  Maciej Paszyński,et al.  Computing with hp-ADAPTIVE FINITE ELEMENTS: Volume II Frontiers: Three Dimensional Elliptic and Maxwell Problems with Applications , 2007 .

[8]  J. Oden,et al.  A Posteriori Error Estimation in Finite Element Analysis , 2000 .

[9]  David R. O'Hallaron,et al.  Scalable Parallel Octree Meshing for TeraScale Applications , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[10]  Michael Zingale,et al.  High-Performance Reactive Fluid Flow Simulations Using Adaptive Mesh Refinement on Thousands of Processors , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[11]  Allen D. Malony,et al.  The Tau Parallel Performance System , 2006, Int. J. High Perform. Comput. Appl..

[12]  Richard D. Hornung,et al.  Parallel Adaptive Mesh Refinement , 2006, Parallel Processing for Scientific Computing.

[13]  T. Hughes,et al.  Streamline upwind/Petrov-Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier-Stokes equations , 1990 .

[14]  John B. Bell,et al.  Performance and scaling of locally-structured grid methods forpartial differential equations , 2007 .

[15]  Boleslaw K. Szymanski,et al.  Adaptive Local Refinement with Octree Load Balancing for the Parallel Solution of Three-Dimensional Conservation Laws , 1997, J. Parallel Distributed Comput..

[16]  David Bailey The 1997 Petaflops Algorithms Workshop , 1997 .

[17]  I. Babuska,et al.  The finite element method and its reliability , 2001 .

[18]  J. Z. Zhu,et al.  The finite element method , 1977 .

[19]  Rolf Rannacher,et al.  An optimal control approach to a posteriori error estimation in finite element methods , 2001, Acta Numerica.

[20]  Benjamin S. Kirk,et al.  Library for Parallel Adaptive Mesh Refinement / Coarsening Simulations , 2006 .