PUMI: Parallel Unstructured Mesh Infrastructure

The Parallel Unstructured Mesh Infrastructure (PUMI) is designed to support the representation of, and operations on, unstructured meshes as needed for the execution of mesh-based simulations on massively parallel computers. In PUMI, the mesh representation is complete in the sense of being able to provide any adjacency of mesh entities of multiple topologies in O(1) time, and fully distributed to support relationships of mesh entities across multiple memory spaces in a manner consistent with supporting massively parallel simulation workflows. PUMI's mesh maintains links to the high-level model definition in terms of a model topology as produced by CAD systems, and is specifically designed to efficiently support evolving meshes as required for mesh generation and adaptation. To support the needs of parallel unstructured mesh simulations, PUMI also supports a specific set of services such as the migration of mesh entities between parts while maintaining the mesh adjacencies, maintaining read-only mesh entity copies from neighboring parts (ghosting), repartitioning parts as the mesh evolves, and dynamic mesh load balancing. Here we present the overall design, software structures, example programs, and performance results. The effectiveness of PUMI is demonstrated by its applications to massively parallel adaptive simulation workflows.

[1]  Onkar Sahni,et al.  Tools to support mesh adaptation on massively parallel computers , 2011, Engineering with Computers.

[2]  Timothy J. Tautges,et al.  An Interoperable, Data-Structure-Neutral Component for Mesh Query and Manipulation , 2010, ACM Trans. Math. Softw..

[3]  Laxmikant V. Kalé,et al.  ParFUM: a parallel framework for unstructured meshes for scalable dynamic physics applications , 2006, Engineering with Computers.

[4]  D. Drew,et al.  PARALLEL ADAPTIVE SIMULATION OF A PLUNGING LIQUID JET ∗ Dedicated to Professor James Glimm on the occasion of his 75th birthday , 2010 .

[5]  Onkar Sahni,et al.  Anisotropic Boundary Layer Adaptivity of Multi-Element Wings , 2014, 1402.6753.

[6]  K. Jansen,et al.  On the interaction between dynamic model dissipation and numerical dissipation due to streamline upwind/Petrov–Galerkin stabilization , 2005 .

[7]  Robert M. O'Bara,et al.  Attribute Management System for Engineering Analysis , 2002, Engineering with Computers.

[8]  Alan B. Williams,et al.  toolkit computational mesh conceptual model. , 2010 .

[9]  Mark S. Shephard Meshing environment for geometry-based analysis , 2000 .

[10]  Cameron W. Smith,et al.  METHODS AND TOOLS FOR PARALLEL ANISOTROPIC MESH ADAPTATION AND ANALYSIS , 2012 .

[11]  Mark S. Shephard,et al.  a General Topology-Based Mesh Data Structure , 1997 .

[12]  Glaucio H. Paulino,et al.  A compact adjacency‐based topological data structure for finite element mesh representation , 2005 .

[13]  Mark S. Shephard,et al.  PARALLEL MESH GENERATION AND ADAPTATION FOR CAD GEOMETRIES , 2011 .

[14]  M. Shephard,et al.  Reliability of automatic 3D mesh generation , 1992 .

[15]  Benjamin A. Matthews,et al.  Scalable fully implicit finite element flow solver with application to high-fidelity flow control simulations on a realistic wing design , 2014 .

[16]  Timothy J. Tautges,et al.  MOAB : a mesh-oriented database. , 2004 .

[17]  Vipin Kumar,et al.  Parallel static and dynamic multi‐constraint graph partitioning , 2002, Concurr. Comput. Pract. Exp..

[18]  Mark S. Shephard,et al.  Efficient distributed mesh data structure for parallel automated adaptive analysis , 2006, Engineering with Computers.

[19]  L. A. Schoof,et al.  EXODUS II: A finite element data model , 1994 .

[20]  David Bommes,et al.  OpenVolumeMesh - A Versatile Index-Based Data Structure for 3D Polytopal Complexes , 2012, IMR.

[21]  Onkar Sahni,et al.  Automated adaptive cardiovascular flow simulations , 2009, Engineering with Computers.

[22]  Onkar Sahni,et al.  Adaptive boundary layer meshing for viscous flow simulations , 2008, Engineering with Computers.

[23]  Onkar Sahni,et al.  Controlling Unstructured Mesh Partitions for Massively Parallel Simulations , 2010, SIAM J. Sci. Comput..

[24]  K. Jansen,et al.  A parameter-free dynamic subgrid-scale model for large-eddy simulation , 2006 .

[25]  Mark W. Beall,et al.  An Object-Oriented Framework for the Reliable Automated Solution of Problems in Mathematical Physics , 1999 .

[26]  Torsten Hoefler,et al.  Scalable communication protocols for dynamic sparse data exchange , 2010, PPoPP '10.

[27]  Mark S. Shephard,et al.  3D anisotropic mesh adaptation by mesh modification , 2005 .

[28]  S. Dey,et al.  Hierarchical basis for stabilized finite element methods for compressible flows , 2003 .

[29]  Onkar Sahni,et al.  Parallel Adaptive Boundary Layer Meshing for CFD Analysis , 2012, IMR.

[30]  Xiangmin Jiao,et al.  Proceedings of the 21st International Meshing Roundtable , 2014 .

[31]  Joe Walsh,et al.  A comparison of techniques for geometry access related to mesh generation , 2004, Engineering with Computers.

[32]  Onkar Sahni,et al.  Anisotropic Adaptation for Transonic Flows with Turbulent Boundary Layers , 2015 .

[33]  Roger P. Pawlowski,et al.  Albany: A Component-Based Partial Differential Equation Code Built on Trilinos. , 2013 .

[34]  Onkar Sahni,et al.  Building Effective Parallel Unstructured Adaptive Simulations by In-memory Integration of Existing Software Components , 2012 .

[35]  Boleslaw K. Szymanski,et al.  Predictive Load Balancing for Parallel Adaptive Finite Element Computation , 1997, PDPTA.

[36]  J. D. Teresco,et al.  Parallel structures and dynamic load balancing for adaptive finite element computation , 1998 .

[37]  Onkar Sahni,et al.  Unstructured mesh partition improvement for implicit finite element at extreme scale , 2010, The Journal of Supercomputing.

[38]  Timothy J. Tautges,et al.  MOAB-SD: integrated structured and unstructured mesh representation , 2004, Engineering with Computers.

[39]  Courtenay T. Vaughan,et al.  Zoltan data management services for parallel dynamic applications , 2002, Comput. Sci. Eng..

[40]  Michael Amitay,et al.  Aerodynamic Flow Control Using Synthetic Jet Technology , 1998 .

[41]  Mark S. Shephard,et al.  A Parallel Unstructured Mesh Infrastructure , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[42]  Mark S. Shephard,et al.  Generic components for petascale adaptive unstructured mesh-based simulations , 2012, Engineering with Computers.

[43]  Kenneth E. Jansen,et al.  Geometry based pre-processor for parallel fluid dynamic simulations using a hierarchical basis , 2008, Engineering with Computers.

[44]  James A. Malcolm,et al.  An Object-Oriented Virtual Geometry Interface , 1997 .

[45]  Mark S. Shephard,et al.  Hybrid MPI-thread parallelization of adaptive mesh operations , 2016, Parallel Comput..

[46]  Timothy J. Tautges,et al.  Toward interoperable mesh, geometry and field components for PDE simulation development , 2007, Engineering with Computers.

[47]  K. Jansen,et al.  Three-dimensional interactions between a finite-span synthetic jet and a crossflow , 2011, Journal of Fluid Mechanics.

[48]  Joe Walsh,et al.  Accessing CAD Geometry for Mesh Generation , 2003, IMR.

[49]  Mark S. Shephard,et al.  Moving curved mesh adaptation for higher-order finite element simulations , 2010, Engineering with Computers.

[50]  Alan B. Williams,et al.  SIERRA Toolkit Computational Mesh Conceptual Model , 2010 .

[51]  David R. Musser,et al.  Fmdb: flexible distributed mesh database for parallel automated adaptive analysis , 2005 .

[52]  Josep Sarrate,et al.  Proceedings of the 22nd International Meshing Roundtable , 2014 .

[53]  Mark S. Shephard,et al.  Accounting for curved domains in mesh adaptation , 2003 .

[54]  M. Amitay,et al.  SYNTHETIC JETS , 2001 .

[55]  Ümit V. Çatalyürek,et al.  The Zoltan and Isorropia parallel toolkits for combinatorial scientific computing: Partitioning, ordering and coloring , 2012, Sci. Program..

[56]  Tamara G. Kolda,et al.  An overview of the Trilinos project , 2005, TOMS.

[57]  Mark S. Shephard Interoperable Technologies for Advanced Petascale Simulations (ITAPS) , 2010 .

[58]  Malcolm Atkinson,et al.  High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion: , 2012 .

[59]  Jean-François Remacle,et al.  An algorithm oriented mesh database , 2003, IMR.

[60]  Frédéric Alauzet,et al.  Parallel anisotropic 3D mesh adaptation by mesh modification , 2006, Engineering with Computers.

[61]  Charles A. Taylor,et al.  Efficient anisotropic adaptive discretization of the cardiovascular system , 2006 .

[62]  Onkar Sahni,et al.  Cardiovascular flow simulation at extreme scale , 2010 .

[63]  Timothy J. Tautges,et al.  CGM: A Geometry Interface for Mesh Generation, Analysis and Other Applications , 2001, Engineering with Computers.

[64]  G. Hulbert,et al.  A generalized-α method for integrating the filtered Navier–Stokes equations with a stabilized finite element method , 2000 .

[65]  Benjamin S. Kirk,et al.  Library for Parallel Adaptive Mesh Refinement / Coarsening Simulations , 2006 .

[66]  Glen Hansen,et al.  Mesh generation technology for nuclear reactor simulation; barriers and opportunities , 2007 .

[67]  Mark S. Shephard,et al.  Flexible Distributed Mesh Data Structure for Parallel Adaptive Analysis , 2009 .

[68]  Timothy J. Tautges,et al.  AHF: array-based half-facet data structure for mixed-dimensional and non-manifold meshes , 2015, Engineering with Computers.

[69]  Rao V. Garimella,et al.  Mesh data structure selection for mesh generation and FEA applications , 2002 .

[70]  T. Hughes,et al.  Large Eddy Simulation and the variational multiscale method , 2000 .