PPM - A highly efficient parallel particle-mesh library for the simulation of continuum systems

This paper presents a highly efficient parallel particle-mesh (PPM) library, based on a unifying particle formulation for the simulation of continuous systems. In this formulation, the grid-free character of particle methods is relaxed by the introduction of a mesh for the reinitialization of the particles, the computation of the field equations, and the discretization of differential operators. The present utilization of the mesh does not detract from the adaptivity, the efficient handling of complex geometries, the minimal dissipation, and the good stability properties of particle methods.The coexistence of meshes and particles, allows for the development of a consistent and adaptive numerical method, but it presents a set of challenging parallelization issues that have hindered in the past the broader use of particle methods. The present library solves the key parallelization issues involving particle-mesh interpolations and the balancing of processor particle loading, using a novel adaptive tree for mixed domain decompositions along with a coloring scheme for the particle-mesh interpolation.The high parallel efficiency of the library is demonstrated in a series of benchmark tests on distributed memory and on a shared-memory vector architecture. The modularity of the method is shown by a range of simulations, from compressible vortex rings using a novel formulation of smooth particle hydrodynamics, to simulations of diffusion in real biological cell organelles.The present library enables large scale simulations of diverse physical problems using adaptive particle methods and provides a computational tool that is a viable alternative to mesh-based methods.

[1]  V. Rokhlin,et al.  Rapid Evaluation of Potential Fields in Three Dimensions , 1988 .

[2]  Michael Bergdorf,et al.  Multilevel Adaptive Particle Methods for Convection-Diffusion Equations , 2005, Multiscale Model. Simul..

[3]  Robert D. Falgout,et al.  The Design and Implementation of hypre, a Library of Parallel High Performance Preconditioners , 2006 .

[4]  Ravi Jain,et al.  Parallel I/O scheduling using randomized, distributed edge coloring algorithms , 2003, J. Parallel Distributed Comput..

[5]  P. Colella,et al.  A Conservative Adaptive Projection Method for the Variable Density Incompressible Navier-Stokes Equations , 1998 .

[6]  Raphaël Couturier,et al.  Parallel molecular dynamics using OPENMP on a shared memory machine , 2000 .

[7]  P. Degond,et al.  The weighted particle method for convection-diffusion equations , 1989 .

[8]  S. R. Chapple,et al.  The Parallel Utilities Library , 1994, Proceedings Scalable Parallel Libraries Conference.

[9]  Qian Xi Wang,et al.  Variable order revised binary treecode , 2004 .

[10]  Scott R. Kohn,et al.  Large scale parallel structured AMR calculations using the SAMRAI framework , 2001, SC.

[11]  Petros Koumoutsakos,et al.  Remeshed smoothed particle hydrodynamics for the simulation of viscous and heat conducting flows , 2002 .

[12]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[13]  Steven J. Plimpton,et al.  A load-balancing algorithm for a parallel electromagnetic particle-in-cell code , 2003 .

[14]  P. Koumoutsakos MULTISCALE FLOW SIMULATIONS USING PARTICLES , 2005 .

[15]  Florent Laporte,et al.  Elliptic Instability of Counter-Rotating Vortices: Experiment and Direct Numerical Simulation , 2002 .

[16]  G. Pedrizzetti,et al.  Vortex Dynamics , 2011 .

[17]  Goran Lj. Djordjevic,et al.  A Heuristic for Scheduling Task Graphs with Communication Delays Onto Multiprocessors , 1996, Parallel Comput..

[18]  J. Williamson Low-storage Runge-Kutta schemes , 1980 .

[19]  J. Christiansen Numerical Simulation of Hydrodynamics by the Method of Point Vortices , 1997 .

[20]  L. Verlet Computer "Experiments" on Classical Fluids. I. Thermodynamical Properties of Lennard-Jones Molecules , 1967 .

[21]  Petros Koumoutsakos,et al.  Three-dimensional vortex methods for particle-laden flows with two-way coupling , 2001 .

[22]  D. W. Moore,et al.  The effect of compressibility on the speed of propagation of a vortex ring , 1985, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[23]  J. Monaghan,et al.  Extrapolating B splines for interpolation , 1985 .

[24]  Georges-Henri Cottet,et al.  Advances in direct numerical simulations of 3D wall-bounded flows by Vortex-in-Cell methods , 2004 .

[25]  Tim Colonius,et al.  A general deterministic treatment of derivatives in particle methods , 2002 .

[26]  V. Springel,et al.  GADGET: a code for collisionless and gasdynamical cosmological simulations , 2000, astro-ph/0003162.

[27]  S. Osher,et al.  Efficient implementation of essentially non-oscillatory shock-capturing schemes,II , 1989 .

[28]  Mark F. Adams,et al.  Applications of Algebraic Multigrid to Large-Scale Finite Element Analysis of Whole Bone Micro-Mechanics on the IBM SP , 2003, International Conference on Software Composition.

[29]  R W Hockney,et al.  Computer Simulation Using Particles , 1966 .

[30]  Christopher R. Anderson,et al.  Vortex dynamics and vortex methods , 1991 .

[31]  J. Lippincott-Schwartz,et al.  Studying protein dynamics in living cells , 2001, Nature Reviews Molecular Cell Biology.

[32]  Joel H. Saltz,et al.  Adaptive runtime support for direct simulation Monte Carlo methods on distributed memory architectures , 1994, Proceedings of IEEE Scalable High Performance Computing Conference.

[33]  Paolo Orlandi,et al.  A numerical study of three-dimensional vortex ring instabilities: viscous corrections and early nonlinear stage , 1994, Journal of Fluid Mechanics.

[34]  J. Cary,et al.  VORPAL: a versatile plasma simulation code , 2004 .

[35]  P. Gremaud,et al.  Super-time-stepping acceleration of explicit schemes for parabolic problems , 1996 .

[36]  Edward A. Carmona,et al.  On Parallel PIC Versatility and the Structure of Parallel PIC Approaches , 1997, Concurr. Pract. Exp..

[37]  Grégoire Winckelmans,et al.  Contributions to vortex particle methods for the computation of three-dimensional incompressible unsteady flows , 1993 .

[38]  Mark F. Adams,et al.  Ultrascalable Implicit Finite Element Analyses in Solid Mechanics with over a Half a Billion Degrees of Freedom , 2004, Proceedings of the ACM/IEEE SC2004 Conference.