Coupling multibody dynamics and computational fluid dynamics on 8192 processor cores

This paper describes a method for the fully resolved simulation of particle laden flows. For this purpose, we discuss the parallelization of large scale coupled fluid structure interaction with up to 37 million geometrically modeled moving objects incorporated in the flow. The simulation is performed using a 3D lattice Boltzmann solver for the fluid flow and a so-called rigid body physics engine for the treatment of the objects. The numerical algorithms and the parallelization are discussed in detail. Furthermore, performance results are presented for test cases on up to 8192 processor cores running on an SGI Altix supercomputer. The approach enables a detailed simulation of large scale particulate flows that are relevant for many industrial applications.

[1]  D Frenkel,et al.  Lattice-Boltzmann method for the simulation of transport phenomena in charged colloids. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Volker Strumpen,et al.  The memory behavior of cache oblivious stencil computations , 2007, The Journal of Supercomputing.

[3]  Willi Jäger,et al.  High Performance Computing in Science and Engineering ’98 , 1999 .

[4]  U. Rüde,et al.  Lattice Boltzmann Model for Free Surface Flow for Modeling Foaming , 2005 .

[5]  W. Shyy,et al.  Viscous flow computations with the method of lattice Boltzmann equation , 2003 .

[6]  A. Ladd.  Numerical simulations of particulate suspensions via a discretized Boltzmann equation. Part 2. Numerical results , 1993, Journal of Fluid Mechanics.

[7]  Ulrich Rüde,et al.  Lehrstuhl Für Informatik 10 (systemsimulation) Iterative Rigid Multibody Dynamics Iterative Rigid Multibody Dynamics , 2022 .

[8]  Gerhard Wellein,et al.  On the single processor performance of simple lattice Boltzmann kernels , 2006 .

[9]  Ulrich Rüde,et al.  Concepts of waLBerla Prototype 0.1 , 2008 .

[10]  R. Glowinski,et al.  Fluidization of 1204 spheres: simulation and experiment , 2002, Journal of Fluid Mechanics.

[11]  L. Luo,et al.  Lattice Boltzmann Model for the Incompressible Navier–Stokes Equation , 1997 .

[12]  T. Pohl,et al.  High Performance Simulation of Free Surface Flows Using the Lattice Boltzmann Method , 2008 .

[13]  A. Ladd.  Numerical simulations of particulate suspensions via a discretized Boltzmann equation. Part 1. Theoretical foundation , 1993, Journal of Fluid Mechanics.

[14]  Michael M. Resch,et al.  Computational Science and High Performance Computing III , 2005 .

[15]  Dinesh K. Pai,et al.  Fast frictional dynamics for rigid bodies , 2005, SIGGRAPH 2005.

[16]  Dewei Qi,et al.  Lattice-Boltzmann simulations of particles in non-zero-Reynolds-number flows , 1999, Journal of Fluid Mechanics.

[17]  Ulrich Rüde,et al.  Performance Evaluation of Parallel Large-Scale Lattice Boltzmann Applications on Three Supercomputing Architectures , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[18]  Michael Griebel,et al.  Numerical Simulation in Molecular Dynamics: Numerics, Algorithms, Parallelization, Applications , 2007 .

[19]  Ulrich Rüde,et al.  Parallel Lattice Boltzmann Methods for CFD Applications , 2006 .

[20]  J. Boon.  The Lattice Boltzmann Equation for Fluid Dynamics and Beyond , 2003 .

[21]  Samuel Williams,et al.  Lattice Boltzmann simulation optimization on leading multicore platforms , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[22]  Ulrich Rüde,et al.  Optimising a 3D multigrid algorithm for the IA-64 architecture , 2008, Int. J. Comput. Sci. Eng..

[23]  Matthias Müller,et al.  Interacting Particle-Liquid Systems , 1999 .

[24]  I. Millington.  Game physics engine development , 2007 .

[25]  H. Wengenroth.  Rigid Body Collisions , 2007 .

[26]  R. Brach.  Rigid Body Collisions , 1989 .

[27]  P. Bhatnagar,et al.  A Model for Collision Processes in Gases. I. Small Amplitude Processes in Charged and Neutral One-Component Systems , 1954 .

[28]  Shiyi Chen,et al.  LATTICE BOLTZMANN METHOD FOR FLUID FLOWS , 2001 .

[29]  Wei Shyy,et al.  Lattice Boltzmann Method for 3-D Flows with Curved Boundary , 2000 .

[30]  C. Aidun,et al.  Direct analysis of particulate suspensions with inertia using the discrete Boltzmann equation , 1998, Journal of Fluid Mechanics.

[31]  Ulrich Rüde,et al.  Massively parallel rigid body dynamics simulations , 2009, Computer Science - Research and Development.

[32]  Ulrich Rüde,et al.  Optimization and Profiling of the Cache Performance of Parallel Lattice Boltzmann Codes in 2 D and 3 D ∗ , 2003 .

[33]  Y. Qian,et al.  Lattice BGK Models for Navier-Stokes Equation , 1992 .

[34]  Ulrich Rüde,et al.  Performance comparison of different parallel lattice Boltzmann implementations on multi-core multi-socket systems , 2008, Int. J. Comput. Sci. Eng..

[35]  Y Ishida,et al.  Impact And Friction Of Solids, Structures And Intelligent Machines: In Memoriam of P D Panagiotopoulos (1950–1998) , 2000 .

[36]  Ulrich Rüde,et al.  Fluid flow simulation on the Cell Broadband Engine using the lattice Boltzmann method , 2009, Comput. Math. Appl..

[37]  Ulrich Rüde,et al.  Simulation of the hydrodynamic drag of aggregated particles. , 2006, Journal of colloid and interface science.

[38]  Ulrich Rüde,et al.  Simulation of moving particles in 3D with the Lattice Boltzmann method , 2008, Comput. Math. Appl..

[39]  John F. Brady,et al.  STOKESIAN DYNAMICS , 2006 .