On improving the performance of large parallel lattice Boltzmann flow simulations in heterogeneous porous media

Classical Cartesian domain decompositions for parallel lattice Boltzmann simulations of fluid flow through heterogeneous porous media are doomed to workload imbalance as the number of processors increases, thus leading to decreasing parallel performance. A one-lattice lattice Boltzmann method (LBM) implementation with vector data structure combined with even fluid node partitioning domain decomposition and fully-optimized data transfer layout is presented. It is found to provide nearly-optimal workload balance, lower memory usage and better computational performance than classical slice decomposition techniques using sparse matrix data structures. Predictive memory usage and parallel performance models are also established and observed to be in very good agreement with data corresponding to numerical fluid flow simulations performed through 3-dimensional packings of cylinders and polydisperse spheres.

[1]  François Bertrand,et al.  Effect of particle size distribution and packing compression on fluid permeability as predicted by lattice-Boltzmann simulations , 2009, Comput. Chem. Eng..

[2]  Manfred Krafczyk,et al.  A parallelisation concept for a multi-physics lattice Boltzmann prototype based on hierarchical grids , 2008 .

[3]  Jan Westerholm,et al.  An efficient swap algorithm for the lattice Boltzmann method , 2007, Comput. Phys. Commun..

[4]  Peter M. A. Sloot,et al.  Lattice-Boltzmann hydrodynamics on parallel systems , 1998 .

[5]  Ulrich Rüde,et al.  Optimization and Profiling of the Cache Performance of Parallel Lattice Boltzmann Codes in 2 D and 3 D ∗ , 2003 .

[6]  Tuomo Rossi,et al.  Comparison of implementations of the lattice-Boltzmann method , 2008, Comput. Math. Appl..

[7]  Bastien Chopard,et al.  An object oriented approach to lattice gas modeling , 2000, Future Gener. Comput. Syst..

[8]  Cass T. Miller,et al.  A high-performance lattice Boltzmann implementation to model flow in porous media , 2003 .

[9]  Cass T. Miller,et al.  An evaluation of lattice Boltzmann schemes for porous medium flow simulation , 2006 .

[10]  Xiaoxian Zhang,et al.  Domain-decomposition method for parallel lattice Boltzmann simulation of incompressible flow in porous media. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  C. P. Lowe,et al.  Efficiently using memory in lattice Boltzmann simulations , 2004, Future Gener. Comput. Syst..

[12]  Thomas Zeiser,et al.  Performance evaluation of a parallel sparse lattice Boltzmann solver , 2008, J. Comput. Phys..

[13]  Nobuyuki Satofuka,et al.  Parallelization of lattice Boltzmann method for incompressible flow computations , 1999 .

[14]  John G. Hagedorn,et al.  Multiscale modeling of fluid transport in heterogeneous materials using discrete Boltzmann methods , 2002 .

[15]  Gerhard Wellein,et al.  On the single processor performance of simple lattice Boltzmann kernels , 2006 .

[16]  Hans-Joachim Bungartz,et al.  High Performance Scientific And Engineering Computing , 1999 .

[17]  J. Boon.  The Lattice Boltzmann Equation for Fluid Dynamics and Beyond , 2003 .

[18]  Theo G. Theofanous,et al.  The lattice Boltzmann equation method: theoretical interpretation, numerics and implications , 2003 .

[19]  P. Bhatnagar,et al.  A Model for Collision Processes in Gases. I. Small Amplitude Processes in Charged and Neutral One-Component Systems , 1954 .

[20]  Nicos Martys,et al.  Transport in sandstone: A study based on three dimensional microtomography , 1996 .

[21]  Ernst Rank,et al.  Parallelization Strategies and Efficiency of CFD Computations in Complex Geometries Using Lattice Boltzmann Methods on High-Performance Computers , 2002 .