Parallel algorithms for Sn transport sweeps on unstructured meshes

The Boltzmann Transport Equation is solved on unstructured meshes using the Discrete Ordinates Method. The flux for each ordinate is swept across the computational grid, within a source iteration loop that accounts for the coupling between the different ordinates. In this paper, a spatial domain decomposition strategy is used to divide the work among the available CPUs. The sequential nature of the sweep process makes the parallelization of the overall algorithm the most challenging aspect. Several parallel sweep algorithms, which represent different options of interleaving communications and calculations in the solution process, are analysed. The option of grouping messages by means of buffering is also considered. One of the heuristics proposed consistently stands out as the best option in all the situations analyzed, which include different geometries and different sizes of the ordinate set. With this algorithm, good scalability results have been achieved regarding both weak and strong speedup tests with up to 2560 CPUs.

[1]  Y. Y. Azmy Arbitrarily High Order Transport Method of the Characteristic Type for Tetrahedral Grids , 2001 .

[2]  Prediction of radiative transfer in general body-fitted coordinates , 1997 .

[3]  Shawn D. Pautz,et al.  An Algorithm for Parallel Sn Sweeps on Unstructured Meshes , 2001 .

[4]  Eric E. Aubanel,et al.  Parallelization of radiation transport on unstructured triangular grids with spatial decomposition a , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[5]  William F. Godoy,et al.  Introduction of Parallel GPGPU Acceleration Algorithms for the Solution of Radiative Transfer , 2011 .

[6]  G. D. Raithby,et al.  A Finite-Volume Method for Predicting a Radiant Heat Transfer in Enclosures With Participating Media , 1990 .

[7]  Lawrence Rauchwerger,et al.  Parallel Sn Sweeps on Unstructured Grids: Algorithms for Prioritization, Grid Partitioning, and Cycle Detection , 2005 .

[8]  R. Baker,et al.  An Sn algorithm for the massively parallel CM-200 computer , 1998 .

[9]  M. Modest Radiative heat transfer , 1993 .

[10]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[11]  Adolfy Hoisie,et al.  Performance and Scalability Analysis of Teraflop-Scale Parallel Architectures Using Multidimensional Wavefront Applications , 2000, Int. J. High Perform. Comput. Appl..

[12]  Christon,et al.  Spatial domain-based parallelism in large-scale, participating-media, radiative transport applications , 1997 .

[13]  Guillem Colomer Rey,et al.  Numerical methods for radiative heat transfer , 2006 .

[14]  William F. Godoy,et al.  On the use of flux limiters in the discrete ordinates method for 3D radiation calculations in absorbing and scattering media , 2010, J. Comput. Phys..

[15]  Yousry Y. Azmy,et al.  Comparison via parallel performance models of angular and spatial domain decompositions for solving neutral particle transport problems , 2007 .

[16]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[17]  Mark D. Hill,et al.  Amdahl's Law in the Multicore Era , 2008 .

[18]  Yen-Sen Chen,et al.  Development of an unstructured radiation model applicable for two-dimensional planar, axisymmetric, and three-dimensional geometries , 1999 .

[19]  Haowei Huang,et al.  GPU accelerated simulations of 3D deterministic particle transport using discrete ordinates method , 2011, J. Comput. Phys..

[20]  Darren J. Kerbyson,et al.  A General Performance Model of Structured and Unstructured Mesh Particle Transport Computations , 2005, The Journal of Supercomputing.

[21]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[22]  K. D. Lathrop,et al.  DISCRETE ORDINATES ANGULAR QUADRATURE OF THE NEUTRON TRANSPORT EQUATION , 1964 .

[23]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[24]  Li-Ming Ruan,et al.  Finite element method for radiative heat transfer in absorbing and anisotropic scattering media , 2005 .

[25]  Robert D. Falgout,et al.  Analysis of Massively Parallel Discrete-Ordinates Transport Sweep Algorithms with Collisions , 2008 .

[26]  K. M. Case,et al.  Existence and Uniqueness Theorems for the Neutron Transport Equation , 1963 .

[27]  S. R. Mathur,et al.  Finite Volume Method for Radiative Heat Transfer Using Unstructured Meshes , 1998 .

[28]  W. Fiveland Discrete-Ordinates Solutions of the Radiative Transport Equation for Rectangular Enclosures , 1984 .

[29]  P. J. Coelho,et al.  Parallelization of the finite volume method for radiation heat transfer , 1999 .

[30]  Coupling heat conduction and radiative transfer , 2002 .

[31]  Aravind Srinivasan,et al.  Provable algorithms for parallel generalized sweep scheduling , 2006, J. Parallel Distributed Comput..

[32]  Eric E. Aubanel,et al.  Parallelization of the three-dimensional transport equation for Boron Neutron Capture Therapy , 2003, Proceedings International Parallel and Distributed Processing Symposium.