Computational Performance of a Parallelized Three-Dimensional High-Order Spectral Element Toolbox

In this paper, a comprehensive performance review of an MPI-based high-order three-dimensional spectral element method C++ toolbox is presented. The focus is put on the performance evaluation of several aspects with a particular emphasis on the parallel efficiency. The performance evaluation is analyzed with help of a time prediction model based on a parameterization of the application and the hardware resources. A tailor-made CFD computation benchmark case is introduced and used to carry out this review, stressing the particular interest for clusters with up to 8192 cores. Some problems in the parallel implementation have been detected and corrected. The theoretical complexities with respect to the number of elements, to the polynomial degree, and to communication needs are correctly reproduced. It is concluded that this type of code has a nearly perfect speed up on machines with thousands of cores, and is ready to make the step to next-generation petaflop machines.

[1]  Roland Bouffanais,et al.  Solution of moving-boundary problems by the spectral element method , 2007, ArXiv.

[2]  P. Fischer,et al.  Parallel spectral element solution of the Stokes problem , 1991 .

[3]  George E. Karniadakis,et al.  A new domain decomposition method with overlapping patches for ultrascale simulations: Application to biological flows , 2010, J. Comput. Phys..

[4]  Joel Ferziger,et al.  Higher Order Methods for Incompressible Fluid Flow: by Deville, Fischer and Mund, Cambridge University Press, 499 pp. , 2003 .

[5]  Ibm Blue,et al.  Overview of the IBM Blue Gene/P Project , 2008, IBM J. Res. Dev..

[6]  M. Deville,et al.  Spectral-element preconditioners for the uzawa pressure operator applied to incompressible flows , 1994 .

[7]  P. Fischer,et al.  Petascale algorithms for reactor hydrodynamics , 2008 .

[8]  Roland Bouffanais,et al.  Computational performance of a parallelized three-dimensional high-order spectral element toolbox , 2011 .

[9]  R. Bouffanais N. Fiétier J. Latt M. Deville.  High Performance Computing with Spectral Element Methods , 2008 .

[10]  R. Puragliesi,et al.  Numerical investigation of particle-laden thermally driven turbulent flows in enclosure , 2010 .

[11]  P. Fischer,et al.  High-Order Methods for Incompressible Fluid Flow , 2002 .

[12]  Yvon Maday,et al.  Optimal error analysis of spectral methods with emphasis on non-constant coefficients and deformed geometries , 1990 .

[13]  Michel O. Deville,et al.  An Object-Oriented Toolbox for Spectral Element Analysis , 1999, J. Sci. Comput..

[14]  Roland Bouffanais,et al.  Large-eddy simulation of the flow in a lid-driven cubical cavity , 2007, 0709.0222.

[15]  M. Carbonaro,et al.  von Karman Institute for Fluid Dynamics , 2004 .