GPU accelerated flow solver for direct numerical simulation of turbulent flows

Graphical processing units (GPUs), characterized by significant computing performance, are nowadays very appealing for the solution of computationally demanding tasks in a wide variety of scientific applications. However, to run on GPUs, existing codes need to be ported and optimized, a procedure which is not yet standardized and may require non trivial efforts, even to high-performance computing specialists. In the present paper we accurately describe the porting to CUDA (Compute Unified Device Architecture) of a finite-difference compressible Navier-Stokes solver, suitable for direct numerical simulation (DNS) of turbulent flows. Porting and validation processes are illustrated in detail, with emphasis on computational strategies and techniques that can be applied to overcome typical bottlenecks arising from the porting of common computational fluid dynamics solvers. We demonstrate that a careful optimization work is crucial to get the highest performance from GPU accelerators. The results show that the overall speedup of one NVIDIA Tesla S2070 GPU is approximately 22 compared with one AMD Opteron 2352 Barcelona chip and 11 compared with one Intel Xeon X5650 Westmere core. The potential of GPU devices in the simulation of unsteady three-dimensional turbulent flows is proved by performing a DNS of a spatially evolving compressible mixing layer.

[1]  A. Roshko,et al.  The compressible turbulent shear layer: an experimental study , 1988, Journal of Fluid Mechanics.

[2]  D. W. Bogdanoff,et al.  Compressibility Effects in Turbulent Shear Layers , 1983 .

[3]  Robert D. Moser,et al.  Direct Simulation of a Self-Similar Turbulent Mixing Layer , 1994 .

[4]  Rainald Löhner,et al.  Semi‐automatic porting of a large‐scale Fortran CFD code to GPUs , 2012 .

[5]  Matteo Bernardini,et al.  Direct Numerical Simulation Database for Impinging Shock Wave/Turbulent Boundary-Layer Interaction , 2011 .

[6]  Graham Pullan,et al.  An Accelerated 3D Navier–Stokes Solver for Flows in Turbomachines , 2009 .

[7]  Konstantinos I. Karantasis,et al.  Acceleration of a Finite-Difference WENO Scheme for Large-Scale Simulations on Many-Core Architectures , 2010 .

[8]  Paulius Micikevicius,et al.  3D finite difference computation on GPUs using CUDA , 2009, GPGPU-2.

[9]  Sergio Pirozzoli,et al.  Generalized conservative approximations of split convective derivative operators , 2010, J. Comput. Phys..

[10]  T. Poinsot.  Boundary conditions for direct simulations of compressible viscous flows , 1992 .

[11]  Neil D. Sandham,et al.  Three-dimensional simulations of large eddies in the compressible mixing layer , 1991, Journal of Fluid Mechanics.

[12]  Naga K. Govindaraju,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007 .

[13]  Eric Darve,et al.  Large calculation of the flow over a hypersonic vehicle using a GPU , 2008, J. Comput. Phys..

[14]  Matteo Bernardini,et al.  Wall pressure fluctuations beneath supersonic turbulent boundary layers , 2011 .

[15]  A. Roshko,et al.  On density effects and large structure in turbulent mixing layers , 1974, Journal of Fluid Mechanics.

[16]  P. Moin,et al.  Turbulence statistics in fully developed channel flow at low Reynolds number , 1987, Journal of Fluid Mechanics.

[17]  Christopher A. Kennedy,et al.  Reduced aliasing formulations of the convective terms within the Navier-Stokes equations for a compressible fluid , 2008, J. Comput. Phys..

[18]  Matteo Bernardini,et al.  Characterization of coherent vortical structures in a supersonic turbulent boundary layer , 2008, Journal of Fluid Mechanics.

[19]  Inanc Senocak,et al.  An MPI-CUDA Implementation for Massively Parallel Incompressible Flow Computations on Multi-GPU Clusters , 2010 .

[20]  Shigeomi Chono,et al.  GPU-accelerated molecular dynamics simulation for study of liquid crystalline flows , 2010, J. Comput. Phys..

[21]  Massimo Bernaschi,et al.  A flexible high-performance Lattice Boltzmann GPU code for the simulations of fluid flows in complex geometries , 2010 .

[22]  P. Moin,et al.  DIRECT NUMERICAL SIMULATION: A Tool in Turbulence Research , 1998 .

[23]  U. Rist,et al.  DNS of a Plane Mixing Layer for the Investigation of Sound Generation Mechanisms , 2008 .

[24]  Haowei Huang,et al.  GPU accelerated simulations of 3D deterministic particle transport using discrete ordinates method , 2011, J. Comput. Phys..

[25]  S. Goebel,et al.  EXPERIMENTAL STUDY OF COMPRESSIBLE TURBULENT MIXING LAYERS , 1991 .

[26]  G. S. Patterson,et al.  Numerical Simulation of Three-Dimensional Homogeneous Isotropic Turbulence , 1972 .

[27]  Matteo Bernardini,et al.  Direct numerical simulation of transonic shock/boundary layer interaction under conditions of incipient separation , 2010, Journal of Fluid Mechanics.