Shared-memory, distributed-memory, and mixed-mode parallelisation of a CFD simulation code

This paper presents some different approaches to the parallelisation of a harmonic balance Navier-Stokes solver for unsteady aerodynamics. Such simulation codes can require very large amounts of computational resource for realistic simulations, and therefore can benefit significantly from parallelisation. The simulation code addressed in this paper can undertake different modes of aerodynamic simulation and includes both harmonic balance and time domain solvers. These different modes have performance characteristics which can affect any potential parallelisation, as can the specifics of the problem being simulated. Therefore, three different techniques have been used for the parallelisation, shared-memory, distributed-memory, and a combination of the two—a hybrid or mixed-mode parallelisation. These different techniques attempt to address the different performance requirements associated with the types of simulation the code can be used for and provide the level of computational resources required for significant simulation problems. We discuss the different parallelisations and the performance they exhibit on a range of computational resources.

[1]  Jeffrey P. Thomas,et al.  Computation of Unsteady Nonlinear Flows in Cascades Using a Harmonic Balance Technique , 2002 .

[2]  Paul Kutler,et al.  Fifteenth International Conference on Numerical Methods in Fluid Dynamics : proceedings of the conference, held in Monterey, CA, USA, 24-28 June 1996 , 1997 .

[3]  R. Tuminaro,et al.  A parallel block multi-level preconditioner for the 3D incompressible Navier--Stokes equations , 2003 .

[4]  Abdulnaser I. Sayma,et al.  Multibladerow Forced Response Modeling in Axial-Flow Core Compressors , 2007 .

[5]  G. Barakos,et al.  Sliding mesh algorithm for CFD analysis of helicopter rotor–fuselage aerodynamics , 2008 .

[6]  I. Lindblad,et al.  The engineering of multiblock/multigrid software for Navier-Stokes flows on structured meshes , 1993 .

[7]  Johan De Keyser,et al.  A Parallel Multiblock Euler/Navier-Stokes Solver on a Cluster of Workstations Using PVM , 1994, HPCN.

[8]  Dieter an Mey,et al.  Nested Parallelization of the Flow Solver TFS Using the ParaWise Parallelization Environment , 2006, IWOMP.

[9]  William Layton,et al.  A multilevel mesh independence principle for the Navier-Stokes equations , 1996 .

[10]  Nigel P. Topham,et al.  Performance of the decoupled ACRI-1 architecture: the perfect club , 1995, HPCN Europe.

[11]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[12]  M. Sergio Campobasso,et al.  Analysis of Unsteady Flows Past Horizontal Axis Wind Turbine Airfoils Based on Harmonic Balance Compressible Navier-Stokes Equations With Low-Speed Preconditioning , 2012 .

[13]  D. Golby,et al.  A parallel navier-stokes code for large industrial flow simulations , 1997 .