Scalability studies and large grid computations for surface combatant using CFDShip-Iowa

Scalability studies and computations using the largest grids to date for free-surface flows are performed using message-passing interface (MPI)-based CFDShip-Iowa toolbox curvilinear (V4) and Cartesian (V6) grid solvers on Navy high-performance computing systems. Both solvers show good strong scalability up to 2048 processors, with V6 showing somewhat better performance than V4. V6 also outperforms V4 in terms of the memory requirements and central processing unit (CPU) time per time-step per grid point. The explicit solvers show better scalability than the implicit solvers, but the latter allows larger time-step sizes, resulting in a lower total CPU time. The multi-grid HYPRE solver shows better scalability than the portable, extensible toolkit for scientific computation solver. The main scalability bottleneck is identified to be the pressure Poisson solver. The memory bandwidth test suggests that further scalability improvements could be obtained by using hybrid MPI/open multi-processing (OpenMP) parallelization. V4-detached eddy simulation (DES) on a 300 M grid for the surface combatant model DTMB 5415 in the straight-ahead condition provides a plausible description of the vortical structures and mean flow patterns observed in the experiments. However, the vortex strengths are over predicted and the turbulence is not resolved. V4-DESs on up to 250 M grids for DTMB 5415 at 20° static drift angle significantly improve the forces and moment predictions compared to the coarse grid unsteady Reynolds averaged Navier–Stokes, due to the improved resolved turbulence predictions. The simulations provide detailed resolution of the free-surface and breaking pattern and vortical and turbulent structures, which will guide planned experiments. V6 simulations on up to 276 M grids for DTMB 5415 in the straight-ahead condition predict diffused vortical structures due to poor wall-layer predictions. This could be due to the limitations of the wall-function implementation for the immersed boundary method.

[1]  Barry Smith,et al.  Large-scale DES computations of the forward speed diffraction and pitch and heave problems for a surface combatant , 2010 .

[2]  Frederick Stern,et al.  Model-and Full-Scale URANS Simulations of Athena Resistance, Powering, Seakeeping, and 5415 Maneuvering , 2009 .

[3]  Onkar Sahni,et al.  Scalable implicit finite element solver for massively parallel processing with demonstration to 160K cores , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[4]  Frederick Stern,et al.  Sharp interface immersed-boundary/level-set method for wave-body interactions , 2009, J. Comput. Phys..

[5]  Frederick Stern,et al.  Evaluation of linear and nonlinear convection schemes on multidimensional non‐orthogonal grids with applications to KVLCC2 tanker , 2009 .

[6]  Frederick Stern,et al.  An improved particle correction procedure for the particle level set method , 2009, J. Comput. Phys..

[7]  David W. Walker,et al.  Hybrid Message-Passing and Shared-Memory Programming in a Molecular Dynamics Application On Multicore Clusters , 2009, Int. J. High Perform. Comput. Appl..

[8]  F. Stern,et al.  A coupled level set and volume-of-fluid method for sharp interface simulation of plunging breaking waves , 2009 .

[9]  Inanc Senocak,et al.  CUDA Implementation of a Navier-Stokes Solver on Multi-GPU Desktop Platforms for Incompressible Flows , 2009 .

[10]  Juntao Huang,et al.  Semi‐coupled air/water immersed boundary approach for curvilinear dynamic overset grids with application to ship hydrodynamics , 2008 .

[11]  Frederick Stern,et al.  Computational Towing Tank Procedures for Single Run Curves of Resistance and Propulsion , 2008 .

[12]  Frederick Stern,et al.  FACTORS OF SAFETY FOR RICHARDSON EXTRAPOLATION FOR INDUSTRIAL APPLICATIONS , 2008 .

[13]  Frederick Stern,et al.  URANS analysis of a broaching event in irregular quartering seas , 2008 .

[14]  Gabriel Staffelbach,et al.  Large eddy simulations of turbulent reacting flows in real burners: the status and challenges , 2008 .

[15]  Subhash Saini,et al.  Performance comparison of SGI Altix 4700 and SGI Altix 3700 Bx2 , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[16]  Juntao Huang,et al.  Coupled ghost fluid/two‐phase level set method for curvilinear body‐fitted grids , 2007 .

[17]  Emilio F. Campana,et al.  Scars and Vortices Induced by Ship Bow and Shoulder Wave Breaking , 2007 .

[18]  F. Stern,et al.  Ship motions using single-phase level set with dynamic overset grids , 2007 .

[19]  F. Stern,et al.  Phase-Averaged PIV for the Nominal Wake of a Surface Ship in Regular Head Waves , 2007 .

[20]  Frederick Stern,et al.  An unsteady single‐phase level set method for viscous free surface flows , 2007 .

[21]  Roger C. Strawn,et al.  Prediction of HART II Rotor BVI Loading and Wake System Using CFD/CSD Loose Coupling , 2007 .

[22]  Ugo Piomelli,et al.  Interface Conditions for Hybrid RANS/LES Calculations , 2006 .

[23]  加藤 信介,et al.  41343 建築環境工学分野における剥離剪断層の乱流性状に関する研究 (その2) : 1開口換気に関する Detached-Eddy Simulation の適用(換気通風CFD, 環境工学II) , 2006 .

[24]  A. Bruaset,et al.  Numerical Solution of Partial Differential Equations on Parallel Computers (Lecture Notes in Computational Science and Engineering) , 2006 .

[25]  Ralph Noack,et al.  SUGGAR: A General Capability for Moving Body Overset Grid Assembly , 2005 .

[26]  G. Iaccarino,et al.  Near-wall behavior of RANS turbulence models and implications for wall functions , 2005 .

[27]  E. Sanmiguel-Rojas,et al.  On the efficiency of a numerical method with periodic time strides for solving incompressible flows , 2003 .

[28]  Gerhard Wellein,et al.  Communication and Optimization Aspects of Parallel Programming Models on Hybrid Architectures , 2003, Int. J. High Perform. Comput. Appl..

[29]  Frederick Stern,et al.  Towing Tank Experiments of Resistance, Sinkage and Trim, Boundary Layer, Wake, and Free Surface Flow Around a Naval Combatant Insean 2340 Model , 2001 .

[30]  Arne V. Johansson,et al.  An explicit algebraic Reynolds stress model for incompressible and compressible turbulent flows , 2000, Journal of Fluid Mechanics.

[31]  F. Menter.  Two-equation eddy-viscosity turbulence models for engineering applications , 1994 .

[32]  F. Stern,et al.  Motion Prediction Using Wall-Resolved and Wall-Modeled Approaches on a Cartesian Grid , 2010 .

[33]  F. Stern,et al.  Large Scale Parallel Computing and Scalability Study for Surface Combatant Static Maneuver and Straight Ahead Conditions Using CFDShip-Iowa , 2010 .

[34]  Daniel Livescu,et al.  Adapting the CFDNS Compressible Navier-Stokes Solver to the Roadrunner Hybrid Supercomputer , 2010 .

[35]  Frederick Stern,et al.  Urans and des simulations of static and dynamic maneuvering for surface combatant , 2009 .

[36]  H. Yoon.  Phase-averaged stereo-PIV flow field and force/moment/motion measurements for surface combatant in PMM maneuvers , 2009 .

[37]  Thomas H. Pulliam,et al.  Large Scale Aerodynamic Calculation on Pleiades , 2009 .

[38]  Jonathan Cohen,et al.  Title: A Fast Double Precision CFD Code using CUDA , 2009 .

[39]  P. Spalart.  Detached-Eddy Simulation , 2009 .

[40]  Frederick Stern,et al.  Large-Eddy Simulation of Ship Flows with Wall-Layer Models on Cartesian Grids , 2008 .

[41]  C. Fureby.  Large Eddy Simulation of Ship Hydrodynamics , 2008 .

[42]  Frederick Stern,et al.  Unsteady free-surface wave-induced separation: analysis of turbulent structures using detached eddy simulation and single-phase level set , 2007 .

[43]  J. Dongarra,et al.  The Impact of Multicore on Computational Science Software , 2007 .

[44]  T. Xing,et al.  BKW- RS-DES of Unsteady Vortical Flow for KVLCC2 at Large Drift Angles , 2007 .

[45]  Robert D. Falgout,et al.  The Design and Implementation of hypre, a Library of Parallel High Performance Preconditioners , 2006 .

[46]  Hyung Jin Sung,et al.  Large-eddy simulation of turbulent mixed convection in a vertical annulus with a rotating inner cylinder , 2006 .

[47]  Volker Bertram,et al.  A Workshop on Numerical Ship Hydrodynamics , 2000 .

[48]  A. Gosman,et al.  Solution of the implicitly discretised reacting flow equations by operator-splitting , 1986 .