Toward Exascale: Overview of Large Eddy Simulations and Direct Numerical Simulations of Nuclear Reactor Flows with the Spectral Element Method in Nek5000

Abstract At the beginning of the last decade, Petascale supercomputers (i.e., computers capable of more than 1 petaFLOP) emerged. Now, at the dawn of exascale supercomputing, we provide a review of recent landmark simulations of portions of reactor components with turbulence-resolving techniques that this computational power has made possible. In fact, these simulations have provided invaluable insight into flow dynamics, which is difficult or often impossible to obtain with experiments alone. We focus on simulations performed with the spectral element method, as this method has emerged as a powerful tool to deliver massively parallel calculations at high fidelity by using large eddy simulation or direct numerical simulation. We also limit this paper to constant-property incompressible flow of a Newtonian fluid in the absence of other body or external forces, although the method is by no means limited to this class of flows. We briefly review the fundamentals of the method and the reasons it is compelling for the simulation of nuclear engineering flows. We review in detail a series of Petascale simulations, including the simulations of helical coil steam generators, fuel assemblies, and pebble beds. Even with Petascale computing, however, limitations for nuclear modeling and simulation tools remain. In particular, the size and scope of turbulence-resolving simulations are still limited by computing power and resolution requirements, which scale with the Reynolds number. In the final part of this paper, we discuss the future of the field, including recent advancements in emerging architectures such as GPU-based supercomputers, which are expected to power the next generation of high-performance computers.

[1]  I. Tiselj,et al.  Direct Numerical Simulation and Wall-Resolved Large Eddy Simulation in Nuclear Thermal Hydraulics , 2019, Nuclear Technology.

[2]  Leonhard Kleiser,et al.  High-pass filtered eddy-viscosity models for large-eddy simulations of transitional and turbulent flow , 2005 .

[3]  Haomin Yuan,et al.  Spectral element applications in complex nuclear reactor geometries: Tet-to-hex meshing , 2020 .

[4]  K. Jansen,et al.  Interface Tracking Investigation of Geometric Effects on the Bubbly Flow in PWR Subchannels , 2018, Nuclear Science and Engineering.

[5]  A. Patera A spectral element method for fluid dynamics: Laminar flow in a channel expansion , 1984 .

[6]  John M. Levesque,et al.  An MPI/OpenACC implementation of a high-order electromagnetics solver with GPUDirect communication , 2016, Int. J. High Perform. Comput. Appl..

[7]  D. Chang,et al.  Numerical simulation of turbulent flow in a 37-rod bundle , 2007 .

[8]  P. Fischer,et al.  A novel numerical treatment of the near-wall regions in the k−ω class of RANS models , 2018 .

[9]  Jan Vierendeels,et al.  Benchmark exercise for fluid flow simulations in a liquid metal fast reactor fuel assembly , 2016 .

[10]  E. Merzari,et al.  Flow-induced vibration analysis of a helical coil steam generator experiment using large eddy simulation , 2017 .

[11]  Francesco Capuano,et al.  Comparative study of spectral-element and finite-volume solvers for direct numerical simulation of synthetic jets , 2019, Computers & Fluids.

[12]  Elia Merzari,et al.  Accurate prediction of the wall shear stress in rod bundles with the spectral element method at high Reynolds numbers , 2014 .

[13]  E. Merzari,et al.  Large Eddy Simulation of the Flow Behavior in a Simplified Helical Coil Steam Generator , 2019 .

[14]  Ugo Piomelli,et al.  Large-eddy simulation: achievements and challenges , 1999 .

[15]  Paul F. Fischer,et al.  Scaling Limits for PDE-Based Simulation (Invited) , 2015 .

[16]  Remi Manceau,et al.  Recent progress in the development of the Elliptic Blending Reynolds-stress model , 2015 .

[17]  E. Merzari,et al.  Spectral and modal analysis of the flow in a helical coil steam generator experiment with large eddy simulation , 2019 .

[18]  P. Fischer,et al.  Jet stability and wall impingement flow field in a thermal striping experiment , 2017 .

[19]  E. Merzari,et al.  Invariant analysis of the Reynolds stress tensor for a nuclear fuel assembly with spacer grid and split type vanes , 2019, International Journal of Heat and Fluid Flow.

[20]  Michel Schanen,et al.  On the Strong Scaling of the Spectral Element Solver Nek5000 on Petascale Systems , 2016, EASC.

[21]  Elia Merzari,et al.  Numerical Simulation and Proper Orthogonal Decomposition of the Flow in a Counter-Flow T-Junction , 2013 .

[22]  E. Lamballais,et al.  On the Discontinuity of ε θ -the Dissipation Rate Associated with the Temperature Variance - at the Fluid-Solid Interface for Cases with Conjugate Heat Transfer , 2016 .

[23]  P. Fischer,et al.  Petascale algorithms for reactor hydrodynamics , 2008 .

[24]  E. Merzari,et al.  Direct Numerical Simulation of the Flow Through a Randomly Packed Pebble Bed , 2020 .

[25]  Emilio Baglietto,et al.  CFD methodology and validation for single-phase flow in PWR fuel assemblies , 2010 .

[26]  A. W. Vreman The filtering analog of the variational multiscale method in large-eddy simulation , 2003 .

[27]  Y. Hassan,et al.  Stereoscopic particle image velocimetry measurements of flow in a rod bundle with a spacer grid and mixing vanes at a low Reynolds number , 2017 .

[28]  E. Merzari,et al.  High-Fidelity Simulation of Flow-Induced Vibrations in Helical Steam Generators for Small Modular Reactors , 2018, Nuclear Technology.

[29]  Elia Merzari,et al.  Large-scale large eddy simulation of nuclear reactor flows: Issues and perspectives , 2017 .

[30]  G. Grötzbach,et al.  Direct numerical and large eddy simulations in nuclear applications , 1999 .

[31]  E. Merzari,et al.  Comparison of experimental and simulation results on interior subchannels of a 61-pin wire-wrapped hexagonal fuel bundle , 2018, Nuclear Engineering and Design.

[32]  Steven A. Orszag,et al.  Numerical Simulation of Low Mach Number Reactive Flows , 1997 .

[33]  Sofiane Benhamadouche On the use of (U)RANS and LES approaches for turbulent incompressible single phase flows in nuclear engineering applications , 2017 .