Nektar++: Design and implementation of an implicit, spectral/hp element, compressible flow solver using a Jacobian-free Newton Krylov approach

Abstract At high Reynolds numbers the use of explicit in time compressible flow simulations with spectral/ h p element discretization can become significantly limited by time step. To alleviate this limitation we extend the capability of the spectral/ h p element open-source software framework, Nektar++, to include an implicit discontinuous Galerkin compressible flow solver. The integration in time is carried out by a singly diagonally implicit Runge–Kutta method. The non-linear system arising from the implicit time integration is iteratively solved by the Jacobian-free Newton Krylov (JFNK) method. A favorable feature of the JFNK approach is its extensive use of the explicit operators available from the previous explicit in time implementation. The functionalities of different building blocks of the implicit solver are analyzed from the point of view of software design and placed in appropriate hierarchical levels in the C++ libraries. In the detailed implementation, the contributions of different parts of the solver to computational cost, memory consumption and programming complexity are also analyzed. A combination of analytical and numerical methods is adopted to simplify the programming complexity in forming the preconditioning matrix. The solver is verified and tested using cases such as manufactured compressible Poiseuille flow, Taylor–Green vortex, turbulent flow over a circular cylinder at Re = 3900 and shock wave boundary-layer interaction. The results show that the implicit solver can speed-up the simulations while maintaining good simulation accuracy.

[1]  Christopher J. Roy,et al.  Review of code and solution verification procedures for computational simulation , 2005 .

[2]  Vincent Mousseau,et al.  A reconstructed discontinuous Galerkin method for the compressible Navier-Stokes equations on arbitrary grids , 2010, J. Comput. Phys..

[3]  Per-Olof Persson,et al.  Approximate tensor-product preconditioners for very high order discontinuous Galerkin methods , 2017, J. Comput. Phys..

[4]  Hester Bijl,et al.  Implicit Time Integration Schemes for the Unsteady Compressible Navier–Stokes Equations: Laminar Flow , 2002 .

[5]  Spencer J. Sherwin,et al.  A generic framework for time-stepping partial differential equations (PDEs): general linear methods, object-oriented implementation and application to fluid problems , 2011 .

[6]  E. Toro Riemann Solvers and Numerical Methods for Fluid Dynamics , 1997 .

[7]  Todd A. Oliver Multigrid Solution for High-Order Discontinuous Galerkin Discretizations of the Compressible Navier-Stokes Equations , 2004 .

[8]  Wim Desmet,et al.  Optimal Runge-Kutta schemes for discontinuous Galerkin space discretizations applied to wave propagation problems , 2012, J. Comput. Phys..

[9]  Francesco Capuano,et al.  Comparative study of spectral-element and finite-volume solvers for direct numerical simulation of synthetic jets , 2019, Computers & Fluids.

[10]  E. Lamballais,et al.  Experimental and numerical studies of the flow over a circular cylinder at Reynolds number 3900 , 2008 .

[11]  Spencer J. Sherwin,et al.  On the Connections Between Discontinuous Galerkin and Flux Reconstruction Schemes: Extension to Curvilinear Meshes , 2016, J. Sci. Comput..

[12]  D. Keyes,et al.  Jacobian-free Newton-Krylov methods: a survey of approaches and applications , 2004 .

[13]  Laslo T. Diosady,et al.  Scalable tensor-product preconditioners for high-order finite-element methods: Scalar equations , 2019, J. Comput. Phys..

[14]  H. Deniau,et al.  3D Steady and Unsteady Bifurcations in a Shock-wave/Laminar Boundary Layer Interaction: A Numerical Study , 2006 .

[15]  A. Nigro,et al.  On the efficiency of a matrix-free linearly implicit time integration strategy for high-order Discontinuous Galerkin solutions of incompressible turbulent flows , 2017 .

[16]  J. Peraire,et al.  Sub-Cell Shock Capturing for Discontinuous Galerkin Methods , 2006 .

[17]  Per-Olof Persson,et al.  The Compact Discontinuous Galerkin (CDG) Method for Elliptic Problems , 2007, SIAM J. Sci. Comput..

[18]  Robert Michael Kirby,et al.  Nektar++: An open-source spectral/hp element framework , 2015, Comput. Phys. Commun..

[19]  Alper Ezertas,et al.  Performances of Numerical and Analytical Jacobians in Flow and Sensitivity Analysis , 2009 .

[20]  Robert Michael Kirby,et al.  Nektar++: enhancing the capability and application of high-fidelity spectral/hp element methods , 2019, Comput. Phys. Commun..

[21]  David L. Darmofal,et al.  p-Multigrid solution of high-order discontinuous Galerkin discretizations of the compressible Navier-Stokes equations , 2005 .

[22]  Ralf Hartmann,et al.  An optimal order interior penalty discontinuous Galerkin discretization of the compressible Navier-Stokes equations , 2008, J. Comput. Phys..

[23]  Sangsan Lee,et al.  Large eddy simulation of shock turbulence interaction , 1993 .

[24]  G. Karniadakis,et al.  Spectral/hp Element Methods for Computational Fluid Dynamics , 2005 .

[25]  S. Sherwin,et al.  From h to p efficiently: Strategy selection for operator evaluation on hexahedral and tetrahedral elements , 2011 .

[26]  Andrea Lani,et al.  Implicit high-order flux reconstruction solver for high-speed compressible flows , 2018, Comput. Phys. Commun..

[27]  R. Hartmann,et al.  Symmetric Interior Penalty DG Methods for the CompressibleNavier-Stokes Equations I: Method Formulation , 2005 .

[28]  J. Hesthaven,et al.  Nodal Discontinuous Galerkin Methods: Algorithms, Analysis, and Applications , 2007 .

[29]  Matthew G. Knepley,et al.  Composing Scalable Nonlinear Algebraic Solvers , 2015, SIAM Rev..

[30]  Paul D. Orkwis,et al.  Comparison of numerical and analytical Jacobians , 1996 .

[31]  Koen Hillewaert,et al.  Development of the discontinuous Galerkin method for high-resolution, large scale CFD and acoustics in industrial geometries , 2013 .

[32]  P. Moin,et al.  Numerical studies of flow over a circular cylinder at ReD=3900 , 2000 .

[33]  Douglas N. Arnold,et al.  Unified Analysis of Discontinuous Galerkin Methods for Elliptic Problems , 2001, SIAM J. Numer. Anal..

[34]  Koen Hillewaert,et al.  Assessment of a discontinuous Galerkin method for the simulation of vortical flows at high Reynolds number , 2014 .

[35]  Christopher A. Kennedy,et al.  Diagonally Implicit Runge-Kutta Methods for Ordinary Differential Equations. A Review , 2016 .

[36]  Hong Luo,et al.  Robust Implicit Direct Discontinuous Galerkin Method for Simulating the Compressible Turbulent Flows , 2019 .

[37]  R. J. Wilson,et al.  Spectral / hp Element Methods for Computational Fluid Dynamics Second , 2005 .

[38]  Gianmarco Mengaldo,et al.  Discontinuous spectral/hp element methods: development, analysis and applications to compressible flows , 2015 .

[39]  Xiaodong Liu,et al.  A direct discontinuous Galerkin method for the compressible Navier-Stokes equations on arbitrary grids , 2016, J. Comput. Phys..

[40]  Steffen Müthing,et al.  Matrix-free multigrid block-preconditioners for higher order Discontinuous Galerkin discretisations , 2018, J. Comput. Phys..

[41]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[42]  Chi-Wang Shu,et al.  The Local Discontinuous Galerkin Method for Time-Dependent Convection-Diffusion Systems , 1998 .

[43]  Spencer J. Sherwin,et al.  A comparative study on polynomial dealiasing and split form discontinuous Galerkin schemes for under-resolved turbulence computations , 2017, J. Comput. Phys..

[44]  John W. Peterson,et al.  Overview of the incompressible Navier-Stokes simulation capabilities in the MOOSE framework , 2017, Adv. Eng. Softw..

[45]  F. White Viscous Fluid Flow , 1974 .

[46]  V. V. Chudanov,et al.  Validation of a New Method for Solving of CFD Problems in Nuclear Engineering Using Petascale HPC , 2014 .

[47]  Samuel Williams,et al.  Roofline: an insightful visual performance model for multicore architectures , 2009, CACM.

[48]  S. Orszag Spectral methods for problems in complex geometries , 1980 .