3-D radiative transfer in large-eddy simulations – experiences coupling the TenStream solver to the UCLA-LES

Abstract. The recently developed 3-D TenStream radiative transfer solver was integrated into the University of California, Los Angeles large-eddy simulation (UCLA-LES) cloud-resolving model. This work documents the overall performance of the TenStream solver as well as the technical challenges of migrating from 1-D schemes to 3-D schemes. In particular the employed Monte Carlo spectral integration needed to be reexamined in conjunction with 3-D radiative transfer. Despite the fact that the spectral sampling has to be performed uniformly over the whole domain, we find that the Monte Carlo spectral integration remains valid. To understand the performance characteristics of the coupled TenStream solver, we conducted weak as well as strong-scaling experiments. In this context, we investigate two matrix preconditioner: geometric algebraic multigrid preconditioning (GAMG) and block Jacobi incomplete LU (ILU) factorization and find that algebraic multigrid preconditioning performs well for complex scenes and highly parallelized simulations. The TenStream solver is tested for up to 4096 cores and shows a parallel scaling efficiency of 80–90 % on various supercomputers. Compared to the widely employed 1-D delta-Eddington two-stream solver, the computational costs for the radiative transfer solver alone increases by a factor of 5–10.

[1]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[2]  The impact of model resolution on differences between independent column approximation and monte carlo estimates of shortwave surface irradiance and atmospheric heating rate , 2005 .

[3]  R. Hogan,et al.  Incorporating the Effects of 3D Radiative Transfer in the Presence of Clouds into Two-Stream Multilayer Radiation Schemes , 2013 .

[4]  Paul Markowski,et al.  An application of the tilted independent pixel approximation to cumulonimbus environments , 2009 .

[5]  B. Mayer,et al.  A three-dimensional parallel radiative transfer model for atmospheric heating rates for use in cloud resolving models—The TenStream solver , 2015 .

[6]  B. Mayer,et al.  The Neighboring Column Approximation (NCA) - A fast approach for the calculation of 3D thermal heating rates in cloud resolving models , 2016 .

[7]  E. Mlawer,et al.  Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave , 1997 .

[8]  Adrian M. Tompkins,et al.  Three‐dimensional radiative transfer in tropical deep convective clouds , 2003 .

[9]  C. Bretherton,et al.  Evaluation of Large-Eddy Simulations via Observations of Nocturnal Marine Stratocumulus , 2005 .

[10]  B. Stevens,et al.  Monte Carlo Spectral Integration: a Consistent Approximation for Radiative Transfer in Large Eddy Simulations , 2008 .

[11]  J. Joseph,et al.  The delta-Eddington approximation for radiative flux transfer , 1976 .

[12]  J. Harrington,et al.  Radiative influences on drop and cloud condensation nuclei equilibrium in stratocumulus , 2005 .

[13]  Matthew G. Knepley,et al.  PETSc Users Manual: Revision 3.11 , 2019 .

[14]  Q. Fu,et al.  On the correlated k-distribution method for radiative transfer in nonhomogeneous atmospheres , 1992 .

[15]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[16]  Sandrine Bony,et al.  What favors convective aggregation and why? , 2015 .

[17]  Meng Gao,et al.  The impacts of 3D radiative transfer effects on cloud radiative property simulations and retrievals , 2013 .

[18]  K. Evans.  The Spherical Harmonics Discrete Ordinate Method for Three-Dimensional Atmospheric Radiative Transfer , 1998 .

[19]  W. Cotton,et al.  Radiative impacts on the growth of a population of drops within simulated summertime Arctic stratus , 2000 .

[20]  B. Mayer,et al.  Cloud-shadow effects on the structure of the convective boundary layer , 2002 .

[21]  T. Ackerman,et al.  A simple formulation of the delta-four-stream approximation for radiative transfer parameterizations , 1988 .

[22]  B. Mayer,et al.  paNTICA: A Fast 3D Radiative Transfer Scheme to Calculate Surface Solar Irradiance for NWP and LES Models , 2013 .

[23]  B. Mayer.  Radiative transfer in the cloudy atmosphere , 2009 .

[24]  A. Tompkins,et al.  Generalizing Cloud Overlap Treatment to Include Solar Zenith Angle Effects on Cloud Geometry , 2007 .

[25]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[26]  Yousef Saad,et al.  A Flexible Inner-Outer Preconditioned GMRES Algorithm , 1993, SIAM J. Sci. Comput..