Accelerating Radiation Computations for Dynamical Models With Targeted Machine Learning and Code Optimization

Atmospheric radiation is the main driver of weather and climate, yet due to a complicated absorption spectrum, the precise treatment of radiative transfer in numerical weather and climate models is computationally unfeasible. Radiation parameterizations need to maximize computational efficiency as well as accuracy, and for predicting the future climate many greenhouse gases need to be included. In this work, neural networks (NNs) were developed to replace the gas optics computations in a modern radiation scheme (RTE+RRTMGP) by using carefully constructed models and training data. The NNs, implemented in Fortran and utilizing BLAS for batched inference, are faster by a factor of 1–6, depending on the software and hardware platforms. We combined the accelerated gas optics with a refactored radiative transfer solver, resulting in clear‐sky longwave (shortwave) fluxes being 3.5 (1.8) faster to compute on an Intel platform. The accuracy, evaluated with benchmark line‐by‐line computations across a large range of atmospheric conditions, is very similar to the original scheme with errors in heating rates and top‐of‐atmosphere radiative forcings typically below 0.1 K day−1 and 0.5 W m−2, respectively. These results show that targeted machine learning, code restructuring techniques, and the use of numerical libraries can yield material gains in efficiency while retaining accuracy.

[1]  Damian Podareanu,et al.  Predicting atmospheric optical properties for radiative transfer computations using neural networks , 2020, Philosophical Transactions of the Royal Society A.

[2]  Thomas Slawig,et al.  Single precision arithmetic in ECHAM radiation reduces runtime and energy consumption , 2020 .

[3]  Robin J. Hogan,et al.  Evaluating and improving the treatment of gases in radiation schemes: the Correlated K-Distribution Model Intercomparison Project (CKDMIP) , 2020, Geoscientific Model Development.

[4]  Xiao Lu,et al.  WRF-GC: online coupling of WRF and GEOS-Chem for regional atmospheric chemistry modeling, Part 1: description of the one-way model (v1.0) , 2020 .

[5]  S. Buehler,et al.  Benchmark Calculations of Radiative Forcing by Greenhouse Gases , 2020, Journal of Geophysical Research: Atmospheres.

[6]  D. Bader,et al.  Initial Results From the Super‐Parameterized E3SM , 2020, Journal of Advances in Modeling Earth Systems.

[7]  Vladimir M. Krasnopolsky,et al.  Leveraging Modern Artificial Intelligence for Remote Sensing and NWP: Benefits and Challenges , 2019, Bulletin of the American Meteorological Society.

[8]  Matthew R. Norman,et al.  Using Deep Neural Networks as Cost‐Effective Surrogate Models for Super‐Parameterized E3SM Radiative Transfer , 2019, Geophysical Research Letters.

[9]  Antti Mäkelä,et al.  Evaluation of Machine Learning Classifiers for Predicting Deep Convection , 2019, Journal of Advances in Modeling Earth Systems.

[10]  Robert Pincus,et al.  Balancing Accuracy, Efficiency, and Flexibility in Radiation Calculations for Dynamical Models , 2019, Journal of advances in modeling earth systems.

[11]  Alexander J. Winkler,et al.  Developments in the MPI‐M Earth System Model version 1.2 (MPI‐ESM1.2) and Its Response to Increasing CO2 , 2019, Journal of advances in modeling earth systems.

[12]  Milan Curcic,et al.  A parallel Fortran framework for neural networks and deep learning , 2019, FORF.

[13]  Henk Eskes,et al.  The CAMS reanalysis of atmospheric composition , 2018, Atmospheric Chemistry and Physics.

[14]  Robin J. Hogan,et al.  A Flexible and Efficient Radiation Scheme for the ECMWF Model , 2018, Journal of Advances in Modeling Earth Systems.

[15]  Noah D. Brenowitz,et al.  Prognostic Validation of a Neural Network Unified Physics Parameterization , 2018, Geophysical Research Letters.

[16]  Pierre Gentine,et al.  Could Machine Learning Break the Convection Parameterization Deadlock? , 2018, Geophysical Research Letters.

[17]  T. Shepherd,et al.  Report on Stratosphere Task Force , 2018 .

[18]  Pierre Gentine,et al.  Deep learning to represent subgrid processes in climate models , 2018, Proceedings of the National Academy of Sciences.

[19]  Clifford F. Mass,et al.  Smartphone Pressure Collection and Bias Correction Using Machine Learning , 2018 .

[20]  Oliver Fuhrer,et al.  Using OpenACC to port large legacy climate and weather modeling code to GPUs , 2017 .

[21]  Elizabeth R. Jessup,et al.  Optimizing Weather Model Radiative Transfer Physics for Intel's Many Integrated Core (MIC) Architecture , 2016, Parallel Process. Lett..

[22]  Robert Pincus,et al.  The Radiative Forcing Model Intercomparison Project (RFMIP): Experimental Protocol for CMIP6 , 2016 .

[23]  Chris Eliasmith,et al.  Hyperopt: a Python library for model selection and hyperparameter optimization , 2015 .

[24]  R. V. D. Geijn,et al.  BLIS: A Framework for Rapidly Instantiating BLAS Functionality , 2015, ACM Transactions on Mathematical Software.

[25]  Vladimir M. Krasnopolsky,et al.  The Application of Neural Networks in the Earth System Sciences: Neural Networks Emulations for Complex Multidimensional Mappings , 2013 .

[26]  R. Hogan The full-spectrum correlated-k method for longwave atmospheric radiative transfer using an effective Planck function , 2010 .

[27]  Stephen J. Lord,et al.  Accurate and Fast Neural Network Emulations of Model Radiation for the NCEP Coupled Climate Forecast System: Climate Simulations and Seasonal Predictions* , 2010 .

[28]  W. Collins,et al.  Radiative forcing by long‐lived greenhouse gases: Calculations with the AER radiative transfer models , 2008 .

[29]  J. Harrington,et al.  A Simulation of a Supercell Thunderstorm with Emulated Radiative Cooling beneath the Anvil , 2005 .

[30]  Shepard A. Clough,et al.  Atmospheric radiative transfer modeling: a summary of the AER codes , 2005 .

[31]  U. C. Mohanty,et al.  A Study on the Impact of Parameterization of Physical Processes on Prediction of Tropical Cyclones over the Bay of Bengal With NCAR/PSU Mesoscale Model , 2004 .

[32]  Darren L. Jackson,et al.  Radiance and Jacobian Intercomparison of Radiative Transfer Models Applied to HIRS and AMSU Channels , 2001 .

[33]  W. J. Whiten,et al.  Computational investigations of low-discrepancy sequences , 1997, TOMS.

[34]  Q. Fu,et al.  On the correlated k-distribution method for radiative transfer in nonhomogeneous atmospheres , 1992 .

[35]  R. West,et al.  THE CORRELATED-k METHOD FOR RADIATION CALCULATIONS IN NONHOMOGENEOUS ATMOSPHERES , 1989 .