Neural network radiative transfer solvers for the generation of high resolution solar irradiance spectra parameterized by cloud and aerosol parameters

Abstract This paper reports on the development of a neural network (NN) model for instantaneous and accurate estimation of solar radiation spectra and budgets geared toward satellite cloud data using a ≈2.4 M record, high-spectral resolution look up table (LUT) generated with the radiative transfer model libRadtran. Two NN solvers, one for clear sky conditions dominated by aerosol and one for cloudy skies, were trained on a normally-distributed and multiparametric subset of the LUT that spans a very broad class of atmospheric and meteorological conditions as inputs with corresponding high resolution solar irradiance target spectra as outputs. The NN solvers were tested by feeding them with a large (10 K record) “off-grid” random subset of the LUT spanning the training data space, and then comparing simulated outputs with target values provided by the LUT. The NN solvers demonstrated a capability to interpolate accurately over the entire multiparametric space. Once trained, the NN solvers allow for high-speed estimation of solar radiation spectra with high spectral resolution (1 nm) and for a quantification of the effect of aerosol and cloud optical parameters on the solar radiation budget without the need for a massive database. The cloudy sky NN solver was applied to high spatial resolution (54 K pixel) cloud data extracted from the Spinning Enhanced Visible and Infrared Imager (SEVIRI) onboard the geostationary Meteosat Second Generation 3 (MSG3) satellite and demonstrated that coherent maps of spectrally-integrated global horizontal irradiance at this resolution can be produced on the order of 1 min.

[1]  C. Bretherton,et al.  Clouds and Aerosols , 2013 .

[2]  J. D. Tarpley,et al.  Surface radiation budgets in support of the GEWEX Continental‐Scale International Project (GCIP) and the GEWEX Americas Prediction Project (GAPP), including the North American Land Data Assimilation System (NLDAS) project , 2003 .

[3]  P. Koepke,et al.  Optical Properties of Aerosols and Clouds: The Software Package OPAC , 1998 .

[4]  I. Jolliffe Principal Component Analysis , 2002 .

[5]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[6]  R. Kahn,et al.  Earth's Climate Sensitivity: Apparent Inconsistencies in Recent Assessments , 2014 .

[7]  M. Ringer,et al.  Simulation of the Earth's radiation budget by the European Centre for Medium-Range Weather Forecasts 40-year reanalysis (ERA40) , 2004 .

[8]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[9]  Eli J. Mlawer,et al.  MODELING: The Continual Intercomparison of Radiation Codes (CIRC) , 2010 .

[10]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[11]  U. Lohmann,et al.  A study of internal and external mixing scenarios and its effect on aerosol optical properties and direct radiative forcing , 2002 .

[12]  Timothy Shippert,et al.  The Continual Intercomparison of Radiation Codes: Results from Phase I , 2012 .

[13]  E. Clothiaux,et al.  Global consequences of interactions between clouds and radiation at scales unresolved by global climate models , 2005 .

[14]  P. Ineichen Comparison of eight clear sky broadband models against 16 independent data banks , 2006 .

[15]  Bernhard Mayer,et al.  Atmospheric Chemistry and Physics Technical Note: the Libradtran Software Package for Radiative Transfer Calculations – Description and Examples of Use , 2022 .

[16]  Q. Fu,et al.  On the correlated k-distribution method for radiative transfer in nonhomogeneous atmospheres , 1992 .

[17]  L. J. Cox Optical Properties of the Atmosphere , 1979 .

[18]  R. Charlson,et al.  Trends in Observed Cloudiness and Earth's Radiation Budget: What Do We Not Know and What Do We Need to Know? , 2009 .

[19]  K. Stamnes,et al.  A new spherical model for computing the radiation field available for photolysis and heating at twilight , 1991 .

[20]  M. Haberreiter,et al.  NLTE model calculations for the solar atmosphere with an iterative treatment of opacity distribution functions , 2008, 0810.3471.

[21]  J. Pierluissi,et al.  New molecular transmission band models for LOWTRAN , 1985 .

[22]  K. Stamnes,et al.  Climate sensitivity to cloud optical properties , 2000 .

[23]  E. Clothiaux,et al.  The k-distribution method and correlated-k approximation for a shortwave radiative transfer model. , 1999 .

[24]  F. X. Kneizys,et al.  Atmospheric transmittance/radiance: Computer code LOWTRAN 5 , 1978 .

[25]  S. Manabe,et al.  Influence of cloud feedback on annual variation of global mean surface temperature , 2001 .

[26]  T. Nakajima,et al.  Estimation of solar radiation using a neural network based on radiative transfer , 2011 .

[27]  Robert E. Davis,et al.  Statistics for the evaluation and comparison of models , 1985 .

[28]  Joseph A. Jervase,et al.  Solar radiation estimation using artificial neural networks , 2002 .

[29]  Teruyuki Nakajima,et al.  Algorithms for radiative intensity calculations in moderately thick atmospheres using a truncation approximation , 1988 .

[30]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[31]  J. Hack,et al.  Diagnostic study of climate feedback processes in atmospheric general circulation models , 1994 .

[32]  William Wandji Nyamsi,et al.  How close to detailed spectral calculations is the k-distribution method and correlated-k approximation of Kato et al. (1999) in each spectral interval? , 2014 .

[33]  B. Klecker,et al.  On the origin of the energetic ion events measured upstream of the Earth's bow shock by STEREO, Cluster, and Geotail , 2011 .

[34]  Alexandra Tsekeri,et al.  Satellite retrieval of aerosol microphysical and optical parameters using neural networks: a new methodology applied to the Sahara desert dust peak , 2014 .

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[37]  Robert G. Ellingson,et al.  The intercomparison of radiation codes used in climate models: Long wave results , 1991 .

[38]  Francisco J. Batlles,et al.  Estimation of hourly global photosynthetically active radiation using artificial neural network models , 2001 .

[39]  K. Stamnes,et al.  Numerically stable algorithm for discrete-ordinate-method radiative transfer in multiple scattering and emitting layered media. , 1988, Applied optics.

[40]  Ralph A. Kahn,et al.  Reducing the Uncertainties in Direct Aerosol Radiative Forcing , 2012, Surveys in Geophysics.

[41]  E. Manzini,et al.  Chemical and dynamical response to the 11‐year variability of the solar irradiance simulated with a chemistry‐climate model , 2004 .

[42]  Tomas Sauer,et al.  Polynomial interpolation in several variables , 2000, Adv. Comput. Math..

[43]  J. Haigh,et al.  An efficient and accurate correlated‐k parameterization of infrared radiative transfer for troposphere–stratosphere–mesosphere GCMs , 2000 .

[44]  G. Reuter,et al.  A stochastic model of global atmospheric response to enhanced greenhouse warming with cloud feedback , 1998 .

[45]  Josef Gasteiger,et al.  Representative wavelengths absorption parameterization applied to satellite channels and spectral bands , 2014 .

[46]  Teruyuki Nakajima,et al.  Matrix formulations for the transfer of solar radiation in a plane-parallel scattering atmosphere. , 1986 .

[47]  M. Derrien,et al.  MSG/SEVIRI cloud mask and type from SAFNWC , 2005 .

[48]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[49]  K. Pearson VII. Note on regression and inheritance in the case of two parents , 1895, Proceedings of the Royal Society of London.

[50]  Richard Neale,et al.  A standard test for AGCMs including their physical parametrizations: I: the proposal , 2000 .

[51]  F. Windmeijer,et al.  An R-squared measure of goodness of fit for some common nonlinear regression models , 1997 .

[52]  A. Lacis,et al.  Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: Refinements of the radiative transfer model and the input data , 2004 .

[53]  T. Sauer,et al.  On multivariate Lagrange interpolation , 1995 .

[54]  Rachel T. Pinker,et al.  Geostationary satellite parameters for surface energy balance , 2002 .

[55]  Catherine Gautier,et al.  SBDART: A Research and Teaching Software Tool for Plane-Parallel Radiative Transfer in the Earth's Atmosphere. , 1998 .

[56]  Jesús Polo,et al.  Artificial intelligence techniques applied to hourly global irradiance estimation from satellite-derived cloud index , 2005 .

[57]  Yoram J. Kaufman,et al.  On the twilight zone between clouds and aerosols , 2007 .