A review of validation methodologies and statistical performance indicators for modeled solar radiation data: Towards a better bankability of solar projects

In the context of the current rapid development of large-scale solar power projects, the accuracy of the modeled radiation datasets regularly used by many different interest groups is of the utmost importance. This process requires careful validation, normally against high-quality measurements. Some guidelines for a successful validation are reviewed here, not just from the standpoint of solar scientists but also of non-experts with limited knowledge of radiometry or solar radiation modeling. Hence, validation results and performance metrics are reported as comprehensively as possible. The relationship between a desirable lower uncertainty in solar radiation data, lower financial risks, and ultimately better bankability of large-scale solar projects is discussed.

[1]  Thomas W. Giambelluca,et al.  Modeling clear-sky solar radiation across a range of elevations in Hawai‘i: Comparing the use of input parameters at different temporal resolutions , 2012 .

[2]  L. Wald,et al.  McClear: a new model estimating downwelling solar radiation at ground level in clear-sky conditions , 2013 .

[3]  C. Gueymard,et al.  Assessment of spatial and temporal variability in the US solar resource from radiometric measurements and predictions from models using ground-based or satellite data , 2011 .

[4]  C. Gueymard.  Direct solar transmittance and irradiance predictions with broadband models. Part I: detailed theoretical performance assessment , 2003 .

[5]  C. Gueymard,et al.  Validation and Ranking Methodologies for Solar Radiation Models , 2008 .

[6]  C. Willmott.  ON THE VALIDATION OF MODELS , 1981 .

[7]  Jeffrey G. Arnold,et al.  Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations , 2007 .

[8]  A. Louche,et al.  Experimental verification of some clear-sky insolation models , 1988 .

[9]  I. A. Walter,et al.  The ASCE standardized reference evapotranspiration equation , 2005 .

[10]  R. J. Stone.  Improved statistical procedure for the evaluation of solar radiation estimation models , 1993 .

[11]  Viorel Badescu,et al.  Computing global and diffuse solar hourly irradiation on clear sky. Review and testing of 54 models , 2012 .

[12]  F. Antonanzas-Torres,et al.  Improving daily output of global to direct solar irradiance models with ground measurements , 2013 .

[13]  C. Gueymard,et al.  Evaluation of conventional and high-performance routine solar radiation measurements for improved solar resource, climatological trends, and radiative modeling , 2009 .

[14]  Jesús Polo,et al.  Iterative filtering of ground data for qualifying statistical models for solar irradiance estimation from satellite data , 2006 .

[15]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[16]  C. H. Whitlock,et al.  Assessment of the global monthly mean surface insolation estimated from satellite measurements using global energy balance archive data , 1995 .

[17]  John A. Davies,et al.  Evaluation of selected models for estimating solar radiation on horizontal surfaces , 1989 .

[18]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[19]  C. Gueymard.  Direct solar transmittance and irradiance predictions with broadband models. Part II: validation with high-quality measurements , 2003 .

[20]  Pierre Ineichen,et al.  Mesures d'ensoleillement à Genève : publication No 9 : Indice de clarté , 1984 .

[21]  C. Long,et al.  Identification of clear skies from broadband pyranometer measurements and calculation of downwelling shortwave cloud effects , 2000 .

[22]  David Crisp,et al.  Intercomparison of shortwave radiative transfer codes and measurements , 2005 .

[23]  K. Gaustad,et al.  The Shortwave (SW) Clear-Sky Detection and Fitting Algorithm: Algorithm Operational Details and Explanations , 2004 .

[24]  Siri S. Khalsa,et al.  Methods for probabilistic modeling of concentrating solar power plants , 2011 .

[25]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[26]  R. E. Bird,et al.  Review, Evaluation, and Improvement of Direct Irradiance Models , 1981 .

[27]  Elke Lorenz,et al.  COMBINING SOLAR IRRADIANCE MEASUREMENTS AND VARIOUS SATELLITE-DERIVED PRODUCTS TO A SITE-SPECIFIC BEST ESTIMATE , 2008 .

[28]  K. Taylor.  Summarizing multiple aspects of model performance in a single diagram , 2001 .

[29]  Manuel Romero,et al.  Solar radiation estimations over India using Meteosat satellite images , 2011 .

[30]  G. Marsaglia,et al.  Evaluating Kolmogorov's distribution , 2003 .

[31]  R. Bird,et al.  Simplified clear sky model for direct and diffuse insolation on horizontal surfaces , 1981 .

[32]  Eldon C. Boes.  Fundamentals of Solar Radiation , 1979 .

[33]  P. Ineichen,et al.  A new airmass independent formulation for the Linke turbidity coefficient , 2002 .

[34]  Frank Vignola,et al.  Building a bankable solar radiation dataset , 2012 .

[35]  D. Mckay,et al.  Estimating solar irradiance and components , 1982 .

[36]  C. Willmott,et al.  Ambiguities inherent in sums-of-squares-based error statistics , 2009 .

[37]  Richard Meyer,et al.  Standardizing and benchmarking of modeled DNI data products , 2011 .

[38]  Ross S. Purves,et al.  Uncertainties of parameterized surface downward clear-sky shortwave and all-sky longwave radiation. , 2012 .

[39]  J. Kleissl,et al.  Reporting of irradiance modeling relative prediction errors , 2013 .

[40]  C. Willmott.  Some Comments on the Evaluation of Model Performance , 1982 .

[41]  Jorge Aguilera,et al.  A BANKABLE METHOD FOR THE FIELD TESTING OF A CPV PLANT , 2013 .

[42]  Keith Kirkpatrick,et al.  Understanding Solar Power Performance Risk and Uncertainty , 2012 .

[43]  D. Legates,et al.  A refined index of model performance: a rejoinder , 2013 .

[44]  Iñigo Pagola,et al.  New methodology of solar radiation evaluation using free access databases in specific locations , 2010 .

[45]  P. Ineichen.  A broadband simplified version of the Solis clear sky model , 2008 .

[46]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[47]  R. J. Stone.  A nonparametric statistical procedure for ranking the overall performance of solar radiation models at multiple locations , 1994 .

[48]  Taiping Zhang,et al.  The validation of the GEWEX SRB surface shortwave flux data products using BSRN measurements: A systematic quality control, production and application approach , 2013 .

[49]  Claudia Biermann.  Applied Solar Energy An Introduction , 2016 .

[50]  F. Antonanzas-Torres,et al.  Comparative assessment of global irradiation from a satellite estimate model (CM SAF) and on-ground measurements (SIAR): a Spanish case study , 2013 .

[51]  Christoph Schillings,et al.  Validation of a method for deriving high resolution direct normal irradiance from satellite data and application for the Arabian Peninsula , 2004 .

[52]  Bernhard Geiger,et al.  Satellite Application Facilities irradiance products: hourly time step comparison and validation over Europe , 2009 .

[53]  Robert E. Davis,et al.  Statistics for the evaluation and comparison of models , 1985 .

[54]  Carlo Renno,et al.  Design and modeling of a concentrating photovoltaic thermal (CPV/T) system for a domestic application , 2013 .

[55]  P. Ineichen.  Five satellite products deriving beam and global irradiance validation on data from 23 ground stations , 2011 .

[56]  P. Ineichen,et al.  The importance of correct albedo determination for adequately modeling energy received by tilted surfaces , 1987 .

[57]  Thomas Huld,et al.  Management and Exploitation of Solar Resource Knowledge , 2008 .

[58]  Jason Wittenberg,et al.  Clarify: Software for Interpreting and Presenting Statistical Results , 2003 .

[59]  C. Gueymard.  Clear-sky irradiance predictions for solar resource mapping and large-scale applications: Improved validation methodology and detailed performance analysis of 18 broadband radiative models , 2012 .

[60]  Paul W. Stackhouse,et al.  Solar Resource Knowledge Management: A New Task of the International Energy Agency , 2006 .

[61]  V. Badescu.  Assessing the performance of solar radiation computing models and model selection procedures , 2013 .

[62]  Tariq Muneer,et al.  Discourses on solar radiation modeling , 2007 .

[63]  Nadir Ahmed Elagib,et al.  New approaches for estimating global solar radiation across Sudan , 2000 .

[64]  Christian A. Gueymard,et al.  Temporal variability in direct and global irradiance at various time scales as affected by aerosols , 2012 .

[65]  Viorel Badescu,et al.  The CMSAF hourly solar irradiance database (product CM54): Accuracy and bias corrections with illustrations for Romania (south-eastern Europe) , 2013 .

[66]  P. Ineichen,et al.  A new operational model for satellite-derived irradiances: description and validation , 2002 .

[67]  C. Coimbra,et al.  Proposed Metric for Evaluation of Solar Forecasting Models , 2013 .

[68]  Peter Lindstrom,et al.  THE MUTUAL INFORMATION DIAGRAM FOR UNCERTAINTY VISUALIZATION , 2013 .

[69]  Nelson Fumo,et al.  Uncertainty Analysis for Dimensioning Solar Photovoltaic Arrays , 2012 .

[70]  Xin Li,et al.  A LUT-based approach to estimate surface solar irradiance by combining MODIS and MTSAT data , 2011 .

[71]  Jörg Trentmann,et al.  Remote sensing of solar surface radiation for climate monitoring — the CM-SAF retrieval in international comparison , 2012 .

[72]  Richard G. Allen,et al.  Assessing Integrity of Weather Data for Reference Evapotranspiration Estimation , 1996 .

[73]  C. Gueymard.  REST2: High-performance solar radiation model for cloudless-sky irradiance, illuminance, and photosynthetically active radiation – Validation with a benchmark dataset , 2008 .

[74]  C. Willmott,et al.  A refined index of model performance , 2012 .

[75]  Taiping Zhang,et al.  Assessment of BSRN radiation records for the computation of monthly means , 2010 .

[76]  Ciprian Nemes.  A clear sky irradiation assessment using the European Solar Radiation Atlas model and Shuttle Radar Topography Mission database: A case study for Romanian territory , 2013 .

[77]  L. Alados-Arboledas,et al.  Comparison of Cloudless Sky Parameterizations of Solar Irradianceat Various Spanish Midlatitude Locations , 2000 .

[78]  Nicholas C. Coops,et al.  Validation of Solar Radiation Surfaces from MODIS and Reanalysis Data over Topographically Complex Terrain , 2009 .

[79]  Helen C. Power,et al.  Estimating clear-sky beam irradiation from sunshine duration , 2001 .

[80]  Richard G. Allen,et al.  Analytical integrated functions for daily solar radiation on slopes , 2006 .

[81]  N. Majumdar,et al.  Prediction of direct solar radiation for low atmospheric turbidity , 1972 .

[82]  Carlos F.M. Coimbra,et al.  Verification of the SUNY direct normal irradiance model with ground measurements , 2014 .

[83]  Jorge Aguilera,et al.  A bankable method of assessing the performance of a CPV plant , 2014 .

[84]  L. Ramírez,et al.  Analysis of different comparison parameters applied to solar radiation data from satellite and German radiometric stations , 2009 .