Can we justify producing univariate machine-learning forecasts with satellite-derived solar irradiance?

Ground-based radiometry is the most reliable method for obtaining data for solar energy applications. However, due to potential calibration and data quality-control issues, as well as the high cost associated with instrumentation, reliable and long-term ground-based measurements are scarce. For this reason, irradiance data from alternative sources, such as modeled or remote-sensed data, are of interest. Nonetheless, data coming from these sources are known to have systematic errors that may deteriorate the performance of subsequent applications. This study aims to evaluate the quality of solar forecasts generated using two types of irradiance data, namely, ground-based and bias-corrected satellite-derived global horizontal irradiance using error decomposition frameworks. Hourly forecasts are generated using 5 high-performance machine-learning models, with ground-based data from 15 research-grade monitoring stations in Europe, South America, and Africa, and satellite-derived data at the collocated pixels, separately. On top of these component forecasts, ensemble forecasts are also evaluated. Instead of limiting the forecast verification to a set of accuracy measures (e.g., mean bias error or root mean square error), the Murphy–Winkler forecast verification framework is considered, in which the joint, conditional, and marginal distributions of observations and forecasts are examined. The framework describes the qualities of forecast, such as calibration, conditional bias, or discrimination, with quantitative measures. Hence, it provides additional insights to the traditional measure-oriented approach. The main results show that the forecasts generated using bias-corrected satellite-derived data have comparable quality as compared to those generated using ground-based data.

[1]  Ponnuthurai Nagaratnam Suganthan,et al.  Ensemble methods for wind and solar power forecasting—A state-of-the-art review , 2015 .

[2]  Richard Perez,et al.  Can we gauge forecasts using satellite-derived solar irradiance? , 2019, Journal of Renewable and Sustainable Energy.

[3]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[4]  Dipti Srinivasan,et al.  Automatic hourly solar forecasting using machine learning models , 2019, Renewable and Sustainable Energy Reviews.

[5]  A. H. Murphy,et al.  A General Framework for Forecast Verification , 1987 .

[6]  Antonio Sanfilippo,et al.  Analysis of the long-term solar potential for electricity generation in Qatar , 2017 .

[7]  Ana M. Gracia-Amillo,et al.  Evaluation of global horizontal irradiance estimates from ERA5 and COSMO-REA6 reanalyses using ground and satellite-based data , 2018 .

[8]  Jordan M. Malof,et al.  Automatic Detection of Solar Photovoltaic Arrays in High Resolution Aerial Imagery , 2016, ArXiv.

[9]  Dipti Srinivasan,et al.  Reconciling solar forecasts: Sequential reconciliation , 2019, Solar Energy.

[10]  Robert A. Taylor,et al.  Assessment of direct normal irradiance and cloud connections using satellite data over Australia , 2015 .

[11]  Max Kuhn,et al.  Building Predictive Models in R Using the caret Package , 2008 .

[12]  M. Topič,et al.  Methodology of Köppen-Geiger-Photovoltaic climate classification and implications to worldwide mapping of PV system performance , 2019, Solar Energy.

[13]  Lucien Wald,et al.  Fast radiative transfer parameterisation for assessing the surface solar irradiance: The Heliosat-4 method , 2017 .

[14]  P. Ineichen Validation of models that estimate the clear sky global and beam solar irradiance , 2016 .

[15]  Robert Pitz-Paal,et al.  Shadow camera system for the generation of solar irradiance maps , 2017 .

[16]  S. Grassi,et al.  A scalable method for estimating rooftop solar irradiation potential over large regions , 2018 .

[17]  Dazhi Yang,et al.  Ultra-fast preselection in lasso-type spatio-temporal solar forecasting problems , 2018, Solar Energy.

[18]  Martin Wild,et al.  Impact of geolocations of validation data on the evaluation of surface incident shortwave radiation from Earth System Models , 2015 .

[19]  Hans-Georg Beyer,et al.  Irradiance Forecasting for the Power Prediction of Grid-Connected Photovoltaic Systems , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Richard Perez,et al.  Preliminary assessment of two spatio-temporal forecasting technics for hourly satellite-derived irradiance in a complex meteorological context , 2019, Solar Energy.

[21]  C. Long,et al.  From Dimming to Brightening: Decadal Changes in Solar Radiation at Earth's Surface , 2005, Science.

[22]  L. Wald,et al.  McClear: a new model estimating downwelling solar radiation at ground level in clear-sky conditions , 2013 .

[23]  Yi Zhang,et al.  Estimation of all-sky instantaneous surface incident shortwave radiation from Moderate Resolution Imaging Spectroradiometer data using optimization method , 2018 .

[24]  Dazhi Yang,et al.  Post-processing of NWP forecasts using ground or satellite-derived data through kernel conditional density estimation , 2019, Journal of Renewable and Sustainable Energy.

[25]  Jan Kleissl,et al.  WRF inversion base height ensembles for simulating marine boundary layer stratocumulus , 2017 .

[26]  Gokhan Mert Yagli,et al.  Quality Control for Solar Irradiance Data , 2018, 2018 IEEE Innovative Smart Grid Technologies - Asia (ISGT Asia).

[27]  Maria João Costa,et al.  Development of an ANN based corrective algorithm of the operational ECMWF global horizontal irradiation forecasts , 2019, Solar Energy.

[28]  R. Urraca,et al.  Clear sky solar irradiance models: A review of seventy models , 2019, Renewable and Sustainable Energy Reviews.

[29]  Richard Perez,et al.  Detecting Calibration Drift at Ground Truth Stations A Demonstration of Satellite Irradiance Models' Accuracy , 2017 .

[30]  Dazhi Yang,et al.  A correct validation of the National Solar Radiation Data Base (NSRDB) , 2018, Renewable and Sustainable Energy Reviews.

[31]  Richard Perez,et al.  COMPARING SATELLITE REMOTE SENSING AND GROUND NETWORK MEASUREMENTS FOR THE PRODUCTION OF SITE/TIME SPECIFIC IRRADIANCE DATA , 1997 .

[32]  Dazhi Yang,et al.  Spatial prediction using kriging ensemble , 2018, Solar Energy.

[33]  Dazhi Yang,et al.  Kriging for NSRDB PSM version 3 satellite-derived solar irradiance , 2018, Solar Energy.

[34]  Carlos F.M. Coimbra,et al.  History and trends in solar irradiance and PV power forecasting: A preliminary assessment and review using text mining , 2018, Solar Energy.

[35]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..

[36]  Christophe Vernay,et al.  Review of Satellite-based Surface Solar Irradiation Databases for the Engineering, the Financing and the Operating of Photovoltaic Systems☆ , 2014 .

[37]  Thomas Reindl,et al.  Block Matching Algorithms: Their Applications and Limitations in Solar Irradiance Forecasting , 2013 .

[38]  Pierre Tandeo,et al.  Nowcasting solar irradiance using an analog method and geostationary satellite images , 2018 .

[39]  A. H. Murphy,et al.  General Decompositions of MSE-Based Skill Scores: Measures of Some Basic Aspects of Forecast Quality , 1996 .

[40]  Jan Kleissl,et al.  Coastal Stratocumulus cloud edge forecasts , 2018 .

[41]  Haydar Demirhan,et al.  Missing value imputation for short to mid-term horizontal solar irradiance data , 2018, Applied Energy.

[42]  Dazhi Yang,et al.  SolarData package update v1.1: R functions for easy access of Baseline Surface Radiation Network (BSRN) , 2019, Solar Energy.

[43]  Matthias Morzfeld,et al.  Intra-hour Cloud Index Forecasting with Data Assimilation , 2019, 2019 IEEE 46th Photovoltaic Specialists Conference (PVSC).

[44]  Yudong Tian,et al.  Performance Metrics, Error Modeling, and Uncertainty Quantification , 2016 .

[45]  David J. Hand,et al.  Classifier Technology and the Illusion of Progress , 2006, math/0606441.

[46]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[47]  I. Jolliffe,et al.  Forecast verification : a practitioner's guide in atmospheric science , 2011 .

[48]  A. H. Murphy,et al.  What Is a Good Forecast? An Essay on the Nature of Goodness in Weather Forecasting , 1993 .

[49]  S. Miller,et al.  Short-term solar irradiance forecasting via satellite/model coupling , 2017, Solar Energy.

[50]  John Boland,et al.  Preliminary survey on site-adaptation techniques for satellite-derived and reanalysis solar radiation datasets , 2016 .

[51]  Dazhi Yang,et al.  Reconciling solar forecasts: Geographical hierarchy , 2017 .

[52]  Dazhi Yang,et al.  SolarData: An R package for easy access of publicly available solar datasets , 2018, Solar Energy.

[53]  Nicholas A. Engerer,et al.  Improved satellite-derived PV power nowcasting using real-time power data from reference PV systems , 2017, Solar Energy.

[54]  Dazhi Yang,et al.  On adding and removing sensors in a solar irradiance monitoring network for areal forecasting and PV system performance evaluation , 2017 .

[55]  Jan Kleissl,et al.  Assimilating observations to simulate marine layer stratocumulus for solar forecasting , 2018 .

[56]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[57]  Chunlin Huang,et al.  Representativeness errors of point-scale ground-based solar radiation measurements in the validation of remote sensing products , 2016 .

[58]  Thomas R. Betts,et al.  Satellite or ground-based measurements for production of site specific hourly irradiance data: Which is most accurate and where? , 2018 .

[59]  Dazhi Yang,et al.  A guideline to solar forecasting research practice: Reproducible, operational, probabilistic or physically-based, ensemble, and skill (ROPES) , 2019, Journal of Renewable and Sustainable Energy.

[60]  G. Hodges,et al.  Baseline Surface Radiation Network (BSRN): structure and data description (1992–2017) , 2018, Earth System Science Data.

[61]  Jan Kleissl,et al.  Cloud tomography applied to sky images: A virtual testbed , 2018, Solar Energy.

[62]  Soteris A. Kalogirou,et al.  Machine learning methods for solar radiation forecasting: A review , 2017 .

[63]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.