SolarData: An R package for easy access of publicly available solar datasets

Abstract Although the applications of data science and machine learning in solar engineering have increased tremendously in the past decade, most of the solar datasets come from heterogeneous and autonomous sources. For that reason, identifying spatially collocated and temporally aligned datasets has always been time consuming, or even frustrating sometimes, in data-driven solar research. In this regard, I present a new R package— SolarData —for easy access of some publicly available solar datasets. In version 1.0, a total of 5 datasets are included: (1) NREL physical solar model version 3; (2) NREL Oahu solar measurement grid; (3) NOAA surface radiation network; (4) SoDa Linke turbidity factor; and (5) NASA shuttle radar topography mission. This paper provides an overview of each of dataset, and gives code segments that exemplify the usage of the package. Furthermore, in the appendices, a series of self-contained R scripts are used to provide perspectives on how these datasets can be used in solar research. To promote the widespread uptake of this R package, and to facilitate future contribution and collaboration, all contents herein described are made available on GitHub. This paper is the first Data Article, a new submission type offered by the Solar Energy journal.

[1]  C. Gueymard REST2: High-performance solar radiation model for cloudless-sky irradiance, illuminance, and photosynthetically active radiation – Validation with a benchmark dataset , 2008 .

[2]  R. Perez,et al.  Satellite-to-irradiance modeling - a new version of the SUNY model , 2015, 2015 IEEE 42nd Photovoltaic Specialist Conference (PVSC).

[3]  T. Hoff,et al.  Validation of short and medium term operational solar radiation forecasts in the US , 2010 .

[4]  Nan Chen,et al.  Solar irradiance forecasting using spatial-temporal covariance structures and time-forward kriging , 2013 .

[5]  E. Arias-Castro,et al.  A Poisson model for anisotropic solar ramp rate correlations , 2014 .

[6]  Andreas Macke,et al.  Enhanced solar global irradiance during cloudy sky conditions , 2007 .

[7]  Thomas Reindl,et al.  Solar irradiance monitoring network design using the variance quadtree algorithm , 2015 .

[8]  Philippe Blanc,et al.  Short-term solar power forecasting based on satellite images , 2017 .

[9]  Dazhi Yang,et al.  On adding and removing sensors in a solar irradiance monitoring network for areal forecasting and PV system performance evaluation , 2017 .

[10]  John Boland,et al.  Preliminary survey on site-adaptation techniques for satellite-derived and reanalysis solar radiation datasets , 2016 .

[11]  Matthias Morzfeld,et al.  Optimal interpolation of satellite and ground data for irradiance nowcasting at city scales , 2017 .

[12]  Ciprian Nemes A clear sky irradiation assessment using the European Solar Radiation Atlas model and Shuttle Radar Topography Mission database: A case study for Romanian territory , 2013 .

[13]  Thomas Huld,et al.  PVMAPS: Software tools and data for the estimation of solar radiation and photovoltaic module performance over large geographical areas , 2017 .

[14]  Miguel Brito,et al.  Impact of network layout and time resolution on spatio-temporal solar forecasting , 2018 .

[15]  Charles N. Long,et al.  An Automated Quality Assessment and Control Algorithm for Surface Radiation Measurements , 2008 .

[16]  T. Hoff,et al.  Parameterization of site-specific short-term irradiance variability , 2011 .

[17]  Matthew J. Reno,et al.  Solar variability zones: Satellite-derived zones that represent high-frequency ground variability , 2017 .

[18]  Joakim Widén,et al.  A copula method for simulating correlated instantaneous solar irradiance in spatial networks , 2017 .

[19]  T. Hoff,et al.  Short-term irradiance variability: Preliminary estimation of station pair correlation as a function of distance , 2012 .

[20]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[21]  Carlos F.M. Coimbra,et al.  On the determination of coherent solar microclimates for utility planning and operations , 2014 .

[22]  Jan Kleissl,et al.  Solar Energy Forecasting and Resource Assessment , 2013 .

[23]  L. Wald,et al.  Worldwide Linke turbidity information , 2003 .

[24]  P. Ineichen,et al.  A new airmass independent formulation for the Linke turbidity coefficient , 2002 .

[25]  Laura M. Hinkelman,et al.  Differences between along-wind and cross-wind solar irradiance variability on small spatial scales , 2013 .

[26]  T. Farr,et al.  Shuttle radar topography mission produces a wealth of data , 2000 .

[27]  Richard Perez,et al.  Characterization of the intraday variability regime of solar irradiation of climatically distinct locations , 2016 .

[28]  M. Ninyerola,et al.  Mapping a topographic global solar radiation model implemented in a GIS and refined with ground data , 2008 .

[29]  Norman Mariun,et al.  Spatial energy predictions from large-scale photovoltaic power plants located in optimal sites and connected to a smart grid in Peninsular Malaysia , 2016 .

[30]  Dazhi Yang,et al.  Spatial prediction using kriging ensemble , 2018, Solar Energy.

[31]  Dazhi Yang,et al.  Kriging for NSRDB PSM version 3 satellite-derived solar irradiance , 2018, Solar Energy.

[32]  Shunlin Liang,et al.  Evaluation of ASTER and MODIS land surface temperature and emissivity products using long-term surface longwave radiation observations at SURFRAD sites , 2009 .

[33]  P. Ineichen Comparison of eight clear sky broadband models against 16 independent data banks , 2006 .

[34]  Carlos F.M. Coimbra,et al.  History and trends in solar irradiance and PV power forecasting: A preliminary assessment and review using text mining , 2018, Solar Energy.

[35]  Pierre Tandeo,et al.  Nowcasting solar irradiance using an analog method and geostationary satellite images , 2018 .

[36]  C. Long,et al.  SURFRAD—A National Surface Radiation Budget Network for Atmospheric Research , 2000 .

[37]  Oscar Perpiñán Lamigueiro solaR: Solar Radiation and Photovoltaic Systems with R , 2012 .

[38]  J. Michalsky,et al.  Solar and Infrared Radiation Measurements , 2012 .

[39]  Dazhi Yang,et al.  Solar radiation on inclined surfaces: Corrections and benchmarks , 2016 .

[40]  Andrew K. Heidinger,et al.  Using SURFRAD to Verify the NOAA Single-Channel Land Surface Temperature Algorithm , 2013 .

[41]  Sanjib Kumar Panda,et al.  A Siting and Sizing Optimization Approach for PV–Battery–Diesel Hybrid Systems , 2018, IEEE Transactions on Industry Applications.

[42]  L. F. Zarzalejo,et al.  Solar resources estimation combining digital terrain models and satellite images techniques , 2010 .

[43]  Antonio Sanfilippo,et al.  Analysis of the long-term solar potential for electricity generation in Qatar , 2017 .

[44]  Nicholas A. Engerer,et al.  QCPV: A quality control algorithm for distributed photovoltaic array power output , 2017 .

[45]  P. Ineichen,et al.  Producing satellite-derived irradiances in complex arid terrain , 2004 .

[46]  M. Claverie,et al.  Intercomparison of Landsat albedo retrieval techniques and evaluation against in situ measurements across the US SURFRAD network , 2014 .

[47]  Tomas Cebecauer,et al.  Spatial disaggregation of satellite-derived irradiance using a high-resolution digital elevation model , 2010 .

[48]  Ming Chen,et al.  Validation of GOES-R Satellite Land Surface Temperature Algorithm Using SURFRAD Ground Measurements and Statistical Estimates of Error Properties , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Galen Maclaurin,et al.  The National Solar Radiation Data Base (NSRDB) , 2017, Renewable and Sustainable Energy Reviews.

[50]  J. Kleissl,et al.  Evaluation of numerical weather prediction for intra-day solar forecasting in the continental United States , 2011 .

[51]  Nicholas A. Engerer Minute resolution estimates of the diffuse fraction of global irradiance for southeastern Australia , 2015 .

[52]  J. Duffie,et al.  Estimation of the diffuse radiation fraction for hourly, daily and monthly-average global radiation , 1982 .

[53]  J. A. Ruiz-Arias,et al.  Extensive worldwide validation and climate sensitivity analysis of direct irradiance predictions from 1-min global irradiance , 2016 .

[54]  L. Wald,et al.  McClear: a new model estimating downwelling solar radiation at ground level in clear-sky conditions , 2013 .

[55]  Dazhi Yang,et al.  Very short term irradiance forecasting using the lasso , 2015 .

[56]  Andreas Kazantzidis,et al.  Determination of measuring sites for solar irradiance, based on cluster analysis of satellite-derived cloud estimations , 2013 .

[57]  A. Cronin,et al.  Intra-hour forecasts of solar power production using measurements from a network of irradiance sensors , 2013 .

[58]  Noel A Cressie,et al.  Statistics for Spatio-Temporal Data , 2011 .

[59]  Dazhi Yang,et al.  Very short-term irradiance forecasting at unobserved locations using spatio-temporal kriging , 2015 .

[60]  Jan Kleissl,et al.  Cloud speed impact on solar variability scaling – Application to the wavelet variability model , 2013 .

[61]  Dazhi Yang,et al.  Reconciling solar forecasts: Geographical hierarchy , 2017 .

[62]  Joseph J. Michalsky,et al.  An Update on SURFRAD—The GCOS Surface Radiation Budget Network for the Continental United States , 2005 .

[63]  Jan Kleissl,et al.  Editorial: Submission of Data Article is now open , 2018, Solar Energy.

[64]  E. Zhandire,et al.  Predicting clear-sky global horizontal irradiance at eight locations in South Africa using four models , 2017 .

[65]  R. Müller,et al.  A new solar radiation database for estimating PV performance in Europe and Africa , 2012 .

[66]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[67]  Oscar Perpinan Lamigueiro Displaying Time Series, Spatial, and Space-Time Data with R , 2014 .