Spatial Assessment of Solar Radiation by Machine Learning and Deep Neural Network Models Using Data Provided by the COMS MI Geostationary Satellite: A Case Study in South Korea

Although data-driven methods including deep neural network (DNN) were introduced, there was not enough assessment about spatial characteristics when using limited ground observation as reference. This work aimed to interpret the feasibility of several machine learning approaches to assess the spatial distribution of solar radiation on Earth based on the Communication, Ocean, and Meteorological Satellite (COMS) Meteorological Imager (MI) geostationary satellite. Four data-driven models were selected (artificial neural network (ANN), random forest (RF), support vector regression (SVR), and DNN), to compare their accuracy and spatial estimating performance. Moreover, we used a physical model to probe the ability of data-driven methods, implementing hold-out and k-fold cross-validation approaches based on pyranometers located in South Korea. The results of analysis showed the RF had the highest accuracy in predicting performance, although the difference between RF and the second-best technique (DNN) was insignificant. Temporal variations in root mean square error (RMSE) were dependent on the number of data samples, while the physical model showed relatively less sensitivity. Nevertheless, DNN and RF showed less variability in RMSE than the others. To examine spatial estimation performance, we mapped solar radiation over South Korea for each model. The data-driven models accurately simulated the observed cloud pattern spatially, whereas the physical model failed to do because of cloud mask errors. These exhibited different spatial retrieval performances according to their own training approaches. Overall analysis showed that deeper layers of networks approaches (RF and DNN), could best simulate the challenging spatial pattern of thin clouds when using satellite multispectral data.

[1]  Geoffrey E. Hinton,et al.  Semantic hashing , 2009, Int. J. Approx. Reason..

[2]  Xiaolei Niu,et al.  Retrieving high-resolution surface solar radiation with cloud parameters derived by combining MODIS and MTSAT data , 2015 .

[3]  Steven W. Running,et al.  Reconciling satellite with ground data to estimate forest productivity at national scales , 2012 .

[4]  Geoffrey E. Hinton,et al.  Deep, Narrow Sigmoid Belief Networks Are Universal Approximators , 2008, Neural Computation.

[5]  R. Roebeling,et al.  Application of Meteosat derived meteorological information for crop yield predictions in Europe , 2004 .

[6]  A solar radiation database for Chile , 2017, Scientific Reports.

[7]  Jungho Im,et al.  Prediction of Drought on Pentad Scale Using Remote Sensing Data and MJO Index through Random Forest over East Asia , 2018, Remote. Sens..

[8]  Wen Zhang,et al.  Upscaling of Surface Soil Moisture Using a Deep Learning Model with VIIRS RDR , 2017, ISPRS Int. J. Geo Inf..

[9]  Viorel Badescu,et al.  Solar Radiation Measurements , 2013 .

[10]  Marcel Suri,et al.  D 1.1.3 Report on Benchmarking of Radiation Products , 2009 .

[11]  François Anctil,et al.  Neural network estimation of air temperatures from AVHRR data , 2004 .

[12]  Shahaboddin Shamshirband,et al.  Potential of radial basis function based support vector regression for global solar radiation prediction , 2014 .

[13]  Thomas D. Brock,et al.  Calculating solar radiation for ecological studies , 1981 .

[14]  J. F. Meirink,et al.  Retrieval and validation of global, direct, and diffuse irradiance derived from SEVIRI satellite observations , 2013 .

[15]  Lutz Prechelt,et al.  Automatic early stopping using cross validation: quantifying the criteria , 1998, Neural Networks.

[16]  Jungho Im,et al.  Downscaling of AMSR-E soil moisture with MODIS products using machine learning approaches , 2016, Environmental Earth Sciences.

[17]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[18]  S. Liang Atmospheric correction of optical imagery , 2005, Advanced Remote Sensing.

[19]  Hiroshi Kawamura,et al.  Validation and Improvement of Satellite-Derived Surface Solar Radiation over the Northwestern Pacific Ocean , 2005 .

[20]  G. Powers,et al.  A Description of the Advanced Research WRF Version 3 , 2008 .

[21]  Hiroshi Kawamura,et al.  A system to distribute satellite incident solar radiation in real-time , 2001 .

[22]  Jae-Dong Jang,et al.  Estimation of soil moisture using deep learning based on satellite data: a case study of South Korea , 2018, GIScience & Remote Sensing.

[23]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  W. Menzel,et al.  Discriminating clear sky from clouds with MODIS , 1998 .

[25]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[26]  Muhsin Tunay Gencoglu,et al.  The performance comparison of Multiple Linear Regression, Random Forest and Artificial Neural Network by using photovoltaic and atmospheric data , 2017, 2017 14th International Conference on Engineering of Modern Electric Systems (EMES).

[27]  R. Deo,et al.  Forecasting long-term global solar radiation with an ANN algorithm coupled with satellite-derived (MODIS) land surface temperature (LST) for regional locations in Queensland , 2017 .

[28]  Yoram J. Kaufman,et al.  MODIS Cloud screening for remote sensing of aerosols over oceans using spatial variability , 2002 .

[29]  Stephen A. Billings,et al.  International Journal of Control , 2004 .

[30]  Alejandro Flores,et al.  A machine learning approach to estimation of downward solar radiation from satellite-derived data products: An application over a semi-arid ecosystem in the U.S. , 2017, PloS one.

[31]  Belkacem Draoui,et al.  Estimating Global Solar Radiation Using Artificial Neural Network and Climate Data in the South-western Region of Algeria , 2012 .

[32]  Jungho Im,et al.  Estimation of Fugacity of Carbon Dioxide in the East Sea Using In Situ Measurements and Geostationary Ocean Color Imager Satellite Data , 2017, Remote. Sens..

[34]  Y. Radhika,et al.  Atmospheric Temperature Prediction using Support Vector Machines , 2009 .

[35]  T. Muneer Solar radiation and daylight models , 2004 .

[36]  Muyiwa S. Adaramola,et al.  Estimating global solar radiation using common meteorological data in Akure, Nigeria , 2012 .

[37]  Hiroshi Kawamura,et al.  Estimation of insolation over the Pacific Ocean off the Sanriku coast , 1998 .

[38]  Yoshua Bengio,et al.  Deep Learning of Representations: Looking Forward , 2013, SLSP.

[39]  F. Besharat,et al.  Empirical models for estimating global solar radiation: A review and case study , 2013 .

[40]  D. Lettenmaier,et al.  A simple hydrologically based model of land surface water and energy fluxes for general circulation models , 1994 .

[41]  Kyung-Soo Han,et al.  Solar Radiation Received by Slopes Using COMS Imagery, a Physically Based Radiation Model, and GLOBE , 2016, J. Sensors.

[42]  Gavin C. Cawley,et al.  On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation , 2010, J. Mach. Learn. Res..

[43]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[44]  X. Wen,et al.  A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset , 2016 .

[45]  Sancho Salcedo-Sanz,et al.  Short term wind speed prediction based on evolutionary support vector regression algorithms , 2011, Expert Syst. Appl..

[46]  Jungho Im,et al.  Machine Learning Approaches for Estimating Forest Stand Height Using Plot-Based Observations and Airborne LiDAR Data , 2018 .

[47]  Khubaib Amjad Alam,et al.  Support vector regression based prediction of global solar radiation on a horizontal surface , 2015 .

[48]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[49]  S. N. Alamri,et al.  ANN-based modelling and estimation of daily global solar radiation data: A case study , 2009 .

[50]  Viorel Badescu,et al.  Weather Modeling and Forecasting of PV Systems Operation , 2012 .

[51]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[52]  Kyung-Soo Han,et al.  Neural network determination of cloud attenuation to estimate insolation using MTSAT‐1R data , 2008 .

[53]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Roberta E. Martin,et al.  A Tale of Two “Forests”: Random Forest Machine Learning Aids Tropical Forest Carbon Mapping , 2014, PloS one.

[55]  G. Lemasters,et al.  Exposure assessment models for elemental components of particulate matter in an urban environment: A comparison of regression and random forest approaches. , 2017, Atmospheric environment.

[56]  Kyung-Soo Han,et al.  Improved estimation of surface solar insolation using a neural network and MTSAT-1R data , 2010, Comput. Geosci..

[57]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  J. C. Waltona,et al.  Desert vegetation and timing of solar radiation , 2004 .

[59]  Nicolas Le Roux,et al.  Deep Belief Networks Are Compact Universal Approximators , 2010, Neural Computation.

[60]  Le Wang,et al.  An object-based SVM method incorporating optimal segmentation scale estimation using Bhattacharyya Distance for mapping salt cedar (Tamarisk spp.) with QuickBird imagery , 2015 .

[61]  John D. Aber,et al.  Variation among solar radiation data sets for the Eastern US and its effects on predictions of forest production and water yield , 2000 .

[62]  Bernard Bobée,et al.  Daily reservoir inflow forecasting using artificial neural networks with stopped training approach , 2000 .

[63]  Soteris A. Kalogirou,et al.  Machine learning methods for solar radiation forecasting: A review , 2017 .

[64]  Jungho Im,et al.  Detection of Tropical Overshooting Cloud Tops Using Himawari-8 Imagery , 2017, Remote. Sens..

[65]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[66]  Domenico Cimini,et al.  Improvement in Surface Solar Irradiance Estimation Using HRV/MSG Data , 2018, Remote. Sens..

[67]  J. Im,et al.  Drought assessment and monitoring through blending of multi-sensor indices using machine learning approaches for different climate regions , 2016 .

[68]  C. Gueymard,et al.  Validation and Ranking Methodologies for Solar Radiation Models , 2008 .

[69]  Shunlin Liang,et al.  An efficient physically based parameterization to derive surface solar irradiance based on satellite atmospheric products , 2015 .

[70]  Shunlin Liang,et al.  An algorithm for estimating downward shortwave radiation from GMS 5 visible imagery and its evaluation over China , 2010 .

[71]  Fatih Evrendilek,et al.  Statistical Modeling of Spatio-Temporal Variability in Monthly Average Daily Solar Radiation over Turkey , 2007, Sensors.

[72]  John W. Pomeroy,et al.  Synthesis of incoming shortwave radiation for hydrological simulation , 2011 .

[73]  Hideki Kobayashi,et al.  MODIS-derived global land products of shortwave radiation and diffuse and total photosynthetically active radiation at 5 km resolution from 2000 , 2018 .

[74]  Tim Appelhans,et al.  Improving the accuracy of rainfall rates from optical satellite sensors with machine learning — A random forests-based approach applied to MSG SEVIRI , 2014 .

[75]  Wenmin Qin,et al.  Comparison of deterministic and data-driven models for solar radiation estimation in China , 2018 .

[76]  Shahaboddin Shamshirband,et al.  Prediction of the solar radiation on the Earth using support vector regression technique , 2015 .

[77]  David Pozo-Vázquez,et al.  A comparative study of ordinary and residual kriging techniques for mapping global solar radiation over southern Spain , 2009 .

[78]  Douglas M. Hawkins,et al.  Assessing Model Fit by Cross-Validation , 2003, J. Chem. Inf. Comput. Sci..

[79]  Gérard Dedieu,et al.  A multi-temporal method for cloud detection, applied to FORMOSAT-2, VENµS, LANDSAT and SENTINEL-2 images , 2010 .

[80]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[81]  Jamil Amanollahi,et al.  Estimating solar radiation using NOAA/AVHRR and ground measurement data , 2018 .

[82]  Jungho Im,et al.  Classification and Mapping of Paddy Rice by Combining Landsat and SAR Time Series Data , 2018, Remote. Sens..

[83]  Francisco J. Tapiador,et al.  Assessment of renewable energy potential through satellite data and numerical models , 2009 .

[84]  Claudia Notarnicola,et al.  Review of Machine Learning Approaches for Biomass and Soil Moisture Retrievals from Remote Sensing Data , 2015, Remote. Sens..

[85]  Robert Frouin,et al.  A review of satellite methods to derive surface shortwave irradiance , 1995 .

[86]  Jungho Im,et al.  Icing Detection over East Asia from Geostationary Satellite Data Using Machine Learning Approaches , 2018, Remote. Sens..

[87]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[88]  Adel Mellit,et al.  Prediction of daily and mean monthly global solar radiation using support vector machine in an arid climate , 2016 .