Multi-objective evolutionary optimization of prediction intervals for solar energy forecasting with neural networks

Abstract In the context of forecasting for renewable energy, it is common to produce point forecasts but it is also important to have information about the uncertainty of the forecast. To this extent, instead of providing a single measure for the prediction, lower and upper bound for the expected value for the solar radiation are used (prediction interval). This estimation of optimal prediction intervals requires the simultaneous optimization of two objective measures: on one hand, it is important that the coverage probability of the interval is as close as possible to a given target value. On the other, in order to bound uncertainty, intervals must be narrow; this means that there is a trade-off between both objectives, as narrow intervals reduce the coverage probability for those solutions, as the actual value of solar radiation is more likely to fall outside the predicted margins. In this work we propose a multi-objective evolutionary approach that is able to optimize both goals simultaneously. The proposal uses neural networks to create complex non-linear models whose outputs are the upper and lower limits of the prediction intervals. Results have been compared with a single-objective optimization of similar neural network architectures and a baseline algorithm (quantile estimation with gradient boosting). Results show that the neural network is able to provide accurate results. Also, the multi-objective approach is able to obtain the best results and has also the advantage that a single run is able to obtain prediction intervals for any target coverage probability.

[1]  İnci Okumuş,et al.  Current status of wind energy forecasting and a hybrid method for hourly predictions , 2016 .

[2]  P Pinson,et al.  Conditional Prediction Intervals of Wind Power Generation , 2010, IEEE Transactions on Power Systems.

[3]  J. Friedman Stochastic gradient boosting , 2002 .

[4]  N. D. Hatziargyriou,et al.  Probabilistic Wind Power Forecasting Using Radial Basis Function Neural Networks , 2012, IEEE Transactions on Power Systems.

[5]  L. D. Monache,et al.  An analog ensemble for short-term probabilistic solar power forecast , 2015 .

[6]  Ahmet zk,et al.  A novel metaheuristic for multi-objective optimization problems , 2017 .

[7]  Felipe Valencia,et al.  Prediction interval based on type-2 fuzzy systems for wind power generation and loads in microgrid control design , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[8]  Adel Mellit,et al.  Artificial Intelligence technique for modelling and forecasting of solar radiation data: a review , 2008, Int. J. Artif. Intell. Soft Comput..

[9]  Henrik Madsen,et al.  Online short-term solar power forecasting , 2009 .

[10]  Henrik Madsen,et al.  Using quantile regression to extend an existing wind power forecasting system with probabilistic forecasts , 2006 .

[11]  Songfeng Zheng,et al.  QBoost: Predicting quantiles with boosting for regression and binary classification , 2012, Expert Syst. Appl..

[12]  Zhao Xu,et al.  Direct Interval Forecasting of Wind Power , 2013, IEEE Transactions on Power Systems.

[13]  Nicolai Meinshausen,et al.  Quantile Regression Forests , 2006, J. Mach. Learn. Res..

[14]  Jianxue Wang,et al.  Review on probabilistic forecasting of wind power generation , 2014 .

[15]  Prospero C. Naval,et al.  An effective use of crowding distance in multiobjective particle swarm optimization , 2005, GECCO '05.

[16]  M. R. Aghaebrahimi,et al.  A fuzzy discrete harmony search algorithm applied to annual cost reduction in radial distribution systems , 2016 .

[17]  Saeid Nahavandi,et al.  A novel fuzzy multi-objective framework to construct optimal prediction intervals for wind power forecast , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[18]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[19]  Carlos F.M. Coimbra,et al.  Hybrid solar forecasting method uses satellite imaging and ground telemetry as inputs to ANNs , 2013 .

[20]  Taher Niknam,et al.  Probabilistic wind power forecasting using a novel hybrid intelligent method , 2016, Neural Computing and Applications.

[21]  Henrik Madsen,et al.  A review on the young history of the wind power short-term prediction , 2008 .

[22]  Alireza Alfi,et al.  A memetic algorithm applied to trajectory control by tuning of Fractional Order Proportional-Integral-Derivative controllers , 2015, Appl. Soft Comput..

[23]  Georges Kariniotakis,et al.  Probabilistic short-term wind power forecasting based on kernel density estimators , 2007 .

[24]  H. Pedro,et al.  Assessment of forecasting techniques for solar power production with no exogenous inputs , 2012 .

[25]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[26]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[27]  Pierre Pinson,et al.  Wind Energy: Forecasting Challenges for Its Operational Management , 2013, 1312.6471.

[28]  Zhao Xu,et al.  Optimal Granule-Based PIs Construction for Solar Irradiance Forecast , 2016, IEEE Transactions on Power Systems.

[29]  Matthias Schonlau,et al.  Boosted Regression (Boosting): An Introductory Tutorial and a Stata Plugin , 2005 .

[30]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[31]  John Bjørnar Bremnes,et al.  Probabilistic wind power forecasts using local quantile regression , 2004 .

[32]  Carlos F.M. Coimbra,et al.  Real-time prediction intervals for intra-hour DNI forecasts , 2015 .

[33]  Saeid Nahavandi,et al.  Combined Nonparametric Prediction Intervals for Wind Power Generation , 2013, IEEE Transactions on Sustainable Energy.

[34]  Za'er Salim Abo-Hammour,et al.  Numerical solution of systems of second-order boundary value problems using continuous genetic algorithm , 2014, Inf. Sci..

[35]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[36]  David Pozo-Vázquez,et al.  An evolutionary artificial neural network ensemble model for estimating hourly direct normal irradiances from meteosat imagery , 2015 .

[37]  José R. Dorronsoro,et al.  Hybrid machine learning forecasting of solar radiation values , 2016, Neurocomputing.

[38]  A. McGovern,et al.  Solar Energy Prediction: An International Contest to Initiate Interdisciplinary Research on Compelling Meteorological Problems , 2015 .

[39]  Guido Carpinelli,et al.  A Bayesian Method for Short-Term Probabilistic Forecasting of Photovoltaic Generation in Smart Grid Operation and Control , 2013 .

[40]  Kit Po Wong,et al.  Probabilistic Forecasting of Wind Power Generation Using Extreme Learning Machine , 2014, IEEE Transactions on Power Systems.

[41]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[42]  Aliasghar Arab,et al.  An adaptive gradient descent-based local search in memetic algorithm applied to optimal controller design , 2015, Inf. Sci..

[43]  C. Coimbra,et al.  Forecasting of global and direct solar irradiance using stochastic learning methods, ground experiments and the NWS database , 2011 .

[44]  Ali Sadollah,et al.  Gradient-based Water Cycle Algorithm with evaporation rate applied to chaos suppression , 2017, Appl. Soft Comput..

[45]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[46]  A. Mellit,et al.  A 24-h forecast of solar irradiance using artificial neural network: Application for performance prediction of a grid-connected PV plant at Trieste, Italy , 2010 .

[47]  Álvaro Alonso,et al.  Random Forests and Gradient Boosting for Wind Energy Prediction , 2015, HAIS.

[48]  Inés María Galván,et al.  Machine learning techniques for daily solar energy prediction and interpolation using numerical weather models , 2016, Concurr. Comput. Pract. Exp..

[49]  Richard A. Berk,et al.  Boosting the Quantile Distribution: A Cost-Sensitive Statistical Learning Procedure , 2007 .