Regression tree ensembles for wind energy and solar radiation prediction

Abstract The ability of ensemble models to retain the bias of their learners while decreasing their individual variance has long made them quite attractive in a number of classification and regression problems. In this work we will study the application of Random Forest Regression (RFR), Gradient Boosted Regression (GBR) and Extreme Gradient Boosting (XGB) to global and local wind energy prediction as well as to a solar radiation problem. Besides a complete exploration of the fundamentals of RFR, GBR and XGB, we will show experimentally that ensemble methods can improve on Support Vector Regression (SVR) for individual wind farm energy prediction, that GBR and XGB are competitive when the interest lies in predicting wind energy in a much larger geographical scale and, finally, that both gradient-based ensemble methods can improve on SVR in the solar radiation problem.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  S. N. Alamri,et al.  ANN-based modelling and estimation of daily global solar radiation data: A case study , 2009 .

[3]  Oliver Kramer,et al.  Comparing support vector regression for PV power forecasting to a physical modeling approach using measurement, numerical weather prediction, and cloud motion data , 2016 .

[4]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[5]  Yongqian Liu,et al.  Neural Network Ensemble Method Study for Wind Power Prediction , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[6]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[7]  Peter L. Bartlett,et al.  Boosting Algorithms as Gradient Descent in Function Space , 2007 .

[8]  J. Friedman Stochastic gradient boosting , 2002 .

[9]  Ivor W. Tsang,et al.  Diversified SVM Ensembles for Large Data Sets , 2006, ECML.

[10]  Aoife Foley,et al.  Current methods and advances in forecasting of wind power generation , 2012 .

[11]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[14]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[15]  Oliver Kramer,et al.  Precise Wind Power Prediction with SVM Ensemble Regression , 2014, ICANN.

[16]  Wei Qiao,et al.  Short-term solar power prediction using a support vector machine , 2013 .