Online Ensemble Learning for Load Forecasting

Traditionally, load forecasting models are trained offline and generate predictions online. However, the pure batch learning approach fails to incorporate new load information available in real-time. Conversely, online learning allows for efficient adaptation of newly incoming information. This letter advocates a novel online ensemble learning approach for load forecasting by combining batch and online learning. While the individual batch models provide an appropriate forecast basis, the online ensemble combines their predictions and ensures adaptivity for online application. In that respect, we propose a modified Passive Aggressive Regression (PAR) model to implement the online ensemble forecasting. Case studies on a real-world load dataset show that the proposed method can improve the forecasting accuracy significantly compared to a pure batch learning approach.

[1]  Hwa Jen Yap,et al.  Daily maximum load forecasting of consecutive national holidays using OSELM-based multi-agents system with weighted average strategy , 2012, Neurocomputing.

[2]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[3]  C.P. Lim,et al.  Short Term Load Forecasting Using a Hybrid Neural Network , 2006, 2006 IEEE International Power and Energy Conference.

[4]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[5]  Jun Hu,et al.  Short-Term Load Forecasting With Deep Residual Networks , 2018, IEEE Transactions on Smart Grid.

[6]  Charu C. Aggarwal,et al.  On the Surprising Behavior of Distance Metrics in High Dimensional Spaces , 2001, ICDT.

[7]  Chongqing Kang,et al.  An Ensemble Forecasting Method for the Aggregated Load With Subprofiles , 2018, IEEE Transactions on Smart Grid.

[8]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[9]  Manfred K. Warmuth,et al.  Exponentiated Gradient Versus Gradient Descent for Linear Predictors , 1997, Inf. Comput..

[10]  Jinxing Che,et al.  An incremental electric load forecasting model based on support vector regression , 2016 .

[11]  Sokratis Papadopoulos,et al.  Short-term electricity load forecasting using time series and ensemble learning methods , 2015, 2015 IEEE Power and Energy Conference at Illinois (PECI).

[12]  Yi Wang,et al.  Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges , 2018, IEEE Transactions on Smart Grid.

[13]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[14]  Adela Bâra,et al.  Machine Learning Algorithms for Short-Term Load Forecast in Residential Buildings Using Smart Meters, Sensors and Big Data Solutions , 2019, IEEE Access.

[15]  R. M. Nelms,et al.  Ensemble Learning for Load Forecasting , 2020, IEEE Transactions on Green Communications and Networking.

[16]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[17]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..