Forecasting electricity consumption by aggregating specialized experts A review of the sequential aggregation of specialized experts, with an application to Slovakian and French country-wide one-day-ahead (half-)hourly predictions

We consider the setting of sequential prediction of arbitrary sequences based on specialized experts. We first provide a review of the relevant literature and present two theoretical contributions: a general analysis of the specialist aggregation rule of Freund et al. [1997] and an adaptation of fixed-share rules of Herbster and Warmuth [1998] in this setting. We then apply these rules to the sequential short-term (one-day-ahead) forecasting of electricity consumption; to do so, we consider two data sets, a Slovakian one and a French one, respectively concerned with hourly and half-hourly predictions. We follow a general methodology to perform the stated empirical studies and detail in particular tuning issues of the learning parameters. The introduced aggregation rules demonstrate an improved accuracy on the data sets at hand; the improvements lie in a reduced mean squared error but also in a more robust behavior with respect to large occasional errors.

[1]  Mark Herbster,et al.  Tracking the Best Expert , 1995, Machine-mediated learning.

[2]  T. Cover Universal Portfolios , 1996 .

[3]  Yoram Singer,et al.  Using and combining predictors that specialize , 1997, STOC '97.

[4]  Allan Borodin,et al.  On the Competitive Theory and Practice of Portfolio Selection (Extended Abstract) , 2000, LATIN.

[5]  Claudio Gentile,et al.  Adaptive and Self-Confident On-Line Learning Algorithms , 2000, J. Comput. Syst. Sci..

[6]  Tommi S. Jaakkola,et al.  Online Learning of Non-stationary Sequences , 2003, NIPS.

[7]  Avrim Blum,et al.  Empirical Support for Winnow and Weighted-Majority Algorithms: Results on a Calendar Scheduling Domain , 2004, Machine Learning.

[8]  Nicolò Cesa-Bianchi,et al.  Potential-Based Algorithms in On-Line Prediction and Game Theory , 2003, Machine Learning.

[9]  Gábor Lugosi,et al.  Internal Regret in On-Line Portfolio Selection , 2005, Machine Learning.

[10]  Alexander Bruhns,et al.  A NON-LINEAR REGRESSION MODEL FOR MID-TERM LOAD FORECASTING AND IMPROVEMENTS IN SEASONALITY , 2005 .

[11]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[12]  David M. Pennock,et al.  An Empirical Comparison of Algorithms for Aggregating Expert Predictions , 2006, UAI.

[13]  S. Wood Generalized Additive Models: An Introduction with R , 2006 .

[14]  Yishay Mansour,et al.  From External to Internal Regret , 2005, J. Mach. Learn. Res..

[15]  S. Koopman,et al.  An Hourly Periodic State Space Model for Modelling French National Electricity Load , 2007 .

[16]  Gilles Stoltz,et al.  A Further Look at Sequential Aggregation Rules for Ozone Ensemble Forecasting , 2008 .

[17]  Vladimir Vovk,et al.  Prediction with expert advice for the Brier game , 2007, ICML '08.

[18]  Y. Goude Mélange de prédicteurs : application à la prévision de consommation d'électricité , 2008 .

[20]  Steven de Rooij,et al.  Learning the Switching Rate by Discretising Bernoulli Sources Online , 2009, AISTATS.

[21]  Vivien Mallet,et al.  Ozone ensemble forecast with machine learning algorithms , 2009 .

[22]  Vivien Mallet,et al.  Ensemble forecast of analyses: Coupling data assimilation and sequential aggregation , 2010 .

[23]  Claire Monteleoni,et al.  Tracking climate models , 2011, CIDU.

[24]  Robert D. Kleinberg,et al.  Regret bounds for sleeping experts and bandits , 2010, Machine Learning.

[25]  Abigail Z. Jacobs Adapting to non-stationarity with growing predictor ensembles , 2011 .

[26]  Zhiyuan Luo,et al.  Time series prediction with performance guarantee , 2011, IET Commun..

[27]  A further look at the forecasting of the electricity consumption by aggregation of specialized experts , 2012 .

[28]  Anestis Antoniadis,et al.  Clustering Functional Data using Wavelets , 2010, Int. J. Wavelets Multiresolution Inf. Process..