3ETS+RD-LSTM: A New Hybrid Model for Electrical Energy Consumption Forecasting

This work presents an extended hybrid and hierarchical deep learning model for electrical energy consumption forecasting. The model combines initial time series (TS) decomposition, exponential smoothing (ETS) for forecasting trend and dispersion components, ETS for deseasonalization, advanced long short-term memory (LSTM), and ensembling. Multi-layer LSTM is equipped with dilated recurrent skip connections and a spatial shortcut path from lower layers to allow the model to better capture long-term seasonal relationships and ensure more efficient training. Deseasonalization and LSTM are combined in a simultaneous learning process using stochastic gradient descent (SGD) which leads to learning TS representations and mapping at the same time. To deal with a forecast bias, an asymmetric pinball loss function was applied. Three-level ensembling provides a powerful regularization reducing the model variance. A simulation study performed on the monthly electricity demand TS for 35 European countries demonstrates a high performance of the proposed model. It generates more accurate forecasts than its predecessor (ETS+RD-LSTM [1]), statistical models such as ARIMA and ETS as well as state-of-the-art models based on machine learning (ML).

[1]  L. Suganthi,et al.  Energy models for demand forecasting—A review , 2012 .

[2]  Rob J. Hyndman,et al.  Forecasting with Exponential Smoothing , 2008 .

[3]  Eva Gonzalez-Romera,et al.  Monthly electric energy demand forecasting with neural networks and Fourier series , 2008 .

[4]  Christoph Bergmeir,et al.  Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directions , 2019, ArXiv.

[5]  Ning Jin,et al.  Multi-Step Short-Term Power Consumption Forecasting with a Hybrid Deep Learning Strategy , 2018, Energies.

[6]  Grzegorz Dudek,et al.  Pattern-based Long Short-term Memory for Mid-term Electrical Load Forecasting , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[7]  Mihai Gavrilas,et al.  Medium-term load forecasting with artificial neural network models , 2001 .

[8]  Grzegorz Dudek,et al.  Pattern-Based Forecasting Monthly Electricity Demand Using Multilayer Perceptron , 2019, ICAISC.

[9]  Jeng-Fung Chen,et al.  Forecasting Monthly Electricity Demands: An Application of Neural Networks Trained by Heuristic Algorithms , 2017, Inf..

[10]  Durga Toshniwal,et al.  Empirical Mode Decomposition Based Deep Learning for Electricity Demand Forecasting , 2018, IEEE Access.

[11]  Keith W. Hipel,et al.  Long short term memory networks for short-term electric load forecasting , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[12]  Long Chen,et al.  Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation , 2017 .

[13]  Nicolas Chapados,et al.  N-BEATS: Neural basis expansion analysis for interpretable time series forecasting , 2019, ICLR.

[14]  Jungwon Lee,et al.  Residual LSTM: Design of a Deep Recurrent Architecture for Distant Speech Recognition , 2017, INTERSPEECH.

[15]  Grzegorz Dudek,et al.  Neuro-Fuzzy System for Medium-Term Electric Energy Demand Forecasting , 2017, ISAT.

[16]  E. Doveh,et al.  Experience with FNN models for medium term power demand predictions , 1999 .

[17]  Grzegorz Dudek,et al.  Medium-Term Electric Energy Demand Forecasting Using Generalized Regression Neural Network , 2018 .

[18]  Slawek Smyl,et al.  A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting , 2020, International Journal of Forecasting.

[19]  Evangelos Spiliotis,et al.  The M4 Competition: Results, findings, conclusion and way forward , 2018, International Journal of Forecasting.

[20]  Pei-Chann Chang,et al.  Monthly electricity demand forecasting based on a weighted evolving fuzzy neural network approach , 2011 .

[21]  Tanveer Ahmad,et al.  Potential of three variant machine-learning models for forecasting district level medium-term and long-term energy demand in smart grid environment , 2018, Energy.

[22]  Rob J Hyndman,et al.  Forecasting with Exponential Smoothing: The State Space Approach , 2008 .

[23]  E. H. Barakat,et al.  Modeling of nonstationary time-series data. Part II. Dynamic periodic trends , 2001 .