An electricity load forecasting model based on multilayer dilated LSTM network and attention mechanism

From national development to daily life, electric energy is integral to people’s lives. Although the development of electricity should be expected, expansion without restriction will only result in energy waste. The forecasting of electricity load plays an important role in the adjustment of power enterprises’ strategies and the stability of power operation. Recently, the electricity-related data acquisition system has been perfected, and the available load information has gradually reached the minute level. This means that the related load series lengthens and the time and spatial information of load become increasingly complex. In this paper, a load forecasting model based on multilayer dilated long and short-term memory neural network is established. The model uses a multilayer dilated structure to extract load information from long series and to extract information from different dimensions. Moreover, the attention mechanism is used to make the model pay closer attention to the key information in the series as an intermediate variable. Such structures can greatly alleviate the loss in the extraction of long time series information and make use of more valid historical information for future load forecasting. The proposed model is validated using two real datasets. According to load forecasting curves, error curve, and related indices, the proposed method is more accurate and stable in electricity load forecasting than the comparison methods.

[1]  Anindya Iqbal,et al.  Actual rating calculation of the zoom cloud meetings app using user reviews on google play store with sentiment annotation of BERT and hybridization of RNN and LSTM , 2023, Expert Syst. Appl..

[2]  Wei Huang,et al.  Ultra-short term power load forecasting based on CEEMDAN-SE and LSTM neural network , 2022, Energy and Buildings.

[3]  Yifang Yang,et al.  Application of LSTM Neural Network Technology Embedded in English Intelligent Translation , 2022, Computational intelligence and neuroscience.

[4]  Qiong Zhou,et al.  Improving the Bi-LSTM model with XGBoost and attention mechanism: A combined approach for short-term power load prediction , 2022, Appl. Soft Comput..

[5]  Y. Nakanishi,et al.  BiLSTM Multitask Learning-Based Combined Load Forecasting Considering the Loads Coupling Relationship for Multienergy System , 2022, IEEE Transactions on Smart Grid.

[6]  L. Chrifi-Alaoui,et al.  Predicting Energy Consumption Using LSTM, Multi-Layer GRU and Drop-GRU Neural Networks , 2022, Sensors.

[7]  Tomo Popović,et al.  Forecasting Day-Ahead Electricity Metrics with Artificial Neural Networks , 2022, Sensors.

[8]  Grzegorz Dudek,et al.  ES-dRNN: A Hybrid Exponential Smoothing and Dilated Recurrent Neural Network Model for Short-Term Load Forecasting , 2021, IEEE transactions on neural networks and learning systems.

[9]  Abheejeet Mohapatra,et al.  Data driven day-ahead electrical load forecasting through repeated wavelet transform assisted SVM model , 2021, Appl. Soft Comput..

[10]  Junfei Han,et al.  Load Forecasting Method of Integrated Energy System Based on CNN-BiLSTM with Attention Mechanism , 2021, 2021 3rd International Conference on Smart Power & Internet Energy Systems (SPIES).

[11]  Nooriya A. Mohammed,et al.  An adaptive backpropagation algorithm for long-term electricity load forecasting , 2021, Neural Comput. Appl..

[12]  Xiangjun Zeng,et al.  Short-term load forecasting of industrial customers based on SVMD and XGBoost , 2021, International Journal of Electrical Power & Energy Systems.

[13]  Stanislaw Osowski,et al.  High Precision LSTM Model for Short-Time Load Forecasting in Power Systems , 2021, Energies.

[14]  Maryam Imani,et al.  Electrical load-temperature CNN for residential load forecasting , 2021, Energy.

[15]  Lin Wang,et al.  Effective electricity load forecasting using enhanced double-reservoir echo state network , 2021, Eng. Appl. Artif. Intell..

[16]  Eenjun Hwang,et al.  An Attention-Based Multilayer GRU Model for Multistep-Ahead Short-Term Load Forecasting † , 2021, Sensors.

[17]  Sung Wook Baik,et al.  Smart and intelligent energy monitoring systems: A comprehensive literature survey and future research guidelines , 2021, International Journal of Energy Research.

[18]  Zhao Ren,et al.  An attention‐based CNN‐LSTM‐BiLSTM model for short‐term electric load forecasting in integrated energy system , 2020 .

[19]  Tianrui Li,et al.  Multivariate time series forecasting via attention-based encoder-decoder framework , 2020, Neurocomputing.

[20]  Katarina Grolinger,et al.  Deep Learning for Load Forecasting: Sequence to Sequence Recurrent Neural Networks With Attention , 2020, IEEE Access.

[21]  Mustaqeem,et al.  A CNN-Assisted Enhanced Audio Signal Processing for Speech Emotion Recognition , 2019, Sensors.

[22]  Akbar Siami Namin,et al.  A Comparative Analysis of Forecasting Financial Time Series Using ARIMA, LSTM, and BiLSTM , 2019, ArXiv.

[23]  Sahm Kim,et al.  Short term electricity load forecasting for institutional buildings , 2019, Energy Reports.

[24]  Eenjun Hwang,et al.  A comparative analysis of artificial neural network architectures for building energy consumption forecasting , 2019, Int. J. Distributed Sens. Networks.

[25]  Ralf C. Staudemeyer,et al.  Understanding LSTM - a tutorial into Long Short-Term Memory Recurrent Neural Networks , 2019, ArXiv.

[26]  Nawaraj Kumar Mahato,et al.  Research on Short-Term Load Prediction Based on Seq2seq Model , 2019, Energies.

[27]  Nadeem Javaid,et al.  Electricity Load Forecasting for Each Day of Week Using Deep CNN , 2019, AINA Workshops.

[28]  K. Yin,et al.  Time series analysis and long short-term memory neural network to predict landslide displacement , 2019, Landslides.

[29]  Thomas S. Huang,et al.  Dilated Recurrent Neural Networks , 2017, NIPS.

[30]  Phuong H. Nguyen,et al.  A relevant data selection method for energy consumption prediction of low energy building based on support vector machine , 2017 .

[31]  Irena Koprinska,et al.  Forecasting electricity load with advanced wavelet neural networks , 2016, Neurocomputing.

[32]  Alex Pentland,et al.  Energy consumption prediction using people dynamics derived from cellular network data , 2016, EPJ Data Science.

[33]  Zafar A. Khan,et al.  Load forecasting, dynamic pricing and DSM in smart grid: A review , 2016 .

[34]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[35]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[36]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[37]  Jaime Lloret,et al.  A Survey on Electric Power Demand Forecasting: Future Trends in Smart Grids, Microgrids and Smart Buildings , 2014, IEEE Communications Surveys & Tutorials.

[38]  Li Wei,et al.  Based on Time Sequence of ARIMA Model in the Application of Short-Term Electricity Load Forecasting , 2009, 2009 International Conference on Research Challenges in Computer Science.

[39]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[40]  Zulfiqar Ahmad Khan,et al.  Efficient Short-Term Electricity Load Forecasting for Effective Energy Management , 2022, Sustainable Energy Technologies and Assessments.

[41]  De Xia,et al.  Effective energy consumption forecasting using empirical wavelet transform and long short-term memory , 2022 .

[42]  Slawek Smyl,et al.  A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting , 2020, International Journal of Forecasting.

[43]  Qiao Wei-de,et al.  Intelligent Pre-Estimation Method Study on Short-Period Power Load , 2008 .