Deep-Learning Forecasting Method for Electric Power Load via Attention-Based Encoder-Decoder with Bayesian Optimization

Short-term electrical load forecasting plays an important role in the safety, stability, and sustainability of the power production and scheduling process. An accurate prediction of power load can provide a reliable decision for power system management. To solve the limitation of the existing load forecasting methods in dealing with time-series data, causing the poor stability and non-ideal forecasting accuracy, this paper proposed an attention-based encoder-decoder network with Bayesian optimization to do the accurate short-term power load forecasting. Proposed model is based on an encoder-decoder architecture with a gated recurrent units (GRU) recurrent neural network with high robustness on time-series data modeling. The temporal attention layer focuses on the key features of input data that play a vital role in promoting the prediction accuracy for load forecasting. Finally, the Bayesian optimization method is used to confirm the model’s hyperparameters to achieve optimal predictions. The verification experiments of 24 h load forecasting with real power load data from American Electric Power (AEP) show that the proposed model outperforms other models in terms of prediction accuracy and algorithm stability, providing an effective approach for migrating time-serial power load prediction by deep-learning technology.

[1]  Yiqun Zhong,et al.  Study on power consumption load forecast based on K-means clustering and FCM–BP model , 2020 .

[2]  Tingli Su,et al.  Parallel deep prediction with covariance intersection fusion on non-stationary time series , 2021, Knowl. Based Syst..

[3]  Chunming Huang,et al.  The Comparison of Predicting Storm-Time Ionospheric TEC by Three Methods: ARIMA, LSTM, and Seq2Seq , 2020, Atmosphere.

[4]  Lovekesh Vig,et al.  LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection , 2016, ArXiv.

[5]  Samarjit Kar,et al.  A Hybridized Forecasting Method Based on Weight Adjustment of Neural Network Using Generalized Type-2 Fuzzy Set , 2018, Int. J. Fuzzy Syst..

[6]  Tingli Su,et al.  Distributed Deep Fusion Predictor for a Multi-Sensor System Based on Causality Entropy , 2021, Entropy.

[7]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[8]  Tingli Su,et al.  Deep Hybrid Model Based on EMD with Classification by Frequency Characteristics for Long-Term Air Quality Prediction , 2020, Mathematics.

[9]  Wei-Chiang Hong,et al.  Electric load forecasting by the SVR model with differential empirical mode decomposition and auto regression , 2016, Neurocomputing.

[10]  Ting-Li Su,et al.  Hybrid Deep Learning Predictor for Smart Agriculture Sensing Based on Empirical Mode Decomposition and Gated Recurrent Unit Group Model , 2020, Sensors.

[11]  Jean-François Toubeau,et al.  Very-Short-Term Probabilistic Forecasting for a Risk-Aware Participation in the Single Price Imbalance Settlement , 2020, IEEE Transactions on Power Systems.

[12]  Ting-Li Su,et al.  Online Denoising Based on the Second-Order Adaptive Statistics Model , 2017, Sensors.

[13]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[14]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[15]  Yongli Wang,et al.  Short-term power load forecasting based on IVL-BP neural network technology , 2012 .

[16]  Ning Zhang,et al.  Probabilistic individual load forecasting using pinball loss guided LSTM , 2019, Applied Energy.

[17]  Qiang Zhang,et al.  Empirical mode decomposition based hybrid ensemble model for electrical energy consumption forecasting of the cement grinding process , 2019, Measurement.

[18]  Ali Ouni,et al.  Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches † , 2018, Energies.

[19]  Mohammad Rastegar,et al.  Deep-Based Conditional Probability Density Function Forecasting of Residential Loads , 2020, IEEE Transactions on Smart Grid.

[20]  C. Holt.  Author's retrospective on ‘Forecasting seasonals and trends by exponentially weighted moving averages’ , 2004 .

[21]  Mohammad Moradzadeh,et al.  A Novel Technique for Load Frequency Control of Multi-Area Power Systems , 2020, Energies.

[22]  Xifeng Guo,et al.  A short-term load forecasting model of multi-scale CNN-LSTM hybrid neural network considering the real-time electricity price , 2020 .

[23]  ZhengMing Li,et al.  Short Term Prediction of Photovoltaic Power Based on FCM and CG-DBN Combination , 2019, Journal of Electrical Engineering & Technology.

[24]  Ejaz Ul Haq,et al.  Forecasting household electric appliances consumption and peak demand based on hybrid machine learning approach , 2020 .

[25]  Mohamed Morchid,et al.  Parsimonious memory unit for recurrent neural networks with application to natural language processing , 2018, Neurocomputing.

[26]  Jin Xuebo,et al.  Closed-Loop Estimation for Randomly Sampled Measurements in Target Tracking System , 2014 .

[27]  P. J. Santos,et al.  Designing the input vector to ANN-based models for short-term load forecast in electricity distribution systems , 2007 .

[28]  Zhengwei Li,et al.  Using Support Vector Machine to Predict Next Day Electricity Load of Public Buildings with Sub-metering Devices☆ , 2015 .

[29]  Kil To Chong,et al.  Forecasting of Power Demands Using Deep Learning , 2020, Applied Sciences.

[30]  Peter Stansby,et al.  Linear Non-Causal Optimal Control of an Attenuator Type Wave Energy Converter M4 , 2020, IEEE Transactions on Sustainable Energy.

[31]  Mehdi Khashei,et al.  A novel hybridization of artificial neural networks and ARIMA models for time series forecasting , 2011, Appl. Soft Comput..

[32]  Tianrui Li,et al.  Multivariate time series forecasting via attention-based encoder-decoder framework , 2020, Neurocomputing.

[33]  Pengfei Li,et al.  Ultra-Short-Term Load Demand Forecast Model Framework Based on Deep Learning , 2020, Energies.

[34]  Tingli Su,et al.  Pedestrian motion recognition via Conv-VLAD integrated spatial-temporal-relational network , 2020 .

[35]  Zhengfei Li,et al.  Study on deep reinforcement learning techniques for building energy consumption forecasting , 2020 .

[36]  Hua Cai,et al.  Power load demand response potential of secondary sectors in China: The case of western Inner Mongolia , 2020 .

[37]  Yuqing Chang,et al.  Gated Recurrent Unit Network-Based Short-Term Photovoltaic Forecasting , 2018, Energies.

[38]  Chongqing Kang,et al.  Implications of COVID-19 for the electricity industry: A comprehensive review , 2020 .

[39]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[40]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[41]  Jia-Shu Zhang,et al.  Predicting Chaotic Time Series Using Recurrent Neural Network , 2000 .

[42]  M. A. Rafe Biswas,et al.  Regression analysis for prediction of residential energy consumption , 2015 .

[43]  Asaf Shabtai,et al.  Using LSTM Encoder-Decoder Algorithm for Detecting Anomalous ADS-B Messages , 2017, Comput. Secur..

[44]  Xue-Bo Jin,et al.  Deep-Learning Prediction Model with Serial Two-Level Decomposition Based on Bayesian Optimization , 2020, Complex..

[45]  Jean-François Toubeau,et al.  Deep Learning-Based Multivariate Probabilistic Forecasting for Short-Term Scheduling in Power Markets , 2019, IEEE Transactions on Power Systems.

[46]  Vivek Srikumar,et al.  Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks , 2018 .

[47]  Min Zuo,et al.  CropDeep: The Crop Vision Dataset for Deep-Learning-Based Classification and Detection in Precision Agriculture , 2019, Sensors.

[48]  Zijian Liu,et al.  A deep learning based multitask model for network-wide traffic speed prediction , 2020, Neurocomputing.

[49]  Tingli Su,et al.  Integrated Predictor Based on Decomposition Mechanism for PM2.5 Long-Term Prediction , 2019, Applied Sciences.

[50]  Garrison W. Cottrell,et al.  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction , 2017, IJCAI.

[51]  H. Abbasimehr,et al.  Prediction of COVID-19 confirmed cases combining deep learning methods and Bayesian optimization , 2020, Chaos, Solitons & Fractals.

[52]  Yunfei Ding,et al.  Analysis of hourly cooling load prediction accuracy with data-mining approaches on different training time scales , 2019, Sustainable Cities and Society.