Optimized Deep Stacked Long Short-Term Memory Network for Long-Term Load Forecasting

Long-term load forecasting (LTLF) is an essential process for strategical planning of the future needed extension in the power systems of any country. Besides, deep learning has become the heart of the machine learning paradigm, which is wildly used nowadays in many fields, and it also has become the current revolution in Artificial Intelligence (AI). In this paper, an optimized deep learning model based on Stacked Long Short-Term Memory Network (SLSTMN) is proposed. The architecture of the model is optimized to get the best configuration using Genetic Algorithm (GA). In addition, the hyperparameters of the model network are optimized using many deep learning techniques. During the optimization process, hundreds of model configurations are tested. The accuracy of this model is compared with many deep learning models and is compared against the related work in the field of LTLF. The dataset of the South Australia State (SA) power system is used to test the compared models. This data includes maximum daily load, daily maximum temperature, daily minimum temperature, weekday, the month, and holidays for 12 years from 2005 to 2016. SLSTMN achieves excellent accuracy and the lowest error value (almost 1%) when compared with other models on the same dataset and with related work models on different datasets.

[1]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[2]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[5]  Mark Lutz,et al.  Learning Python , 1999 .

[6]  B. Kermanshahi,et al.  Up to year 2020 load forecasting using neural nets , 2002 .

[7]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[8]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[9]  S. A. Soliman,et al.  Long-term/mid-term electric load forecasting based on short-term correlation and annual growth , 2005 .

[10]  Y.H. Kareem,et al.  Monthly Peak-load Demand Forecasting for Sulaimany Governorate Using SARIMA. , 2006, 2006 IEEE/PES Transmission & Distribution Conference and Exposition: Latin America.

[11]  Y. Yao,et al.  On Early Stopping in Gradient Descent Learning , 2007 .

[12]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[13]  Tharam S. Dillon,et al.  Cloud Computing: Issues and Challenges , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[14]  Lambros Ekonomou,et al.  Greek long-term energy consumption prediction using artificial neural networks , 2010 .

[15]  Q. Henry Wu,et al.  Electric Load Forecasting Based on Locally Weighted Support Vector Regression , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Adem Alpaslan Altun,et al.  Long Term Electricity Demand Forecasting in Turkey Using Artificial Neural Networks , 2010 .

[17]  Toly Chen,et al.  Long-term load forecasting by a collaborative fuzzy-neural approach , 2012 .

[18]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[20]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[21]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[22]  Haidar Samet,et al.  A new hybrid Modified Firefly Algorithm and Support Vector Regression model for accurate Short Term Load Forecasting , 2014, Expert Syst. Appl..

[23]  Bernard Marr,et al.  Big Data: Using SMART Big Data, Analytics and Metrics To Make Better Decisions and Improve Performance , 2015 .

[24]  G. Ravi,et al.  Long-term Sector-wise Electrical Energy Forecasting Using Artificial Neural Network and Biogeography-based Optimization , 2015 .

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Woo Joo Lee,et al.  A hybrid dynamic and fuzzy time series model for mid-term power load forecasting , 2015 .

[27]  Swasti R. Khuntia,et al.  Forecasting the load of electrical power systems in mid- and long-term horizons : A review , 2016 .

[28]  Nadir Farah,et al.  Mid-Long Term Load Forecasting using Multi-Model Artificial Neural Networks , 2016 .

[29]  Danladi Ali,et al.  Long-term load forecast modelling using a fuzzy logic approach , 2016 .

[30]  Yang Wang,et al.  Short-Term Load-Forecasting Method Based on Wavelet Decomposition With Second-Order Gray Neural Network Model Combined With ADF Test , 2017, IEEE Access.

[31]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[32]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[33]  Keith W. Hipel,et al.  Long short term memory networks for short-term electric load forecasting , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[34]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[35]  Ping-Huan Kuo,et al.  A High Precision Artificial Neural Networks Model for Short-Term Energy Load Forecasting , 2018 .

[36]  David J. Hill,et al.  Short-Term Residential Load Forecasting Based on Resident Behaviour Learning , 2018, IEEE Transactions on Power Systems.

[37]  Eduard Muljadi,et al.  A Short-Term and High-Resolution Distribution System Load Forecasting Approach Using Support Vector Regression With Hybrid Parameters Optimization , 2018, IEEE Transactions on Smart Grid.

[38]  Yuexing Peng,et al.  Enhanced Deep Networks for Short-Term and Medium-Term Load Forecasting , 2019, IEEE Access.

[39]  Wenhu Tang,et al.  Deep Learning for Daily Peak Load Forecasting–A Novel Gated Recurrent Neural Network Combining Dynamic Time Warping , 2019, IEEE Access.

[40]  Ping-Huan Kuo,et al.  Multiple-Input Deep Convolutional Neural Network Model for Short-Term Photovoltaic Power Forecasting , 2019, IEEE Access.

[41]  Qigao Fan,et al.  Long term electric load forecasting based on TS-type recurrent fuzzy neural network model , 2020 .

[42]  Ehab E. Elattar,et al.  Short term electric load forecasting using hybrid algorithm for smart cities , 2020, Applied Intelligence.

[43]  Supari Muslim,et al.  Generalized Regression Neural Network For Long-Term Electricity Load Forecasting , 2020, 2020 International Conference on Smart Technology and Applications (ICoSTA).

[44]  Turaj Amraee,et al.  A hybrid data mining driven algorithm for long term electric peak load and energy demand forecasting , 2020 .

[45]  Dewei Li,et al.  Feature-fusion-kernel-based Gaussian process model for probabilistic long-term load forecasting , 2020, Neurocomputing.

[46]  Ping-Huan Kuo,et al.  An Ensemble Model based on Deep Learning and Data Preprocessing for Short-Term Electrical Load Forecasting , 2021 .