Deep Learning for Daily Peak Load Forecasting–A Novel Gated Recurrent Neural Network Combining Dynamic Time Warping

Daily peak load forecasting is an essential tool for decision making in power system operation and planning. However, the daily peak load is a nonlinear, nonstationary, and volatile time series, which makes it difficult to be forecasted accurately. This paper, for the first time, proposes a bespoke gated recurrent neural network combining dynamic time warping (DTW) for accurate daily peak load forecasting. The shape-based DTW distance is used to match the most similar load curve, which can capture trends in load changes. By analyzing the relationship between the load curve and the cycle of human social activities, the some-hot encoding scheme is first applied on the discrete variables to expand the features to further characterize their impact on load curves. Then, a three-layer gated recurrent neural network is developed to forecast daily peak load. The proposed algorithm is implemented on the Theano deep learning platform and tested on the loaded dataset of the European Network on Intelligent Technologies. The simulation results show that the proposed algorithm achieves satisfactory results compared with other algorithms using the same dataset in this paper.

[1]  Q. Henry Wu,et al.  Electric Load Forecasting Based on Locally Weighted Support Vector Regression , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Paul H. Kupiec,et al.  Techniques for Verifying the Accuracy of Risk Measurement Models , 1995 .

[3]  Philip Heng Wai Leong,et al.  A Hybrid Feature Selection and Generation Algorithm for Electricity Load Prediction Using Grammatical Evolution , 2013, 2013 12th International Conference on Machine Learning and Applications.

[4]  Xiaobo Zhang,et al.  Short-term electric load forecasting based on singular spectrum analysis and support vector machine optimized by Cuckoo search algorithm , 2017 .

[5]  Tao Hong,et al.  Long Term Probabilistic Load Forecasting and Normalization With Hourly Information , 2014, IEEE Transactions on Smart Grid.

[6]  Ming-Wei Chang,et al.  Load forecasting using support vector Machines: a study on EUNITE competition 2001 , 2004, IEEE Transactions on Power Systems.

[7]  Juho Kim,et al.  Kapre: On-GPU Audio Preprocessing Layers for a Quick Implementation of Deep Neural Network Models with Keras , 2017, ArXiv.

[8]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[9]  R. H. Myers,et al.  Probability and Statistics for Engineers and Scientists , 1978 .

[10]  Lior Wolf,et al.  Channel-Level Acceleration of Deep Face Representations , 2015, IEEE Access.

[11]  Heng Huang,et al.  Using Smart Meter Data to Improve the Accuracy of Intraday Load Forecasting Considering Customer Behavior Similarities , 2015, IEEE Transactions on Smart Grid.

[12]  Danladi Ali,et al.  Long-term load forecast modelling using a fuzzy logic approach , 2016 .

[13]  Antonello Rizzi,et al.  Short-Term Electric Load Forecasting Using Echo State Networks and PCA Decomposition , 2015, IEEE Access.

[14]  Gafar Zen Alabdeen Salh,et al.  Voice Recognition using Dynamic Time Warping and Mel-Frequency Cepstral Coefficients Algorithms , 2015 .

[15]  Ying Chen,et al.  Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks , 2010, IEEE Transactions on Power Systems.

[16]  Iñigo Monedero,et al.  Detection of frauds and other non-technical losses in a power utility using Pearson coefficient, Bayesian networks and decision trees , 2012 .

[17]  Fernando Santos Osório,et al.  GPU-Services: GPU Based Real-Time Processing of 3D Point Clouds Applied to Robotic Systems and Intelligent Vehicles , 2016 .

[18]  Witold Pedrycz,et al.  An area-based shape distance measure of time series , 2016, Appl. Soft Comput..

[19]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[20]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[21]  Yuancheng Li,et al.  A Short Term Load Forecasting Model Using Core Vector Regression Optimized by Memetic Algorithm , 2016 .

[22]  Xiao-Jun Zeng,et al.  Short-Term and Midterm Load Forecasting Using a Bilevel Optimization Model , 2009, IEEE Transactions on Power Systems.

[23]  Jun Li,et al.  Short Term Electric Load Prediction by Incorporation of Kernel into Features Extraction Regression Technique , 2017 .

[24]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[25]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[26]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[27]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[28]  Martin A. Riedmiller,et al.  Deep auto-encoder neural networks in reinforcement learning , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[29]  Yusuf Yaslan,et al.  A hybrid method for time series prediction using EMD and SVR , 2014, 2014 6th International Symposium on Communications, Control and Signal Processing (ISCCSP).

[30]  G. W. Hughes,et al.  Minimum Prediction Residual Principle Applied to Speech Recognition , 1975 .

[31]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[32]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[33]  Shie-Jue Lee,et al.  A weighted LS-SVM based learning system for time series forecasting , 2015, Inf. Sci..

[34]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[35]  G. Jang,et al.  Short-term load forecasting for the holidays using fuzzy linear regression method , 2005, IEEE Transactions on Power Systems.

[36]  Mohamed Chaouch,et al.  Clustering-Based Improvement of Nonparametric Functional Time Series Forecasting: Application to Intra-Day Household-Level Load Curves , 2014, IEEE Transactions on Smart Grid.

[37]  Xiaopeng Wei,et al.  Predicting the Risk of Heart Failure With EHR Sequential Data Modeling , 2018, IEEE Access.

[38]  Hai-shan Wu,et al.  Power Load Forecasting with Least Squares Support Vector Machines and Chaos Theory , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[39]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[40]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[41]  Yang Wang,et al.  Short-Term Load-Forecasting Method Based on Wavelet Decomposition With Second-Order Gray Neural Network Model Combined With ADF Test , 2017, IEEE Access.

[42]  Herna L. Viktor,et al.  Spectral Clustering: An Explorative Study of Proximity Measures , 2011, IC3K.

[43]  David J. Hill,et al.  Short-Term Residential Load Forecasting Based on Resident Behaviour Learning , 2018, IEEE Transactions on Power Systems.

[44]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[45]  Tetsuya Ogata,et al.  Audio-visual speech recognition using deep learning , 2014, Applied Intelligence.

[46]  Jean-François Mari,et al.  An N-best strategy, dynamic grammars and selectively trained neural networks for real-time recognition of continuously spelled names over the telephone , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.