Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network

As the power system is facing a transition toward a more intelligent, flexible, and interactive system with higher penetration of renewable energy generation, load forecasting, especially short-term load forecasting for individual electric customers plays an increasingly essential role in the future grid planning and operation. Other than aggregated residential load in a large scale, forecasting an electric load of a single energy user is fairly challenging due to the high volatility and uncertainty involved. In this paper, we propose a long short-term memory (LSTM) recurrent neural network-based framework, which is the latest and one of the most popular techniques of deep learning, to tackle this tricky issue. The proposed framework is tested on a publicly available set of real residential smart meter data, of which the performance is comprehensively compared to various benchmarks including the state-of-the-arts in the field of load forecasting. As a result, the proposed LSTM approach outperforms the other listed rival algorithms in the task of short-term load forecasting for individual residential households.

[1]  Weicong Kong,et al.  A composite k-nearest neighbor model for day-ahead load forecasting with limited temperature forecasts , 2016, 2016 IEEE Power and Energy Society General Meeting (PESGM).

[2]  Heng Huang,et al.  Using Smart Meter Data to Improve the Accuracy of Intraday Load Forecasting Considering Customer Behavior Similarities , 2015, IEEE Transactions on Smart Grid.

[3]  Fahad H. Al-Qahtani,et al.  Multivariate k-nearest neighbour regression for time series data — A novel algorithm for forecasting UK electricity demand , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[4]  A. Arabali,et al.  A hybrid short-term load forecasting with a new input selection framework , 2015 .

[5]  Matthew D. Zeiler.  ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Hong Li,et al.  Short-term load forecasting based on the grid method and the time series fuzzy load forecasting method , 2015 .

[8]  Fei-Fei Li,et al.  Deep visual-semantic alignments for generating image descriptions , 2015, CVPR.

[9]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[10]  Mika Pantzar,et al.  The Dynamics of Social Practice: Everyday Life and how it Changes , 2012 .

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Zhou Quan,et al.  RBF Neural Network and ANFIS-Based Short-Term Load Forecasting Approach in Real-Time Price Environment , 2008, IEEE Transactions on Power Systems.

[13]  Zachary Chase Lipton.  A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[14]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[15]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[16]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[17]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[18]  H A Abyaneh,et al.  Effect of Load Models on Probabilistic Characterization of Aggregated Load Patterns , 2011, IEEE Transactions on Power Systems.

[19]  Rui Zhang,et al.  Short-term load forecasting of Australian National Electricity Market by an ensemble model of extreme learning machine , 2013 .

[20]  Pang Qingle,et al.  Very Short-Term Load Forecasting Based on Neural Network and Rough Set , 2010, 2010 International Conference on Intelligent Computation Technology and Automation.

[21]  Siobhán Clarke,et al.  Residential electrical demand forecasting in very small scale: An evaluation of forecasting methods , 2013, 2013 2nd International Workshop on Software Engineering Challenges for the Smart Grid (SE4SG).

[22]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[23]  Hongseok Kim,et al.  Deep Neural Network Based Demand Side Short Term Load Forecasting , 2016 .

[24]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[25]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[26]  Mohamed Chaouch,et al.  Clustering-Based Improvement of Nonparametric Functional Time Series Forecasting: Application to Intra-Day Household-Level Load Curves , 2014, IEEE Transactions on Smart Grid.

[27]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[28]  Wei Xu,et al.  Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN) , 2014, ICLR.

[29]  Xiaojun Wang,et al.  Short-term load forecasting based on big data technologies , 2015 .

[30]  M. Etezadi-Amoli,et al.  Smart meter based short-term load forecasting for residential customers , 2011, 2011 North American Power Symposium.

[31]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Matthew Rowe,et al.  The Real-Time Optimisation of DNO Owned Storage Devices on the LV Network for Peak Reduction , 2014 .

[34]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[35]  Yinan Jing,et al.  A Data-Driven Hybrid Optimization Model for Short-Term Residential Load Forecasting , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[36]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[37]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[38]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[39]  Bruce Stephen,et al.  Incorporating Practice Theory in Sub-Profile Models for Short Term Aggregated Residential Load Forecasting , 2017, IEEE Transactions on Smart Grid.