Effect of automatic hyperparameter tuning for residential load forecasting via deep learning

Short-term residential load forecasting is becoming increasingly important as we are advancing to an era where the penetration of renewable energy keeps increasing and will become ubiquitous in our day-to-day energy consumption. In this future grid scenario, individual load forecasting is more critical than load forecasting on system level because many renewable energy sources (RESs) are generally distributed, and it is most efficient to consume the renewable generation at the sites of energy production. Despite there have been many works in short-term load forecasting (STLF), few of them target the problem on the end-use level. Also, deep learning has started to be proposed in STLF, but the common problem for deep learning, the selection of many hyperparameters, is rarely discussed. In this paper, we extend a deep long short-term memory (LSTM) based load forecasting framework with automatic hyperparameter tuning to address the STLF problem for the highly volatile residential load. A tree-structured Parzen estimator based hyper-parameter tuning method is integrated into the STLF framework to efficiently find the best set of hyper-parameters for better forecasting performance.

[1]  David J. Hill,et al.  Short-Term Residential Load Forecasting Based on Resident Behaviour Learning , 2018, IEEE Transactions on Power Systems.

[2]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[3]  Iain MacGill,et al.  Coordinated Scheduling of Residential Distributed Energy Resources to Optimize Smart Home Energy Services , 2010, IEEE Transactions on Smart Grid.

[4]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[5]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[6]  João Luiz Afonso,et al.  Smart electric vehicle charging system , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  K. Raahemifar,et al.  On Efficient Tuning of LS-SVM Hyper-Parameters in Short-Term Load Forecasting: A Comparative Study , 2007, 2007 IEEE Power Engineering Society General Meeting.

[8]  Rui Zhang,et al.  Short-term load forecasting of Australian National Electricity Market by an ensemble model of extreme learning machine , 2013 .

[9]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[10]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[11]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[12]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[13]  M. Etezadi-Amoli,et al.  Smart meter based short-term load forecasting for residential customers , 2011, 2011 North American Power Symposium.

[14]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Zhao Xu,et al.  Optimal operation scheduling for microgrid with high penetrations of solar power and thermostatically controlled loads , 2016 .

[16]  Hongseok Kim,et al.  Deep Neural Network Based Demand Side Short Term Load Forecasting , 2016 .

[17]  Mohamed Chaouch,et al.  Clustering-Based Improvement of Nonparametric Functional Time Series Forecasting: Application to Intra-Day Household-Level Load Curves , 2014, IEEE Transactions on Smart Grid.

[18]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[19]  Matthew Rowe,et al.  The Real-Time Optimisation of DNO Owned Storage Devices on the LV Network for Peak Reduction , 2014 .

[20]  David D. Cox,et al.  Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms , 2013, SciPy.