One model fits all: Individualized household energy demand forecasting with a single deep learning model

Energy demand forecasting at the household level is an important issue in smart energy grids to facilitate applications such as residential Demand Response (DR). However, if a separate machine learning model is trained for each house, the erratic nature of some consumers will lead to significant inaccuracies for the respective models, while predictions for new households with scarce data will not be possible to generate. In this work, we propose an approach with a single deep learning model that is trained on multiple households, which can create hourly energy consumption forecasts for individual households. We present a novel architecture that combines a Recurrent Neural Network (RNN) encoder and a Multilayer Perceptron (MLP). Our approach captures both the impact of past consumption time-series and that of energy profiles on future energy demand. Our model incorporates energy profiles to derive different characteristics between consumers, and it features a "double" clustering procedure that is specially designed for a mixture of time-series and non-time-series data. Experiments with real smart meter data show that the proposed neural network architecture achieves high performance in predicting energy consumption both for known and new consumers not present in the training dataset, with a Mean Absolute Percentage Error (MAPE) of 10.1% and 12.5% respectively.

[1]  Jun Jason Zhang,et al.  Evolutionary Deep Learning-Based Energy Consumption Prediction for Buildings , 2019, IEEE Access.

[2]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[3]  Sanjay Lall,et al.  Shape-Based Approach to Household Electric Load Curve Clustering and Prediction , 2017, IEEE Transactions on Smart Grid.

[4]  Sung Wook Baik,et al.  Multiple Electric Energy Consumption Forecasting Using a Cluster-Based Strategy for Transfer Learning in Smart Building , 2020, Sensors.

[5]  Thorsten Staake,et al.  Feature extraction and filtering for household classification based on smart electricity meter data , 2014, Computer Science - Research and Development.

[6]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[8]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[9]  Yacine Rezgui,et al.  Trees vs Neurons: Comparison between random forest and ANN for high-resolution prediction of building energy consumption , 2017 .

[10]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[11]  Silvia Santini,et al.  Automatic socio-economic classification of households using electricity consumption data , 2013, e-Energy '13.

[12]  Valentin Flunkert,et al.  DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks , 2017, International Journal of Forecasting.

[13]  Peter Grindrod,et al.  Analysis and Clustering of Residential Customers Energy Behavioral Demand Using Smart Meter Data , 2016, IEEE Transactions on Smart Grid.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[16]  Zeyu Wang,et al.  Random Forest based hourly building energy prediction , 2018, Energy and Buildings.

[17]  Shengwei Wang,et al.  Development of prediction models for next-day building energy consumption and peak power demand using data mining techniques , 2014 .

[18]  Muralitharan Krishnan,et al.  Neural network based optimization approach for energy demand prediction in smart grid , 2018, Neurocomputing.

[19]  Thorsten Staake,et al.  Enhancing energy efficiency in the residential sector with smart meter data analytics , 2018, Electronic Markets.

[20]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[21]  P. Cramton Electricity market design , 2017 .

[22]  Chandra Sekhar,et al.  k-Shape clustering algorithm for building energy usage patterns analysis and forecasting model accuracy improvement , 2017 .

[23]  George C. Polyzos,et al.  Mobile Apps Meet the Smart Energy Grid: A Survey on Consumer Engagement and Machine Learning Applications , 2020, IEEE Access.

[24]  M. W Gardner,et al.  Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences , 1998 .

[25]  Peter C. Jurs,et al.  New index for clustering tendency and its application to chemical problems , 1990, J. Chem. Inf. Comput. Sci..

[26]  Tao Hong,et al.  Probabilistic electric load forecasting: A tutorial review , 2016 .

[27]  Jianqiang Yi,et al.  Building Energy Consumption Prediction: An Extreme Deep Learning Approach , 2017 .