Predicting residential energy consumption using CNN-LSTM neural networks

Abstract The rapid increase in human population and development in technology have sharply raised power consumption in today's world. Since electricity is consumed simultaneously as it is generated at the power plant, it is important to accurately predict the energy consumption in advance for stable power supply. In this paper, we propose a CNN-LSTM neural network that can extract spatial and temporal features to effectively predict the housing energy consumption. Experiments have shown that the CNN-LSTM neural network, which combines convolutional neural network (CNN) and long short-term memory (LSTM), can extract complex features of energy consumption. The CNN layer can extract the features between several variables affecting energy consumption, and the LSTM layer is appropriate for modeling temporal information of irregular trends in time series components. The proposed CNN-LSTM method achieves almost perfect prediction performance for electric energy consumption that was previously difficult to predict. Also, it records the smallest value of root mean square error compared to the conventional forecasting methods for the dataset on individual household power consumption. The empirical analysis of the variables confirms what affects to forecast the power consumption most.

[1]  Sung-Bae Cho,et al.  Predicting the Household Power Consumption Using CNN-LSTM Hybrid Networks , 2018, IDEAL.

[2]  Stéphane Ploix,et al.  Prediction of appliances energy use in smart homes , 2012 .

[3]  Fan Zhang,et al.  A review on time series forecasting techniques for building energy consumption , 2017 .

[4]  Shanlin Yang,et al.  A deep learning model for short-term power load and probability density forecasting , 2018, Energy.

[5]  Kevin M. Smith,et al.  Forecasting energy consumption of multi-family residential buildings using support vector regression: Investigating the impact of temporal and spatial monitoring granularity on performance accuracy , 2014 .

[6]  Yusuf Yaslan,et al.  Empirical mode decomposition based denoising method with support vector regression for time series prediction: A case study for electricity load forecasting , 2017 .

[7]  Ali Ouni,et al.  Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches † , 2018, Energies.

[8]  Weilin Li,et al.  Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings , 2017 .

[9]  Silvia Santini,et al.  Revealing Household Characteristics from Smart Meter Data , 2014 .

[10]  Khuram Pervez Amber,et al.  Electricity consumption forecasting models for administration buildings of the UK higher education sector , 2015 .

[11]  S. Beck,et al.  Using regression analysis to predict the future energy consumption of a supermarket in the UK , 2014 .

[12]  M. Hashem Pesaran,et al.  Impulse response analysis in nonlinear multivariate models , 1996 .

[13]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[15]  Seongwon Seo,et al.  Decomposition and statistical analysis for regional electricity demand forecasting , 2012 .

[16]  Navid Ghavami,et al.  Occupancy based household energy disaggregation using ultra wideband radar and electrical signature profiles , 2017 .

[17]  Adrian Ilinca,et al.  Energy storage systems—Characteristics and comparisons , 2008 .

[18]  Pasapitch Chujai,et al.  Time Series Analysis of Household Electric Consumption with ARIMA and ARMA Models , 2022 .

[19]  Sung Wook Baik,et al.  Action Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features , 2018, IEEE Access.

[20]  Muhd Zaimi Abd Majid,et al.  A global review of energy consumption, CO2 emissions and policy in the residential sector (with an overview of the top ten CO2 emitting countries) , 2015 .

[21]  Yuebin Guo,et al.  Energy consumption in machining: Classification, prediction, and reduction strategy , 2017 .

[22]  D. H. Vu,et al.  A variance inflation factor and backward elimination based robust regression model for forecasting monthly electricity demand using climatic variables , 2015 .

[23]  Sung-Bae Cho,et al.  Modular Bayesian Networks with Low-Power Wearable Sensors for Recognizing Eating Activities , 2017, Sensors.

[24]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[25]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Jianqiang Yi,et al.  Building Energy Consumption Prediction: An Extreme Deep Learning Approach , 2017 .

[27]  Sung-Bae Cho,et al.  Electric Energy Consumption Prediction by Deep Learning with State Explainable Autoencoder , 2019, Energies.

[28]  Sung-Bae Cho,et al.  Anomalous query access detection in RBAC-administered databases with random forest and PCA , 2016, Inf. Sci..

[29]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.

[31]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[32]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[33]  K. Robert Lai,et al.  Dimensional Sentiment Analysis Using a Regional CNN-LSTM Model , 2016, ACL.

[34]  Alex Pentland,et al.  Energy consumption prediction using people dynamics derived from cellular network data , 2016, EPJ Data Science.

[35]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  U. Rajendra Acharya,et al.  Automated diagnosis of arrhythmia using combination of CNN and LSTM techniques with variable length heart beats , 2018, Comput. Biol. Medicine.

[38]  C. van Treeck,et al.  Data-driven heating and cooling load predictions for non-residential buildings based on support vector machine regression and NARX Recurrent Neural Network: A comparative study on district scale , 2018, Energy.

[39]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  M. A. Rafe Biswas,et al.  Regression analysis for prediction of residential energy consumption , 2015 .

[41]  Sung-Bae Cho,et al.  Web traffic anomaly detection using C-LSTM neural networks , 2018, Expert Syst. Appl..

[42]  Sung-Bae Cho,et al.  Recognizing human activities from smartphone sensors using hierarchical continuous hidden Markov models , 2017, Int. J. Distributed Sens. Networks.

[43]  Zhiyuan Liu,et al.  A C-LSTM Neural Network for Text Classification , 2015, ArXiv.