A Hybrid Neural Network Model for Power Demand Forecasting

The problem of power demand forecasting for the effective planning and operation of smart grid, renewable energy and electricity market bidding systems is an open challenge. Numerous research efforts have been proposed for improving prediction performance in practical environments through statistical and artificial neural network approaches. Despite these efforts, power demand forecasting problems remain to be a grand challenge since existing methods are not sufficiently practical to be widely deployed due to their limited accuracy. To address this problem, we propose a hybrid power demand forecasting model, called (c, l)-Long Short-Term Memory (LSTM) + Convolution Neural Network (CNN). We consider the power demand as a key value, while we incorporate c different types of contextual information such as temperature, humidity and season as context values in order to preprocess datasets into bivariate sequences consisting of pairs. These c bivariate sequences are then input into c LSTM networks with l layers to extract feature sets. Using these feature sets, a CNN layer outputs a predicted profile of power demand. To assess the applicability of the proposed hybrid method, we conduct extensive experiments using real-world datasets. The results of the experiments indicate that the proposed (c, l)-LSTM+CNN hybrid model performs with higher accuracy than previous approaches.

[1]  David Vandyke,et al.  Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems , 2015, EMNLP.

[2]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[3]  Samuel Bartoš,et al.  Prediction of energy load profiles , 2017 .

[4]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[5]  Bernhard Sick,et al.  Deep Learning for solar power forecasting — An approach using AutoEncoder and LSTM Neural Networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Hermann Ney,et al.  From Feedforward to Recurrent LSTM Neural Networks for Language Modeling , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[9]  Daniel Hsu,et al.  Time Series Forecasting Based on Augmented Long Short-Term Memory , 2017, ArXiv.

[10]  J. W. Taylor,et al.  Short-term electricity demand forecasting using double seasonal exponential smoothing , 2003, J. Oper. Res. Soc..

[11]  Manuel Berenguel,et al.  A Comparison of Energy Consumption Prediction Models Based on Neural Networks of a Bioclimatic Building , 2016 .

[12]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[13]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Xiaohua Li,et al.  Electric load forecasting in smart grids using Long-Short-Term-Memory based Recurrent Neural Network , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[15]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[16]  Li Deng,et al.  Ensemble deep learning for speech recognition , 2014, INTERSPEECH.

[17]  Alireza Khotanzad,et al.  ANNSTLF-Artificial Neural Network Short-Term Load Forecaster- generation three , 1998 .

[18]  Lei Huang,et al.  A CNN based bagging learning approach to short-term load forecasting in smart grid , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[19]  Nazih M. Abu-Shikhah,et al.  Medium-Term Electric Load Forecasting Using Multivariable Linear and Non-Linear Regression , 2011 .

[20]  Daniel L. Marino,et al.  Deep neural networks for energy load forecasting , 2017, 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE).

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[23]  Yi Zheng,et al.  Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks , 2014, WAIM.

[24]  Jian Ma,et al.  A Deep Neural Network Model for Short-Term Load Forecast Based on Long Short-Term Memory Network and Convolutional Neural Network , 2018, Energies.

[25]  Stefanos D. Kollias,et al.  A Deep Learning Approach for Load Demand Forecasting of Power Systems , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[26]  Ping-Huan Kuo,et al.  A High Precision Artificial Neural Networks Model for Short-Term Energy Load Forecasting , 2018 .

[27]  Geoffrey Zweig,et al.  Context dependent recurrent neural network language model , 2012, 2012 IEEE Spoken Language Technology Workshop (SLT).

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Hongseok Kim,et al.  Deep Neural Network Based Demand Side Short Term Load Forecasting , 2016 .

[30]  Harshit Saxena,et al.  Forecasting Strategies for Predicting Peak Electric Load Days , 2017 .

[31]  R. Tibshirani,et al.  Prediction by Supervised Principal Components , 2006 .

[32]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[33]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[34]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[35]  Ning Jin,et al.  Multi-Step Short-Term Power Consumption Forecasting with a Hybrid Deep Learning Strategy , 2018, Energies.

[36]  Sifeng Liu,et al.  Comparison of China's primary energy consumption forecasting by using ARIMA (the autoregressive integrated moving average) model and GM(1,1) model , 2016 .

[37]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..