Similarity-Based Chained Transfer Learning for Energy Forecasting With Big Data

Smart meter popularity has resulted in the ability to collect big energy data and has created opportunities for large-scale energy forecasting. Machine Learning (ML) techniques commonly used for forecasting, such as neural networks, involve computationally intensive training typically with data from a single building or a single aggregated load to predict future consumption for that same building or aggregated load. With hundreds of thousands of meters, it becomes impractical or even infeasible to individually train a model for each meter. Consequently, this paper proposes Similarity-Based Chained Transfer Learning (SBCTL), an approach for building neural network-based models for many meters by taking advantage of already trained models through transfer learning. The first model is trained in a traditional way whereas all other models transfer knowledge from the existing models in a chain-like manner according to similarities between energy consumption profiles. A Recurrent Neural Network (RNN) was used as the base forecasting model, two initialization techniques were considered, and different similarity measures were explored. The experiments show that SBCTL achieves accuracy comparable to traditional ML training while taking only a fraction of time.

[1]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  Clayton Miller,et al.  The Building Data Genome Project: An open, public data set from non-residential building electrical meters , 2017 .

[3]  Sinno Jialin Pan,et al.  Transfer defect learning , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[4]  Lei Tang,et al.  Long-term electricity consumption forecasting based on expert prediction and fuzzy Bayesian theory , 2019, Energy.

[5]  Li Li,et al.  Mid-to-long term wind and photovoltaic power generation prediction based on copula function and long short term memory network , 2019, Applied Energy.

[6]  Wenhu Tang,et al.  Deep Learning for Daily Peak Load Forecasting–A Novel Gated Recurrent Neural Network Combining Dynamic Time Warping , 2019, IEEE Access.

[7]  Ling Shao,et al.  Weakly-Supervised Cross-Domain Dictionary Learning for Visual Recognition , 2014, International Journal of Computer Vision.

[8]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[9]  Miriam A. M. Capretz,et al.  Transfer learning with seasonal and trend adjustment for cross-building energy forecasting , 2018 .

[10]  Ali Ouni,et al.  Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches † , 2018, Energies.

[11]  Xinghuo Yu,et al.  Smart Electricity Meter Data Intelligence for Future Energy Systems: A Survey , 2016, IEEE Transactions on Industrial Informatics.

[12]  Miriam A. M. Capretz,et al.  Energy Forecasting for Event Venues: Big Data and Prediction Accuracy , 2016 .

[13]  Rizwan Ahmad,et al.  Intelligent techniques for forecasting electricity consumption of buildings , 2018, Energy.

[14]  Miriam A. M. Capretz,et al.  Energy Consumption Prediction with Big Data: Balancing Prediction Accuracy and Computational Resources , 2016, 2016 IEEE International Congress on Big Data (BigData Congress).

[15]  Yong Wang,et al.  Improved mispronunciation detection with deep neural network trained acoustic models and transfer learning based logistic regression classifiers , 2015, Speech Commun..

[16]  Abbas Shiri,et al.  A new combined method for future energy forecasting in electrical networks , 2018, International Transactions on Electrical Energy Systems.

[17]  Eduardo Valle,et al.  Knowledge transfer for melanoma screening with deep learning , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[18]  Xu Chen,et al.  A hybrid teaching-learning artificial neural network for building electrical energy consumption prediction , 2018, Energy and Buildings.

[19]  Nashat T. AL-Jallad,et al.  Short-Term Forecasting for Energy Consumption through Stacking Heterogeneous Ensemble Learning Model , 2018, Energies.

[20]  Zhihai Lu,et al.  Pathological brain detection based on AlexNet and transfer learning , 2019, J. Comput. Sci..

[21]  Mansour Jamzad,et al.  A SVM-based model-transferring method for heterogeneous domain adaptation , 2016, Pattern Recognit..

[22]  Katarina Grolinger,et al.  Forecasting Building Energy Consumption with Deep Learning: A Sequence to Sequence Approach , 2019, 2019 IEEE International Congress on Internet of Things (ICIOT).

[23]  Thomas Natschläger,et al.  Generalized Online Transfer Learning for Climate Control in Residential Buildings , 2016, ArXiv.

[24]  Yi Wang,et al.  Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges , 2018, IEEE Transactions on Smart Grid.

[25]  Madeleine Gibescu,et al.  Unsupervised energy prediction in a Smart Grid context using reinforcement cross-building transfer learning , 2016 .

[26]  Seung Ho Hong,et al.  Hour-Ahead Price Based Energy Management Scheme for Industrial Facilities , 2017, IEEE Transactions on Industrial Informatics.

[27]  Ivor W. Tsang,et al.  Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Hui He,et al.  Short-Term Non-Residential Load Forecasting Based on Multiple Sequences LSTM Recurrent Neural Network , 2018, IEEE Access.

[29]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[30]  Hamidreza Zareipour,et al.  A New Feature Selection Technique for Load and Price Forecast of Electrical Power Systems , 2017, IEEE Transactions on Power Systems.

[31]  Song Liu,et al.  Proposed Model Employing ARIMA and RELM in Urban Energy Consumption Prediction , 2018, 2018 International Symposium on Computer, Consumer and Control (IS3C).

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.