New Design of a Supervised Energy Disaggregation Model Based on the Deep Neural Network for a Smart Grid

Energy management technology of demand-side is a key process of the smart grid that helps achieve a more efficient use of generation assets by reducing the energy demand of users during peak loads. In the context of a smart grid and smart metering, this paper proposes a hybrid model of energy disaggregation through deep feature learning for non-intrusive load monitoring to classify home appliances based on the information of main meters. In addition, a deep neural model of supervised energy disaggregation with a high accuracy for giving awareness to end users and generating detailed feedback from demand-side with no need for expensive smart outlet sensors was introduced. A new functional API model of deep learning (DL) based on energy disaggregation was designed by combining a one-dimensional convolutional neural network and recurrent neural network (1D CNN-RNN). The proposed model was trained on Google Colab’s Tesla graphics processing unit (GPU) using Keras. The residential energy disaggregation dataset was used for real households and was implemented in Tensorflow backend. Three different disaggregation methods were compared, namely the convolutional neural network, 1D CNN-RNN, and long short-term memory. The results showed that energy can be disaggregated from the metrics very accurately using the proposed 1D CNN-RNN model. Finally, as a work in progress, we introduced the DL on the Edge for Fog Computing non-intrusive load monitoring (NILM) on a low-cost embedded board using a state-of-the-art inference library called uTensor that can support any Mbed enabled board with no need for the DL API of web services and internet connectivity.

[1]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[2]  Gm. Shafiullah,et al.  Implementation of Advanced Demand Side Management for Microgrid Incorporating Demand Response and Home Energy Management System , 2018, Infrastructures.

[3]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[4]  Christ D. Richmond,et al.  Mean-squared error and threshold SNR prediction of maximum-likelihood signal parameter estimation with estimated colored noise covariances , 2006, IEEE Transactions on Information Theory.

[5]  Kamin Whitehouse,et al.  If You Measure It, Can You Improve It? Exploring The Value of Energy Disaggregation , 2015, BuildSys@SenSys.

[6]  Jing Liao,et al.  A graph-based signal processing approach for low-rate energy disaggregation , 2014, 2014 IEEE Symposium on Computational Intelligence for Engineering Solutions (CIES).

[7]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[8]  Hermann Ney,et al.  From Feedforward to Recurrent LSTM Neural Networks for Language Modeling , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[9]  Shubi Kaijage,et al.  A Survey on Non-Intrusive Load Monitoring Methodies and Techniques for Energy Disaggregation Problem , 2017, ArXiv.

[10]  Fred Popowich,et al.  Exploiting HMM Sparsity to Perform Online Real-Time Nonintrusive Load Monitoring , 2016, IEEE Transactions on Smart Grid.

[11]  Francesco Piazza,et al.  Attempting to reduce the vanishing gradient effect through a novel recurrent multiscale architecture , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[12]  Yasin Kabalci,et al.  Introduction to Smart Grid Architecture , 2019 .

[13]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[14]  Gerhard P. Hancke,et al.  Using neural networks for non-intrusive monitoring of industrial electrical loads , 1994, Conference Proceedings. 10th Anniversary. IMTC/94. Advanced Technologies in I & M. 1994 IEEE Instrumentation and Measurement Technolgy Conference (Cat. No.94CH3424-9).

[15]  Eric C. Larson,et al.  Disaggregated End-Use Energy Sensing for the Smart Grid , 2011, IEEE Pervasive Computing.

[16]  Hau-San Wong,et al.  Adaptive activation functions in convolutional neural networks , 2018, Neurocomputing.

[17]  J. Zico Kolter,et al.  REDD : A Public Data Set for Energy Disaggregation Research , 2011 .

[18]  Mirto Musci,et al.  Embedded Real-Time Fall Detection with Deep Learning on Wearable Devices , 2018, 2018 21st Euromicro Conference on Digital System Design (DSD).

[19]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[20]  Hong-Tzer Yang,et al.  Design a Neural Network for Features Selection in Non-intrusive Monitoring of Industrial Electrical Loads , 2007, 2007 11th International Conference on Computer Supported Cooperative Work in Design.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Thomas Bahr,et al.  APPLICATION OF SOFTMAX REGRESSION AND ITS VALIDATION FOR SPECTRAL-BASED LAND COVER MAPPING , 2017 .

[23]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[24]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[25]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[26]  Prakash N. Krishna,et al.  Fuzzy Logic Based Smart Home Energy Management System , 2018, 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT).

[27]  Sung Wook Baik,et al.  Action Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features , 2018, IEEE Access.

[28]  Alex Sherstinsky,et al.  Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network , 2018, Physica D: Nonlinear Phenomena.

[29]  N. Goddard,et al.  Interleaved factorial non-homogeneous hidden Markov models for energy disaggregation , 2014, 1406.7665.

[30]  G. W. Hart,et al.  Nonintrusive appliance load monitoring , 1992, Proc. IEEE.

[31]  Bin Yang,et al.  Toward a semi-supervised non-intrusive load monitoring system for event-based energy disaggregation , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[32]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[33]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[34]  Jack Kelly,et al.  Neural NILM: Deep Neural Networks Applied to Energy Disaggregation , 2015, BuildSys@SenSys.

[35]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[36]  Christine L. Borgman,et al.  Using the Jupyter Notebook as a Tool for Open Science: An Empirical Study , 2017, 2017 ACM/IEEE Joint Conference on Digital Libraries (JCDL).

[37]  A. R. Reyes Lua,et al.  Location-aware Energy Disaggregation in Smart Homes , 2015 .

[38]  Kamin Whitehouse,et al.  Gemello: Creating a Detailed Energy Breakdown from Just the Monthly Electricity Bill , 2016, KDD.

[39]  Bin Yang,et al.  An Approach for Unsupervised Non-Intrusive Load Monitoring of Residential Appliances , 2013 .