Denoising autoencoders for Non-Intrusive Load Monitoring: Improvements and comparative evaluation

Abstract Non-Intrusive Load Monitoring (NILM) is the task of determining the appliances individual contributions to the aggregate power consumption by using a set of electrical parameters measured at a single metering point. NILM allows to provide detailed consumption information to the users, that induces them to modify their habits towards a wiser use of the electrical energy. This paper proposes a NILM algorithm based on the Deep Neural Networks. In particular, the NILM task is treated as a noise reduction problem addressed by using denoising autoencoder (dAE) architecture, i.e., a neural network trained to reconstruct a signal from its noisy version. This architecture has been initially proposed by Kelly and Knottenbelt (2015), and here is extended and improved by conducting a detailed study on the topology of the network, and by intelligently recombining the disaggregated output with a median filter. An additional contribution of this paper is an exhaustive comparative evaluation conducted with respect to one of the reference work in the field of Hidden Markov Models (HMM) for NILM, i.e., the Additive Factorial Approximate Maximum a Posteriori (AFAMAP) algorithm. The experiments have been conducted on the AMPds, UK-DALE, and REDD datasets in seen and unseen scenarios both in presence and in absence of noise. In order to be able to evaluate AFAMAP in presence of noise, an HMM model representing the noise contribution has been introduced. The results showed that the dAE approach outperforms the AFAMAP algorithm both in seen and unseen condition, and that it exhibits a significant robustness in presence of noise.

[1]  Michael Zeifman,et al.  Nonintrusive appliance load monitoring: Review and outlook , 2011, IEEE Transactions on Consumer Electronics.

[2]  Jack Kelly,et al.  Neural NILM: Deep Neural Networks Applied to Energy Disaggregation , 2015, BuildSys@SenSys.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Sundeep Pattem Unsupervised Disaggregation for Non-intrusive Load Monitoring , 2012, 2012 11th International Conference on Machine Learning and Applications.

[5]  Francesco Piazza,et al.  User-aided footprint extraction for appliance modelling in Non-Intrusive Load Monitoring , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[6]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[7]  Alex Rogers,et al.  An unsupervised training method for non-intrusive appliance load monitoring , 2014, Artif. Intell..

[8]  Bernardete Ribeiro,et al.  Home electrical signal disaggregation for non-intrusive load monitoring (NILM) systems , 2012, Neurocomputing.

[9]  Francesco Piazza,et al.  Unsupervised algorithms for non-intrusive load monitoring: An up-to-date overview , 2015, 2015 IEEE 15th International Conference on Environment and Electrical Engineering (EEEIC).

[10]  Fernando Pérez-Cruz,et al.  Infinite Factorial Unbounded-State Hidden Markov Model , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Hussain Shareef,et al.  Application of load monitoring in appliances’ energy management – A review , 2017 .

[12]  Fred Popowich,et al.  Exploiting HMM Sparsity to Perform Online Real-Time Nonintrusive Load Monitoring , 2016, IEEE Transactions on Smart Grid.

[13]  Tommi S. Jaakkola,et al.  Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation , 2012, AISTATS.

[14]  Alex Rogers,et al.  Non-Intrusive Load Monitoring Using Prior Models of General Appliance Types , 2012, AAAI.

[15]  Francesco Piazza,et al.  Improving the performance of the AFAMAP algorithm for Non-Intrusive Load Monitoring , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[16]  G. T. Gardner,et al.  The Short List: The Most Effective Actions U.S. Households Can Take to Curb Climate Change , 2008 .

[17]  Walid G. Morsi,et al.  Nonintrusive Load Monitoring Using Wavelet Design and Machine Learning , 2016, IEEE Transactions on Smart Grid.

[18]  Bin Yang,et al.  A novel DNN-HMM-based approach for extracting single loads from aggregate power signals , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  N. Goddard,et al.  Interleaved factorial non-homogeneous hidden Markov models for energy disaggregation , 2014, 1406.7665.

[20]  Peng Hin Lee,et al.  Unsupervised approach for load disaggregation with devices interactions , 2016 .

[21]  Michael I. Jordan,et al.  Factorial Hidden Markov Models , 1995, Machine Learning.

[22]  Yu Tsao,et al.  Speech enhancement based on deep denoising autoencoder , 2013, INTERSPEECH.

[23]  Andrea Castelletti,et al.  A Hybrid Signature-based Iterative Disaggregation algorithm for Non-Intrusive Load Monitoring , 2017 .

[24]  Antonio GABALDÓN,et al.  Residential end-uses disaggregation and demand response evaluation using integral transforms , 2017 .

[25]  Abhay Gupta,et al.  Is disaggregation the holy grail of energy efficiency? The case of electricity , 2013 .

[26]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[27]  Charles A. Sutton,et al.  Latent Bayesian melding for integrating individual and population models , 2015, NIPS.

[28]  Masakiyo Fujimoto,et al.  Exploring multi-channel features for denoising-autoencoder-based speech enhancement , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Muhammad Ali Imran,et al.  Non-Intrusive Load Monitoring Approaches for Disaggregated Energy Sensing: A Survey , 2012, Sensors.

[30]  Yu-Hsiu Lin,et al.  Modern development of an Adaptive Non-Intrusive Appliance Load Monitoring system in electricity energy conservation , 2012 .

[31]  Guilin Zheng,et al.  Residential Appliances Identification and Monitoring by a Nonintrusive Method , 2012, IEEE Transactions on Smart Grid.

[32]  Bin Yang,et al.  A new approach for supervised power disaggregation by using a deep recurrent LSTM network , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[33]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[34]  Burcin Becerik-Gerber,et al.  A framework for allocating personalized appliance-level disaggregated electricity consumption to daily activities , 2016 .

[35]  Tom Dhaene,et al.  On the Bayesian optimization and robustness of event detection methods in NILM , 2017 .

[36]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[37]  Haimonti Dutta,et al.  NILMTK v0.2: a non-intrusive load monitoring toolkit for large scale data sets: demo abstract , 2014, BuildSys@SenSys.

[38]  Felan Carlo C. Garcia,et al.  Development of an Intelligent System for Smart Home Energy Disaggregation Using Stacked Denoising Autoencoders , 2017 .

[39]  Scott Dick,et al.  Toward Non-Intrusive Load Monitoring via Multi-Label Classification , 2017, IEEE Transactions on Smart Grid.

[40]  Manish Marwah,et al.  Unsupervised Disaggregation of Low Frequency Power Measurements , 2011, SDM.

[41]  Jack Kelly,et al.  The UK-DALE dataset, domestic appliance-level electricity demand and whole-house demand from five UK homes , 2014, Scientific Data.

[42]  Matthew J. Johnson,et al.  Bayesian nonparametric hidden semi-Markov models , 2012, J. Mach. Learn. Res..

[43]  Vladimir Stankovic,et al.  On a Training-Less Solution for Non-Intrusive Appliance Load Monitoring Using Graph Signal Processing , 2016, IEEE Access.

[44]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[45]  Fred Popowich,et al.  AMPds: A public dataset for load disaggregation and eco-feedback research , 2013, 2013 IEEE Electrical Power & Energy Conference.

[46]  Steven B. Leeb,et al.  Non-intrusive electrical load monitoring in commercial buildings based on steady-state and transient load-detection algorithms , 1996 .

[47]  Charles A. Sutton,et al.  Signal Aggregate Constraints in Additive Factorial HMMs, with Application to Energy Disaggregation , 2014, NIPS.

[48]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.