Sequence-to-point learning with neural networks for nonintrusive load monitoring

Energy disaggregation (a.k.a nonintrusive load monitoring, NILM), a single-channel blind source separation problem, aims to decompose the mains which records the whole house electricity consumption into appliance-wise readings. This problem is difficult because it is inherently unidentifiable. Recent approaches have shown that the identifiability problem could be reduced by introducing domain knowledge into the model. Deep neural networks have been shown to be a promising approach for these problems, but sliding windows are necessary to handle the long sequences which arise in signal processing problems, which raises issues about how to combine predictions from different sliding windows. In this paper, we propose sequence-to-point learning, where the input is a window of the mains and the output is a single point of the target appliance. We use convolutional neural networks to train the model. Interestingly, we systematically show that the convolutional neural networks can inherently learn the signatures of the target appliances, which are automatically added into the model to reduce the identifiability problem. We applied the proposed neural network approaches to real-world household energy data, and show that the methods achieve state-of-the-art performance, improving two standard error measures by 84% and 92%.

[1]  Sundeep Pattem Unsupervised Disaggregation for Non-intrusive Load Monitoring , 2012, 2012 11th International Conference on Machine Learning and Applications.

[2]  Jack Kelly,et al.  Neural NILM: Deep Neural Networks Applied to Energy Disaggregation , 2015, BuildSys@SenSys.

[3]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[4]  Charles A. Sutton,et al.  Signal Aggregate Constraints in Additive Factorial HMMs, with Application to Energy Disaggregation , 2014, NIPS.

[5]  Kilian Q. Weinberger,et al.  Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48 , 2016 .

[6]  J. Zico Kolter,et al.  REDD : A Public Data Set for Energy Disaggregation Research , 2011 .

[7]  G. W. Hart,et al.  Nonintrusive appliance load monitoring , 1992, Proc. IEEE.

[8]  Henning Lange,et al.  Efficient Inference in Dual-Emission FHMM for Energy Disaggregation , 2016, AAAI Workshop: AI for Smart Grids and Smart Buildings.

[9]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[10]  Jack Kelly,et al.  'UK-DALE': A dataset recording UK Domestic Appliance-Level Electricity demand and whole-house demand , 2014, ArXiv.

[11]  Charles A. Sutton,et al.  Latent Bayesian melding for integrating individual and population models , 2015, NIPS.

[12]  M. D. Wilkinson,et al.  Management science , 1989, British Dental Journal.

[13]  Ieee Staff,et al.  2013 IEEE Global Conference on Signal and Information Processing (GlobalSIP) , 2013 .

[14]  Scott Dick,et al.  Toward Non-Intrusive Load Monitoring via Multi-Label Classification , 2017, IEEE Transactions on Smart Grid.

[15]  Wilsun Xu,et al.  SDP Relaxation with Randomized Rounding for Energy Disaggregation , 2016, NIPS.

[16]  Hakan Erdogan,et al.  Deep neural networks for single channel source separation , 2013, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Jun Du,et al.  A Regression Approach to Single-Channel Speech Separation Via High-Resolution Deep Neural Networks , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[18]  Jack Kelly,et al.  The UK-DALE dataset, domestic appliance-level electricity demand and whole-house demand from five UK homes , 2014, Scientific Data.

[19]  Tommi S. Jaakkola,et al.  Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation , 2012, AISTATS.

[20]  Alex Rogers,et al.  Non-Intrusive Load Monitoring Using Prior Models of General Appliance Types , 2012, AAAI.

[21]  Vladimir Stankovic,et al.  Blind non-intrusive appliance load monitoring using graph-based signal processing , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[22]  Koray Kavukcuoglu,et al.  Pixel Recurrent Neural Networks , 2016, ICML.

[23]  Volume 22 , 1998 .

[24]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[25]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[26]  Paris Smaragdis,et al.  Deep learning for monaural speech separation , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  N. Goddard,et al.  Interleaved factorial non-homogeneous hidden Markov models for energy disaggregation , 2014, 1406.7665.

[28]  Vladimir Stankovic,et al.  On a Training-Less Solution for Non-Intrusive Appliance Load Monitoring Using Graph Signal Processing , 2016, IEEE Access.

[29]  Corinna Fischer Feedback on household electricity consumption: a tool for saving energy? , 2008 .

[30]  Kamin Whitehouse,et al.  Gemello: Creating a Detailed Energy Breakdown from Just the Monthly Electricity Bill , 2016, KDD.

[31]  R. Bordley A Multiplicative Formula for Aggregating Probability Assessments , 1982 .