Dilated residual attention network for load disaggregation

Load disaggregation technology is a key technology to realize real-time nonintrusive load monitoring (NILM), and deep learning method has shown great promise for NILM. However, current load disaggregation models based on deep learning are prone to the problems of gradient disappearance and model degradation, and it is difficult to extract effective features from load time series. In order to solve these problems, a new dilated residual attention deep network is proposed for load disaggregation. The proposed model adopts residual learning to extract high-level load features, reduces the difficulty of network optimization and solves the problem of network gradient disappearance. Dilated convolution is introduced to increase the receptive field of convolution kernels, which solves the problem that long-load time-series data are difficult to be learned. Most important of all, the proposed bottom-up and top-down attention mechanism can effectively extract the features of the abrupt points in mains power, improve the accuracy of judging the on/off state of electrical appliances and at the same time improve the learning ability of electrical appliances with low usage. Experiments on WikiEnergy dataset and UK-DALE dataset show that the proposed method achieves more accurate load disaggregation tasks than existing studies, which is of great significance for realizing practical NILM.

[1]  Md. Sumon Shahriar,et al.  A context aware sound classifier applied to prawn feed monitoring and energy disaggregation , 2013, Knowl. Based Syst..

[2]  Michael Baldea,et al.  Nonintrusive disaggregation of residential air-conditioning loads from sub-hourly smart meter data , 2014 .

[3]  Hong-Tzer Yang,et al.  Load Identification in Neural Networks for a Non-intrusive Monitoring of Industrial Electrical Loads , 2007, CSCWD.

[4]  Z. Jane Wang,et al.  Home Appliance Load Modeling From Aggregated Smart Meter Data , 2015, IEEE Transactions on Power Systems.

[5]  Jean Hennebert,et al.  A Survey on Intrusive Load Monitoring for Appliance Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[6]  Q. M. Jonathan Wu,et al.  Salient object detection via multi-scale attention CNN , 2018, Neurocomputing.

[7]  Manish Marwah,et al.  Unsupervised Disaggregation of Low Frequency Power Measurements , 2011, SDM.

[8]  Guo Cao,et al.  Single-column CNN for crowd counting with pixel-wise attention mechanism , 2018, Neural Computing and Applications.

[9]  Sousso Kelouwani,et al.  A residual load modeling approach for household short-term load forecasting application , 2019, Energy and Buildings.

[10]  Muhammad Ali Imran,et al.  Low-power appliance monitoring using Factorial Hidden Markov Models , 2013, 2013 IEEE Eighth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[11]  Yan Gao,et al.  Monitoring and diagnosis process of abnormal consumption on smart power grid , 2016, Neural Computing and Applications.

[12]  Francesco Piazza,et al.  Denoising autoencoders for Non-Intrusive Load Monitoring: Improvements and comparative evaluation , 2018 .

[13]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  G. W. Hart,et al.  Nonintrusive appliance load monitoring , 1992, Proc. IEEE.

[15]  Hsueh-Hsien Chang,et al.  Particle-Swarm-Optimization-Based Nonintrusive Demand Monitoring and Load Identification in Smart Meters , 2013 .

[16]  Andrea Castelletti,et al.  Sparse Optimization for Automated Energy End Use Disaggregation , 2016, IEEE Transactions on Control Systems Technology.

[17]  Qiao Liu,et al.  MSST-ResNet: Deep multi-scale spatiotemporal features for robust visual object tracking , 2019, Knowl. Based Syst..

[18]  Yu-Hsiu Lin,et al.  Modern development of an Adaptive Non-Intrusive Appliance Load Monitoring system in electricity energy conservation , 2012 .

[19]  Ming-Yue Zhai,et al.  A non-intrusive load decomposition algorithm for residents , 2018, Neural Computing and Applications.

[20]  Zuhairi Baharudin,et al.  Development of chaotically improved meta-heuristics and modified BP neural network-based model for electrical energy demand prediction in smart grid , 2017, Neural Computing and Applications.

[21]  Jack Kelly,et al.  The UK-DALE dataset, domestic appliance-level electricity demand and whole-house demand from five UK homes , 2014, Scientific Data.

[22]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Yu-Hsiu Lin,et al.  Development of an Improved Time–Frequency Analysis-Based Nonintrusive Load Monitor for Load Demand Identification , 2014, IEEE Transactions on Instrumentation and Measurement.

[26]  Charles A. Sutton,et al.  Sequence-to-point learning with neural networks for nonintrusive load monitoring , 2016, AAAI.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  João P. S. Catalão,et al.  Optimal Household Appliances Scheduling Under Day-Ahead Pricing and Load-Shaping Demand Response Strategies , 2015, IEEE Transactions on Industrial Informatics.

[29]  Yu-Hsiu Lin,et al.  Non-Intrusive Load Monitoring by Novel Neuro-Fuzzy Classification Considering Uncertainties , 2014, IEEE Transactions on Smart Grid.

[30]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[31]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[32]  Hamed Ahmadi,et al.  Load Decomposition at Smart Meters Level Using Eigenloads Approach , 2015, IEEE Transactions on Power Systems.

[33]  Cheng Wang,et al.  A multi-strategy improved particle swarm optimization algorithm and its application to identifying uncorrelated multi-source load in the frequency domain , 2017, Neural Computing and Applications.

[34]  Haijun Zhang,et al.  Understanding Subtitles by Character-Level Sequence-to-Sequence Learning , 2017, IEEE Transactions on Industrial Informatics.

[35]  Jack Kelly,et al.  Neural NILM: Deep Neural Networks Applied to Energy Disaggregation , 2015, BuildSys@SenSys.

[36]  Andrew Y. Ng,et al.  Energy Disaggregation via Discriminative Sparse Coding , 2010, NIPS.

[37]  Arno Schlueter,et al.  Automated load disaggregation for residences with electrical resistance heating , 2019, Energy and Buildings.

[38]  Hsueh-Hsien Chang,et al.  Power-Spectrum-Based Wavelet Transform for Nonintrusive Demand Monitoring and Load Identification , 2014, IEEE Transactions on Industry Applications.

[39]  C. Constantinidis,et al.  Bottom-Up and Top-Down Attention , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[40]  Yasuhiro Hayashi,et al.  Energy disaggregation based on smart metering data via semi-binary nonnegative matrix factorization , 2019, Energy and Buildings.

[41]  E. Miller,et al.  Response to Comment on "Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices" , 2007, Science.

[42]  Linlin Liu,et al.  Sitcom-star-based clothing retrieval for video advertising: a deep learning framework , 2018, Neural Computing and Applications.

[43]  Fahad Javed,et al.  An Empirical Investigation of V-I Trajectory Based Load Signatures for Non-Intrusive Load Monitoring , 2013, IEEE Transactions on Smart Grid.

[44]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Kazunori Sugahara,et al.  Current Sensor Based Home Appliance and State of Appliance Recognition , 2010 .

[46]  Aggelos S. Bouhouras,et al.  A NILM algorithm with enhanced disaggregation scheme under harmonic current vectors , 2019, Energy and Buildings.