Multi-Label Consistent Convolutional Transform Learning: Application to Non-Intrusive Load Monitoring

Convolutional transform learning is an unsupervised framework we introduced recently, for feature generation based on learnt convolutions. In this work, we propose a supervised formulation for convolutional transform so as to address the multi-label classification problem. Unlike the simple multiclass classification, in multi-label problems, each sample can correspond to multiple classes simultaneously, making the problem quite challenging. We propose to make use of a label consistency penalty and develop a suitable minimization algorithm for the training step. We illustrate the performance of the developed formulation on the practical problem of nonintrusive load monitoring. Comparisons with popular techniques show that our proposed approach yields better results on benchmark datasets.

[1]  G. W. Hart,et al.  Nonintrusive appliance load monitoring , 1992, Proc. IEEE.

[2]  Jyoti Maggu,et al.  Simultaneous Detection of Multiple Appliances From Smart-Meter Measurements via Multi-Label Consistent Deep Dictionary Learning and Deep Transform Learning , 2019, IEEE Transactions on Smart Grid.

[3]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[4]  Tommi S. Jaakkola,et al.  Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation , 2012, AISTATS.

[5]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[6]  Jeffrey A. Fessler,et al.  Convolutional Dictionary Learning: Acceleration and Convergence , 2017, IEEE Transactions on Image Processing.

[7]  Émilie Chouzenoux,et al.  Convolutional Transform Learning , 2018, ICONIP.

[8]  S. Shankar Sastry,et al.  Energy Disaggregation via Learning Powerlets and Sparse Coding , 2015, AAAI.

[9]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[10]  D. Bertsekas Projected Newton methods for optimization problems with simple constraints , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[11]  Liyi Dai,et al.  Analysis Dictionary Learning: an Efficient and Discriminative Solution , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[13]  Brendt Wohlberg,et al.  Convolutional Dictionary Learning: A Comparative Review and New Algorithms , 2017, IEEE Transactions on Computational Imaging.

[14]  Émilie Chouzenoux,et al.  A block coordinate variable metric forward–backward algorithm , 2016, Journal of Global Optimization.

[15]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[16]  Jack Kelly,et al.  Neural NILM: Deep Neural Networks Applied to Energy Disaggregation , 2015, BuildSys@SenSys.

[17]  Andrew Y. Ng,et al.  Energy Disaggregation via Discriminative Sparse Coding , 2010, NIPS.

[18]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ujjwal Maulik,et al.  Nonintrusive Load Monitoring: A Temporal Multilabel Classification Approach , 2015, IEEE Transactions on Industrial Informatics.

[20]  Angshul Majumdar,et al.  Discriminative Autoencoder for Feature Extraction: Application to Character Recognition , 2018, Neural Processing Letters.

[21]  Chris Develder,et al.  Appliance classification using VI trajectories and convolutional neural networks , 2018 .

[22]  J. Zico Kolter,et al.  REDD : A Public Data Set for Energy Disaggregation Research , 2011 .

[23]  Angshul Majumdar,et al.  Deep Sparse Coding for Non–Intrusive Load Monitoring , 2018, IEEE Transactions on Smart Grid.