A Clustering Framework for Residential Electric Demand Profiles

The availability of residential electric demand profiles data, enabled by the large-scale deployment of smart metering infrastructure, has made it possible to perform more accurate analysis of electricity consumption patterns. This paper analyses the electric demand profiles of individual households located in the city Amsterdam, the Netherlands. A comprehensive clustering framework is defined to classify households based on their electricity consumption pattern. This framework consists of two main steps, namely a dimensionality reduction step of input electricity consumption data, followed by an unsupervised clustering algorithm of the reduced subspace. While any algorithm, which has been used in the literature for the aforementioned clustering task, can be used for the corresponding step, the more important question is to deduce which particular combination of algorithms is the best for a given dataset and a clustering task. This question is addressed in this paper by proposing a novel objective validation strategy, whose recommendations are then cross-verified by performing subjective validation.

[1]  Stefan Winkler,et al.  Detecting rainfall onset using Sky Images , 2016, 2016 IEEE Region 10 Conference (TENCON).

[2]  Peter A. Flach,et al.  Feature Construction and Calibration for Clustering Daily Load Curves from Smart-Meter Data , 2016, IEEE Trans. Ind. Informatics.

[3]  Christophe G. Giraud-Carrier,et al.  Learning the Threshold in Hierarchical Agglomerative Clustering , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[4]  Elias Oliveira,et al.  Agglomeration and Elimination of Terms for Dimensionality Reduction , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[5]  A.M. van Voorden,et al.  Impact of rapid PV fluctuations on power quality in the low-voltage grid and mitigation strategies using electric vehicles , 2020, International Journal of Electrical Power & Energy Systems.

[6]  Shilpa Manandhar,et al.  Forecasting Precipitable Water Vapor Using LSTMs , 2020, 2020 IEEE USNC-CNC-URSI North American Radio Science Meeting (Joint with AP-S Symposium).

[7]  Irene Monasterolo,et al.  The impact of phasing out fossil fuel subsidies on the low-carbon transition , 2019, Energy Policy.

[8]  D. Wolpert.  The Supervised Learning No-Free-Lunch Theorems , 2002 .

[9]  Jose I. Bilbao,et al.  Household electricity load forecasting using historical smart meter data with clustering and classification techniques , 2018, 2018 IEEE Innovative Smart Grid Technologies - Asia (ISGT Asia).

[10]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[11]  Stefan Winkler,et al.  Systematic Study of Weather Variables for Rainfall Detection , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[12]  Martin K. Patel,et al.  Comparison of clustering approaches for domestic electricity load profile characterisation - Implications for demand side management , 2019, Energy.

[13]  Shilpa Manandhar,et al.  A Data-Driven Approach for Accurate Rainfall Prediction , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Gianfranco Chicco,et al.  Overview and performance assessment of the clustering methods for electrical load pattern grouping , 2012 .

[15]  T. Alskaif,et al.  A systematic analysis of meteorological variables for PV output power estimation , 2020, Renewable Energy.

[16]  Johannes Urpelainen,et al.  Weathering electricity demand? Seasonal variation in electricity consumption among off-grid households in rural India , 2020 .

[17]  Juan Jose Saucedo Dorantes,et al.  Condition monitoring approach based on dimensionality reduction techniques for detecting power quality disturbances in cogeneration systems , 2019, 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[18]  Machteld van den Broek,et al.  Gamification-based framework for engagement of residential customers in energy applications , 2018, Energy Research & Social Science.