Clustering of electrical load patterns and time periods using uncertainty-based multi-level amplitude thresholding

Abstract This paper proposes a novel model to cluster similar load consumption patterns and identify time periods with similar consumption levels. The model represents the customer’s load pattern as an image and takes into account the load variation and uncertainty by using exponential intuitionistic fuzzy entropy. The advantage is that the proposed method can handle the uncertain nature of customer’s load, by adding a hesitation index to the membership and non-membership functions. A multi-level representation of the load patterns is then provided by creating specific bands for the load pattern amplitudes using intuitionistic fuzzy divergence-based thresholding. The typical load pattern is then determined for each customer. In order to reduce the number of features to represent each load pattern with respect to the time-domain data, the discrete wavelet transform is used to extract some spectral features. To cope with the data representation with fuzzy rules, the fuzzy c-means is implemented as the clustering algorithm. The proposed approach also identifies the time periods associated to different load pattern levels, providing useful hints for demand side management policies. The proposed method has been tested on ninety low voltage distribution grid customers, and its superior effectiveness with respect to the classical k-means algorithm has been represented by showing the better values obtained for a set of clustering validity indicators. The combination of load pattern clusters and time periods associated with the segmented load pattern amplitudes provides exploitable information for the efficient design and implementation of innovative energy services such as demand response for different customer categories.

[1]  Amit Konar,et al.  Automatic leukocyte nucleus segmentation by intuitionistic fuzzy divergence based thresholding. , 2014, Micron.

[2]  Georg Peters,et al.  Is there any need for rough clustering? , 2015, Pattern Recognit. Lett..

[3]  G. Coke,et al.  Random effects mixture models for clustering electrical load series , 2010 .

[4]  Richard Weber,et al.  Soft clustering - Fuzzy and rough approaches and their extensions and derivatives , 2013, Int. J. Approx. Reason..

[5]  Thierry Denoeux,et al.  ECM: An evidential version of the fuzzy c , 2008, Pattern Recognit..

[6]  Janusz Kacprzyk,et al.  Distances between intuitionistic fuzzy sets , 2000, Fuzzy Sets Syst..

[7]  Enrico Carpaneto,et al.  Electricity customer classification using frequency–domain load pattern data , 2006 .

[8]  Victor C. M. Leung,et al.  Electricity Theft Detection in AMI Using Customers’ Consumption Patterns , 2016, IEEE Transactions on Smart Grid.

[9]  Zeshui Xu Intuitionistic Fuzzy Aggregation and Clustering , 2012, Studies in Fuzziness and Soft Computing.

[10]  Hoang Nguyen,et al.  A novel similarity/dissimilarity measure for intuitionistic fuzzy sets and its application in pattern recognition , 2016, Expert Syst. Appl..

[11]  G. Chicco,et al.  Renyi entropy-based classification of daily electrical load patterns , 2010 .

[12]  Witold Pedrycz,et al.  Shadowed sets in the characterization of rough-fuzzy clustering , 2011, Pattern Recognit..

[13]  Chen Qi On clustering approach to intuitionistic fuzzy sets , 2007 .

[14]  Shiyin Zhong,et al.  Hierarchical Classification of Load Profiles Based on Their Characteristic Attributes in Frequency Domain , 2015, IEEE Transactions on Power Systems.

[15]  Mohsen Gitizadeh,et al.  Optimal TOU tariff design using robust intuitionistic fuzzy divergence based thresholding , 2017 .

[16]  João Gouveia,et al.  Unraveling electricity consumption profiles in households through clusters: Combining smart meters and door-to-door surveys , 2016 .

[17]  Pierre Pinson,et al.  Online adaptive clustering algorithm for load profiling , 2019, Sustainable Energy, Grids and Networks.

[18]  Keun Ho Ryu,et al.  Subspace Projection Method Based Clustering Analysis in Load Profiling , 2014, IEEE Transactions on Power Systems.

[19]  Diego Klabjan,et al.  Clustering time-series energy data from smart meters , 2015, 1603.07602.

[20]  F. Muñoz,et al.  Hopfield K-Means clustering algorithm: A proposal for the segmentation of electricity customers , 2011 .

[21]  Ram Rajagopal,et al.  Household Energy Consumption Segmentation Using Hourly Data , 2014, IEEE Transactions on Smart Grid.

[22]  Chris Develder,et al.  Two-Stage Load Pattern Clustering Using Fast Wavelet Transformation , 2016, IEEE Transactions on Smart Grid.

[23]  Michael Conlon,et al.  A clustering approach to domestic electricity load profile characterisation using smart metering data , 2015 .

[24]  Thierry Denoeux,et al.  EVCLUS: evidential clustering of proximity data , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Witold Pedrycz,et al.  Shadowed sets: representing and processing fuzzy sets , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[26]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Rajkumar Verma,et al.  On Generalized Intuitionistic Fuzzy Divergence (Relative Information) and Their Properties , 2012 .

[28]  Mohammad Kazem Sheikh-El-Eslami,et al.  An annual framework for clustering-based pricing for an electricity retailer , 2010 .

[29]  Chandan Chakraborty,et al.  Development of Renyi's Entropy Based Fuzzy Divergence Measure for Leukocyte Segmentation , 2011 .

[30]  Peter Grindrod,et al.  Analysis and Clustering of Residential Customers Energy Behavioral Demand Using Smart Meter Data , 2016, IEEE Transactions on Smart Grid.

[31]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[32]  Yoshikuni Yoshida,et al.  Determining the relationship between a household’s lifestyle and its electricity consumption in Japan by analyzing measured electric load profiles , 2016 .

[33]  Jimyung Kang,et al.  Electricity Customer Clustering Following Experts’ Principle for Demand Response Applications , 2015 .

[34]  Gianfranco Chicco,et al.  Electrical Load Pattern Grouping Based on Centroid Model With Ant Colony Clustering , 2013, IEEE Transactions on Power Systems.

[35]  Goran Strbac,et al.  Clustering-Based Residential Baseline Estimation: A Probabilistic Perspective , 2019, IEEE Transactions on Smart Grid.

[36]  Witold Pedrycz,et al.  Rough–Fuzzy Collaborative Clustering , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Jim Z. C. Lai,et al.  Rough clustering using generalized fuzzy clustering algorithm , 2013, Pattern Recognit..

[38]  Ram Rajagopal,et al.  Smart Meter Driven Segmentation: What Your Consumption Says About You , 2013, IEEE Transactions on Power Systems.

[39]  Fangfang Zhang,et al.  A New Validity Index for Fuzzy Clustering , 2012 .

[40]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[41]  Witold Pedrycz,et al.  Shadowed c-means: Integrating fuzzy and rough clustering , 2010, Pattern Recognit..

[42]  Gongguo Tang,et al.  A game-theoretic approach for optimal time-of-use electricity pricing , 2013, IEEE Transactions on Power Systems.

[43]  Víctor Manuel Fernandes Mendes,et al.  Classification of new electricity customers based on surveys and smart metering data , 2016 .

[44]  Graeme Burt,et al.  Enhanced Load Profiling for Residential Network Customers , 2014, IEEE Transactions on Power Delivery.

[45]  José Luis Díez,et al.  Dynamic clustering segmentation applied to load profiles of energy consumption from Spanish customers , 2014 .

[46]  Rajesh N. Davé,et al.  Characterization and detection of noise in clustering , 1991, Pattern Recognit. Lett..

[47]  Michael E. Webber,et al.  Clustering analysis of residential electricity demand profiles , 2014 .

[48]  Sankar K. Pal,et al.  Rough Set Based Generalized Fuzzy $C$ -Means Algorithm and Quantitative Indices , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  Xiaoli Li,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Classification of Energy Consumption in Buildings with Outlier Detection , 2022 .

[50]  Gianfranco Chicco,et al.  Overview and performance assessment of the clustering methods for electrical load pattern grouping , 2012 .

[51]  Peter A. Flach,et al.  Feature Construction and Calibration for Clustering Daily Load Curves from Smart-Meter Data , 2016, IEEE Trans. Ind. Informatics.

[52]  Yang Weng,et al.  Probabilistic baseline estimation based on load patterns for better residential customer rewards , 2018, International Journal of Electrical Power & Energy Systems.

[53]  M. Sugeno,et al.  Fuzzy Measures and Integrals: Theory and Applications , 2000 .

[54]  Mohammad Sadegh Helfroush,et al.  An Automatic and Robust Decision Support System for Accurate Acute Leukemia Diagnosis from Blood Microscopic Images , 2018, Journal of Digital Imaging.

[55]  Furong Li,et al.  Multi-resolution load profile clustering for smart metering data , 2016, 2017 IEEE Power & Energy Society General Meeting.

[56]  Mikko Kolehmainen,et al.  Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data , 2010 .

[57]  Peter J. Wolfs,et al.  A Hybrid Model for Residential Loads in a Distribution System With High PV Penetration , 2013, IEEE Transactions on Power Systems.

[58]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[59]  E. Crisostomi,et al.  Comparison and clustering analysis of the daily electrical load in eight European countries , 2016 .

[60]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[61]  G. Chicco,et al.  Comparisons among clustering techniques for electricity customer classification , 2006, IEEE Transactions on Power Systems.

[62]  F. Gubina,et al.  Determining the load profiles of consumers based on fuzzy logic and probability neural networks , 2004 .

[63]  Pranab K. Muhuri,et al.  Novel Adaptive Clustering Algorithms Based on a Probabilistic Similarity Measure Over Atanassov Intuitionistic Fuzzy Set , 2018, IEEE Transactions on Fuzzy Systems.

[64]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[65]  Zita Vale,et al.  A data-mining-based methodology to support MV electricity customers’ characterization , 2015 .

[66]  Zhaohong Deng,et al.  Transfer Prototype-Based Fuzzy Clustering , 2014, IEEE Transactions on Fuzzy Systems.

[67]  Zhongping Wan,et al.  Interactive intuitionistic fuzzy methods for multilevel programming problems , 2017, Expert Syst. Appl..

[68]  David C. H. Wallom,et al.  Impacts of Raw Data Temporal Resolution Using Selected Clustering Methods on Residential Electricity Load Profiles , 2015, IEEE Transactions on Power Systems.