Overview and performance assessment of the clustering methods for electrical load pattern grouping

In the current structure of the electricity business, distribution and supply services have been unbundled in many jurisdictions. As a consequence of unbundling, electricity supply to customers is now provided on a competitive basis. In this context, the electricity suppliers need to get accurate information on the actual behaviour of their customers for setting up dedicated commercial offers. Customer grouping on the basis of consumption pattern similarity is likely to provide effective results. This paper provides an overview of the clustering techniques used to establish suitable customer grouping, included in a general scheme for analysing electrical load pattern data. The characteristics of the various stages of the customer grouping procedure are illustrated and discussed, providing links to relevant literature references. The specific aspect of assessing the performance of the clustering algorithms for load pattern grouping is then addressed, showing how the parameters used to formulate different clustering methods impact on the clustering validity indicators. It emerges that the clustering methods able to isolate the outliers exhibit the best performance. The implications of this result on the use of the clustering methods for electrical load pattern grouping from the operator’s point of view are discussed.

[1]  B.D. Pitt,et al.  Application of data mining techniques to load profiling , 1999, Proceedings of the 21st International Conference on Power Industry Computer Applications. Connecting Utilities. PICA 99. To the Millennium and Beyond (Cat. No.99CH36351).

[2]  P. Postolache,et al.  Load pattern-based classification of electricity customers , 2004, IEEE Transactions on Power Systems.

[3]  J. Bezdek,et al.  Fuzzy partitions and relations; an axiomatic basis for clustering , 1978 .

[4]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[5]  Lotfi A. Zadeh,et al.  Similarity relations and fuzzy orderings , 1971, Inf. Sci..

[6]  Roberto Napoli,et al.  Electric energy customer characterisation for developing dedicated market strategies , 2001, 2001 IEEE Porto Power Tech Proceedings (Cat. No.01EX502).

[7]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[8]  Enrico Carpaneto,et al.  Electricity customer classification using frequency–domain load pattern data , 2006 .

[9]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  A. Rényi On Measures of Entropy and Information , 1961 .

[11]  K. Steemers,et al.  A method of formulating energy load profile for domestic buildings in the UK , 2005 .

[12]  R. Herman,et al.  Load Models for Mixed-class Domestic and Fixed, Constant Power Loads for use in Probabilistic LV Feeder analysis. , 2003 .

[13]  Mikko Kolehmainen,et al.  Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data , 2010 .

[14]  Enrico Carpaneto,et al.  Probabilistic characterisation of the aggregated residential load patterns , 2008 .

[15]  F. Gubina,et al.  Allocation of the load profiles to consumers using probabilistic neural networks , 2005, IEEE Transactions on Power Systems.

[16]  Regina Lamedica,et al.  A bottom-up approach to residential load modeling , 1994 .

[17]  Mikko Kolehmainen,et al.  Reducing energy consumption by using self-organizing maps to create more personalized electricity use information , 2008 .

[18]  J. Torriti,et al.  Demand response experience in Europe: Policies, programmes and implementation , 2010 .

[19]  Jacob H. Stang,et al.  Load prediction method for heat and electricity demand in buildings for the purpose of planning for mixed energy distribution systems , 2008 .

[20]  K.L. Lo,et al.  Application of Fuzzy Clustering to Determine Electricity Consumers' Load Profiles , 2006, 2006 IEEE International Power and Energy Conference.

[21]  Xiaoli Li,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Classification of Energy Consumption in Buildings with Outlier Detection , 2022 .

[22]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[23]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[24]  P. Postolache,et al.  Customer Characterization Options for Improving the Tariff Offer , 2002, IEEE Power Engineering Review.

[25]  J. Widén,et al.  Constructing load profiles for household electricity and hot water from time-use data—Modelling approach and validation , 2009 .

[26]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[27]  Jin-ho Kim,et al.  Common failures of demand response , 2011 .

[28]  R. Herman,et al.  The statistical description of grouped domestic electrical load currents , 1993 .

[29]  F. Schweppe Spot Pricing of Electricity , 1988 .

[30]  P. Postolache,et al.  Efficient iterative refinement clustering for electricity customer classification , 2005, 2005 IEEE Russia Power Tech.

[31]  Z. Vale,et al.  An electric energy consumer characterization framework based on data mining techniques , 2005, IEEE Transactions on Power Systems.

[32]  Pierluigi Mancarella,et al.  Distributed multi-generation: A comprehensive view , 2009 .

[33]  G. Chicco,et al.  Comparisons among clustering techniques for electricity customer classification , 2006, IEEE Transactions on Power Systems.

[34]  F. Gubina,et al.  Determining the load profiles of consumers based on fuzzy logic and probability neural networks , 2004 .

[35]  Gianfranco Chicco,et al.  Challenges for smart distribution systems: Data representation and optimization objectives , 2010, 2010 12th International Conference on Optimization of Electrical and Electronic Equipment.

[36]  Antti Mutanen,et al.  Customer Classification and Load Profiling Method for Distribution Systems , 2011, IEEE Transactions on Power Delivery.

[37]  G. Chicco,et al.  Renyi entropy-based classification of daily electrical load patterns , 2010 .

[38]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[39]  D.Z. Marques,et al.  A comparative analysis of neural and fuzzy cluster techniques applied to the characterization of electric load in substations , 2004, 2004 IEEE/PES Transmision and Distribution Conference and Exposition: Latin America (IEEE Cat. No. 04EX956).

[40]  Gianfranco Chicco,et al.  APPLICATION OF CLUSTERING TECHNIQUES TO LOAD PATTERN-BASED ELECTRICITY CUSTOMER CLASSIFICATION , 2005 .

[41]  Brian Everitt,et al.  Cluster analysis , 1974 .

[42]  Deniz Erdoğmuş,et al.  Clustering using Renyi's entropy , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[43]  C. Senabre,et al.  Classification, Filtering, and Identification of Electrical Customer Load Patterns Through the Use of Self-Organizing Maps , 2006, IEEE Transactions on Power Systems.

[44]  Sun Ic Kim,et al.  A method for classification of electricity demands using load profile data , 2005, Fourth Annual ACIS International Conference on Computer and Information Science (ICIS'05).

[45]  N.D. Hatziargyriou,et al.  Two-Stage Pattern Recognition of Load Curves for Classification of Electricity Customers , 2007, IEEE Transactions on Power Systems.

[46]  M. Newborough,et al.  Controlling micro-CHP systems to modulate electrical load profiles , 2007 .

[47]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[48]  Gianfranco Chicco,et al.  Load pattern clustering for short-term load forecasting of anomalous days , 2001, 2001 IEEE Porto Power Tech Proceedings (Cat. No.01EX502).

[49]  C. Senabre,et al.  Methods for customer and demand response policies selection in new electricity markets , 2007 .

[50]  C. S. Ozveren,et al.  Fuzzy classification of electrical load demand profiles-a case study , 2002 .

[51]  Lorna A. Greening,et al.  Demand response resources: Who is responsible for implementation in a deregulated market? , 2010 .

[52]  Nikos D. Hatziargyriou,et al.  A pattern recognition methodology for evaluation of load profiles and typical days of large electricity customers , 2008 .

[53]  J. Nazarko,et al.  ARIMA models in load modelling with clustering approach , 2005, 2005 IEEE Russia Power Tech.

[54]  Caixin Sun,et al.  Dynamic intelligent cleaning model of dirty electric load data , 2008 .

[55]  W. Zalewski Application of fuzzy inference to electric load clustering , 2006, 2006 IEEE Power India Conference.

[56]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[57]  Lingfeng Wang,et al.  Electricity theft: Overview, issues, prevention and a smart meter based approach to control theft , 2011 .

[58]  J. Neyman On the Two Different Aspects of the Representative Method: the Method of Stratified Sampling and the Method of Purposive Selection , 1934 .

[59]  Gianfranco Chicco,et al.  Emergent electricity customer classification , 2005 .

[60]  P. Flynn,et al.  Electricity deregulation, spot price patterns and demand-side management , 2006 .

[61]  Dejan J. Sobajic,et al.  Combined use of unsupervised and supervised learning for dynamic security assessment , 1991 .

[62]  C. S. Chen,et al.  Synthesis of power system load profiles by class load study , 2000 .

[63]  J. C. Hwang,et al.  Determination of customer load characteristics by load survey system at Taipower , 1996 .

[64]  Ali Naci Celik,et al.  Effect of different load profiles on the loss-of-load probability of stand-alone photovoltaic systems , 2007 .

[65]  C. F. Walker,et al.  Residential Load Shape Modelling Based on Customer Behavior , 1985, IEEE Transactions on Power Apparatus and Systems.

[66]  Thomas B. Smith,et al.  Electricity theft: a comparative analysis , 2004 .

[67]  G. Chicco,et al.  Support Vector Clustering of Electrical Load Pattern Data , 2009, IEEE Transactions on Power Systems.

[68]  C. S. Chen,et al.  Application of load survey systems to proper tariff design , 1997 .

[69]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[70]  S. Heunis,et al.  A Probabilistic Model for Residential Consumer Loads , 2002, IEEE Power Engineering Review.

[71]  Regina Lamedica,et al.  A novel methodology based on clustering techniques for automatic processing of MV feeder daily load patterns , 2000, 2000 Power Engineering Society Summer Meeting (Cat. No.00CH37134).

[72]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[73]  J. Dunn Well-Separated Clusters and Optimal Fuzzy Partitions , 1974 .

[74]  José Carlos Príncipe,et al.  Information Theoretic Clustering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Z. Vale,et al.  Data Mining Contributions to Characterize MV Consumers and to Improve the Suppliers-Consumers Settlements , 2007, 2007 IEEE Power Engineering Society General Meeting.

[76]  Z. Styczynski,et al.  Application of statistical and neural approaches to the daily load profiles modelling in power distribution systems , 1999, 1999 IEEE Transmission and Distribution Conference (Cat. No. 99CH36333).