Load profiling on time and spectral domain : from big data to smart data

With the promotion of demand side responses (DSRs) and low carbon technologies (LCTs), there is a growing interest in visualising the demand information at individual consumer and low voltage (LV) network level, where demands are less aggregated and highly volatile. Yet, traditional load profiling techniques, which are carried out on small data, are struggling to meet the requirements on accuracy and granularity. This thesis contributes to this area by extending traditional load profiling to a big-data context, where refined load profiles (smart data) can be extracted by two novel load profiling techniques for LV networks and individual consumers. The refined load profiles aim to: i) economically visualise LV networks with limited smart-grid monitoring data; ii) transform the smart metering data into a high-detail granular representation of the customers’ daily demand. For the LV networks, this thesis develops a novel concept, LV network templates, which aim to visualise the LV networks in a cost-effective manner. A novel three-stage load profiling method is proposed as: clustering, classification and scaling. By using statistical time-series analysis, three steps are undertaken: i) cluster a vast amount of load data according to their load shapes; ii) classify un-monitored substations to the most similar cluster without sample metering; iii) and also scale them to the right magnitude without sample metering. Through this method, limited representative monitoring data can be used to develop a library of typical load profiles for un-monitored networks, thus saving the cost of extensive monitoring for every single substation. In addition, it is the first load profiling method that can accurately express both load shapes and magnitudes for LV networks. Regarding the customer’s demand representation, the developed time-series analysis needs to be updated due to the volatile and uncertain nature of smart metering data, including inter-related factors such as overall load shapes, sudden spikes and magnitudes. Therefore, an innovative spectral load profiling is proposed to decompose these factors into different spectral levels, characterised by spectral features. By analysing the extracted features on each spectral level separately through multi-resolution analysis, the interference among different factors can effectively be prevented. The proposed method, for the first time, is able to fully capture the energy characteristics at the household level. The developed LV network load templates provide an economical but straightforward way to quantify the available headroom of unmonitored substations over time, providing quantitative information for distribution network operators to integrate LTCs at the minimal costs. The spectral load profiling gives an insight into customer’s energy behaviours with high granularity and accuracy. It can support the customer-specified DSR, tariff design, smart metering validation and load forecasting.

[1]  C. S. Chen,et al.  Implementation of the load survey system in Taipower , 1999, 1999 IEEE Transmission and Distribution Conference (Cat. No. 99CH36333).

[2]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[3]  H. Willis,et al.  Some unique signal processing applications in power system planning , 1979 .

[4]  F. Gubina,et al.  An approach to customers daily load profile determination , 2002, IEEE Power Engineering Society Summer Meeting,.

[5]  H. Willis,et al.  Forecasting Distribution system Loads Using Curve Shape Clustering , 1983, IEEE Transactions on Power Apparatus and Systems.

[6]  Zechun Hu,et al.  Quantification of low voltage network reinforcement costs: A statistical approach , 2013, IEEE Transactions on Power Systems.

[7]  A. Cook,et al.  Load research in a privatised electricity supply industry , 1990 .

[8]  Fionn Murtagh,et al.  A Survey of Recent Advances in Hierarchical Clustering Algorithms , 1983, Comput. J..

[9]  Shiyin Zhong,et al.  A Frequency Domain Approach to Characterize and Analyze Load Profiles , 2012, IEEE Transactions on Power Systems.

[10]  Hongbin Sun,et al.  Active Demand Response Using Shared Energy Storage for Household Energy Management , 2013, IEEE Transactions on Smart Grid.

[11]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[12]  Enrico Carpaneto,et al.  Stratified sampling of the electricity customers for setting up a load profile survey , 2000 .

[13]  Alireza S. Mahani,et al.  Fast Estimation of Multinomial Logit Models: R Package mnlogit , 2014, 1404.3177.

[14]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[15]  Hideo Hashimoto,et al.  Automatic moving object extraction using x-means clustering , 2010, 28th Picture Coding Symposium.

[16]  C. Senabre,et al.  Classification, Filtering, and Identification of Electrical Customer Load Patterns Through the Use of Self-Organizing Maps , 2006, IEEE Transactions on Power Systems.

[17]  Agnaldo J. R. Reis,et al.  Feature extraction via multiresolution analysis for short-term load forecasting , 2005, IEEE Transactions on Power Systems.

[18]  B.D. Pitt,et al.  Application of data mining techniques to load profiling , 1999, Proceedings of the 21st International Conference on Power Industry Computer Applications. Connecting Utilities. PICA 99. To the Millennium and Beyond (Cat. No.99CH36351).

[19]  N.D. Hatziargyriou,et al.  Two-Stage Pattern Recognition of Load Curves for Classification of Electricity Customers , 2007, IEEE Transactions on Power Systems.

[20]  P. Postolache,et al.  Load pattern-based classification of electricity customers , 2004, IEEE Transactions on Power Systems.

[21]  J. Nazarko,et al.  ARIMA models in load modelling with clustering approach , 2005, 2005 IEEE Russia Power Tech.

[22]  Saifur Rahman,et al.  Input variable selection for ANN-based short-term load forecasting , 1998 .

[23]  Bin Zhang Regression clustering , 2003, Third IEEE International Conference on Data Mining.

[24]  Alireza Khotanzad,et al.  ANNSTLF-Artificial Neural Network Short-Term Load Forecaster- generation three , 1998 .

[25]  Ran Li,et al.  Implementation of load profile test for electricity distribution networks , 2012, PES 2012.

[26]  B. De Moor,et al.  Short-term load forecasting, profile identification, and customer segmentation: a methodology based on periodic time series , 2005, IEEE Transactions on Power Systems.

[27]  T. Hesterberg,et al.  A regression-based approach to short-term system load forecasting , 1989, Conference Papers Power Industry Computer Application Conference.

[28]  Michael G. Pollitt,et al.  The Economics of Energy (and Electricity) Demand , 2011 .

[29]  Daniel Müllner,et al.  fastcluster: Fast Hierarchical, Agglomerative Clustering Routines for R and Python , 2013 .

[30]  Carlos E. Pedreira,et al.  Neural networks for short-term load forecasting: a review and evaluation , 2001 .

[31]  D. Infield,et al.  Integrating micro-generation into distribution systems — a review of recent research , 2008, 2008 IEEE Power and Energy Society General Meeting - Conversion and Delivery of Electrical Energy in the 21st Century.

[32]  Janusz Bialek,et al.  Electricity Network Investment And Regulation For A Low Carbon Future , 2007 .

[33]  Hernán Prieto Schmidt,et al.  Distribution transformer loss of life evaluation: a novel approach based on daily load profiles , 2000 .

[34]  Furong Li,et al.  Analysis of the relationship between load profile and weather condition , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[35]  H. Vincent Poor,et al.  Smart Meter Privacy: A Theoretical Framework , 2013, IEEE Transactions on Smart Grid.

[36]  Ying Chen,et al.  Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks , 2010, IEEE Transactions on Power Systems.

[37]  Antti Mutanen,et al.  Customer Classification and Load Profiling Method for Distribution Systems , 2011, IEEE Transactions on Power Delivery.

[38]  V. Ojala An integrated PC-program for the tariff planning of electric utilities and for national price statistics on electricity , 1992 .

[39]  F. Gubina,et al.  Allocation of the load profiles to consumers using probabilistic neural networks , 2005, IEEE Transactions on Power Systems.

[40]  Z. Vale,et al.  An electric energy consumer characterization framework based on data mining techniques , 2005, IEEE Transactions on Power Systems.

[41]  Shyh-Jier Huang,et al.  Short-term load forecasting via ARMA model identification including non-Gaussian process considerations , 2003 .

[42]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[43]  Pierre Chauss,et al.  Computing Generalized Method of Moments and Generalized Empirical Likelihood with R , 2010 .

[44]  C. Senabre,et al.  Methods for customer and demand response policies selection in new electricity markets , 2007 .

[45]  Joanicjusz Nazarko,et al.  The fuzzy regression approach to peak load estimation in power distribution systems , 1999 .

[46]  C. S. Chen,et al.  Application of load survey systems to proper tariff design , 1997 .

[47]  J. C. Hwang,et al.  Determination of customer load characteristics by load survey system at Taipower , 1996 .

[48]  J. Jardini,et al.  Daily load profiles for residential, commercial and industrial low voltage consumers , 2000 .

[49]  Alberto O. Mendelzon,et al.  Efficient Retrieval of Similar Time Sequences Using DFT , 1998, FODO.

[50]  Sunil Kumar Sinha,et al.  Intelligent Hybrid Wavelet Models for Short-Term Load Forecasting , 2010, IEEE Transactions on Power Systems.

[51]  Joanicjusz Nazarko,et al.  Identification of statistical properties of diversity and conversion factors from load research data , 1998, MELECON '98. 9th Mediterranean Electrotechnical Conference. Proceedings (Cat. No.98CH36056).

[52]  Nima Amjady,et al.  Short-term hourly load forecasting using time-series modeling with peak load estimation capability , 2001 .

[53]  Rung-Fang Chang,et al.  Load profile assignment of low voltage customers for power retail market applications , 2003 .

[54]  P. Postolache,et al.  Customer Characterization Options for Improving the Tariff Offer , 2002, IEEE Power Engineering Review.

[55]  Joanicjusz Nazarko,et al.  Estimation of diversity and kWHR-to-peak-kW factors from load research data , 1994 .

[56]  Z.A. Bashir,et al.  Applying Wavelets to Short-Term Load Forecasting Using PSO-Based Neural Networks , 2009, IEEE Transactions on Power Systems.

[57]  W. DeSarbo,et al.  A maximum likelihood methodology for clusterwise linear regression , 1988 .

[58]  Manuel A. Matos,et al.  Assessing Error Bars in Distribution Load Curve Estimation , 1997, ICANN.

[59]  V. Miranda,et al.  Fuzzy inference systems applied to LV substation load estimation , 2005, IEEE Transactions on Power Systems.

[60]  Chen Xiangxun Physical nature and exact definition of electric power , 1990, Conference on Precision Electromagnetic Measurements.

[61]  G. Chicco,et al.  Comparisons among clustering techniques for electricity customer classification , 2006, IEEE Transactions on Power Systems.

[62]  F. Gubina,et al.  Determining the load profiles of consumers based on fuzzy logic and probability neural networks , 2004 .

[63]  João Marcos Travassos Romano,et al.  The Compression of Electric Signal Waveforms for Smart Grids: State of the Art and Future Trends , 2014, IEEE Transactions on Smart Grid.

[64]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[65]  C. Martin,et al.  Analysis of Performance Parameters for UK Domestic PV Systems , 2006, 2006 IEEE 4th World Conference on Photovoltaic Energy Conference.

[66]  Roberto Napoli,et al.  Electric energy customer characterisation for developing dedicated market strategies , 2001, 2001 IEEE Porto Power Tech Proceedings (Cat. No.01EX502).

[67]  V. Hamidi Domestic demand response to increase the value of wind power , 2009 .

[68]  José Antonio Lozano,et al.  Sensitivity Analysis of k-Fold Cross Validation in Prediction Error Estimation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Jie Lu,et al.  A New Index and Classification Approach for Load Pattern Analysis of Large Electricity Customers , 2012, IEEE Transactions on Power Systems.

[70]  Y. Y. Hong,et al.  Development of Energy Loss Formula for Distribution Systems Using FCN Algorithm and Cluster-Wise Fuzzy Regression , 2002, IEEE Power Engineering Review.

[71]  Dominik Engel,et al.  Wavelet-based load profile representation for smart meter privacy , 2013, 2013 IEEE PES Innovative Smart Grid Technologies Conference (ISGT).

[72]  S. Le Blond,et al.  Cost and emission savings from the deployment of variable electricity tariffs and advanced domestic energy hub storage management , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[73]  Ram Rajagopal,et al.  Household Energy Consumption Segmentation Using Hourly Data , 2014, IEEE Transactions on Smart Grid.

[74]  Matthew Rowe,et al.  Mathematical solutions for electricity networks in a low carbon future , 2013 .

[75]  J. W. Taylor,et al.  Short-Term Load Forecasting With Exponentially Weighted Methods , 2012, IEEE Transactions on Power Systems.