Deriving knowledge of household behaviour from domestic electricity usage metering

The electricity market in the UK is undergoing dramatic changes and requires a transformation of existing practices to meet the current and forthcoming challenges. One aspect of the solution is the deployment of demand side management (DSM) programmes to influence domestic behaviour patterns for the benefit of the overall network. Effective deployment of DSM requires segmentation of the population into a small number of groupings. Using a database of electricity meter data collected at a frequency of five minutes over a year from several hundred houses, households are clustered based on the shape of the average daily electricity usage profile. A novel method, incorporating evaluation criteria beyond compactness, of evaluating the resulting groupings is defined and tested. The results indicate the potentially most useful algorithms for use with load profile clustering. Patterns within the electricity meter data are approximated and symbolised to allow motifs (representing repeated behaviours) to be identified. Uninteresting motifs are automatically identified and discarded. The different possible parameters, including size of motif and number of symbols used in representing the data, are explored and the most appropriate values found for use with electricity meter data motif detection. The concept of variability of regular behaviour within a household is introduced and methods of representing the variability are considered. The novel method of using variability in timing of motifs is compared to other techniques and the results tested using the previously defined evaluation criteria. Combining the generated motif data with the meter data to produce a single set of archetypes does not produce more useful results for use with DSM. However, creating complementary sets of archetypes based on each set of data, provides a more complete understanding of the households and allows for better targeting of DSM initiatives.

[1]  Hadley Wickham,et al.  Reshaping Data with the reshape Package , 2007 .

[2]  Eamonn J. Keogh,et al.  Exact Discovery of Time Series Motifs , 2009, SDM.

[3]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[4]  David Infield,et al.  Domestic electricity use: A high-resolution energy demand model , 2010 .

[5]  Jessica Lin,et al.  Finding Motifs in Time Series , 2002, KDD 2002.

[6]  Corinna Fischer Feedback on household electricity consumption: a tool for saving energy? , 2008 .

[7]  Marko Sarstedt,et al.  A Concise Guide to Market Research: The Process, Data, and Methods Using IBM SPSS Statistics , 2011 .

[8]  Regina Lamedica,et al.  A bottom-up approach to residential load modeling , 1994 .

[9]  Sarah C. Darby,et al.  Social implications of residential demand response in cool temperate climates , 2012 .

[10]  Kevin J. Lomas,et al.  Identifying trends in the use of domestic appliances from household electricity consumption measurements , 2008 .

[11]  Bert-Jaap Koops,et al.  Smart Metering and Privacy in Europe: Lessons from the Dutch Case , 2013, European Data Protection.

[12]  Heikki Mannila,et al.  Rule Discovery from Time Series , 1998, KDD.

[13]  Sasa Z. Djokic,et al.  Multi-scale dynamic modeling to maximize demand side management , 2011, 2011 2nd IEEE PES International Conference and Exhibition on Innovative Smart Grid Technologies.

[14]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[15]  Hsueh-Hsien Chang,et al.  Load identification in nonintrusive load monitoring using steady-state and turn-on transient energy algorithms , 2010, The 2010 14th International Conference on Computer Supported Cooperative Work in Design.

[16]  Kurt Hornik,et al.  A CLUE for CLUster Ensembles , 2005 .

[17]  Steven Reece,et al.  Recommending energy tariffs and load shifting based on smart household usage profiling , 2013, IUI '13.

[18]  R.A. Abd-Alhameed,et al.  Statistical predictions of electric load profiles in the UK domestic buildings , 2010, 2010 1st International Conference on Energy, Power and Control (EPC-IQ).

[19]  Michalis Vazirgiannis,et al.  Cluster validity methods: part I , 2002, SGMD.

[20]  Chris Fraley,et al.  Algorithms for Model-Based Gaussian Hierarchical Clustering , 1998, SIAM J. Sci. Comput..

[21]  Jukka Paatero,et al.  A model for generating household electricity load profiles , 2006 .

[22]  J. Gareth Polhill,et al.  The North East Scotland Energy Monitoring Project: Exploring relationships between household occupants and energy usage , 2014, Energy and Buildings.

[23]  H. Allcott,et al.  Social Norms and Energy Conservation , 2011 .

[24]  C. Vlek,et al.  A review of intervention studies aimed at household energy conservation , 2005 .

[25]  Nuno Constantino Castro,et al.  Time Series Data Mining , 2009, Encyclopedia of Database Systems.

[26]  G. Chicco,et al.  Renyi entropy-based classification of daily electrical load patterns , 2010 .

[27]  J. Torriti,et al.  Demand response experience in Europe: Policies, programmes and implementation , 2010 .

[28]  Gj Raw,et al.  Energy Demand Research Project: final analysis , 2011 .

[29]  K. Seltman Marketing for management. , 2004, Marketing health services.

[30]  Ralph Kimball,et al.  The Data Warehouse Lifecycle Toolkit: Expert Methods for Designing, Developing and Deploying Data Warehouses with CD Rom , 1998 .

[31]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[32]  Uwe Aickelin,et al.  Application of a Clustering Framework to UK Domestic Electricity Data , 2013, ArXiv.

[33]  R. Belmans,et al.  Measuring the “smartness” of the electricity grid , 2010, 2010 7th International Conference on the European Energy Market.

[34]  Rodney Anthony Stewart,et al.  Alarming visual display monitors affecting shower end use water and energy conservation in Australian residential households. , 2010 .

[35]  A. D. Gordon,et al.  Partitions of Partitions , 1998 .

[36]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[37]  M. H. Sadreddini,et al.  Evaluating different clustering techniques for electricity customer classification , 2010, IEEE PES T&D 2010.

[38]  Sasa Z. Djokic,et al.  An 11 kV steady state residential aggregate load model. Part 1: Aggregation methodology , 2011, 2011 IEEE Trondheim PowerTech.

[39]  Gianfranco Chicco,et al.  Overview and performance assessment of the clustering methods for electrical load pattern grouping , 2012 .

[40]  David GERBEC,et al.  COMPARISON OF DIFFERENT CLASSIFICATION METHODS FOR THE CONSUMERS ' LOAD PROFILE DETERMINATION , 2003 .

[41]  Adrian E. Raftery,et al.  mclust Version 4 for R : Normal Mixture Modeling for Model-Based Clustering , Classification , and Density Estimation , 2012 .

[42]  José L. Bernal-Agustín,et al.  Data mining methodology for disaggregation of load demand , 2009 .

[43]  F. Gubina,et al.  An approach to customers daily load profile determination , 2002, IEEE Power Engineering Society Summer Meeting,.

[44]  Rung-Fang Chang,et al.  Load profile assignment of low voltage customers for power retail market applications , 2003 .

[45]  Gianfranco Chicco,et al.  Emergent electricity customer classification , 2005 .

[46]  P. Postolache,et al.  Load pattern-based classification of electricity customers , 2004, IEEE Transactions on Power Systems.

[47]  S. Zachary,et al.  Challenges in quantifying wind generation's contribution to securing peak demand , 2011, IEEE Power & Energy Society General Meeting.

[48]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[49]  Uwe Aickelin,et al.  An Approach for Assessing Clustering of Households by Electricity Usage , 2014, ArXiv.

[50]  Tao Zhang,et al.  A Three-Dimensional Model of Residential Energy Consumer Archetypes for Local Energy Policy Design in the UK , 2012, ArXiv.

[51]  P. Postolache,et al.  Customer Characterization Options for Improving the Tariff Offer , 2002, IEEE Power Engineering Review.

[52]  A. Rodriguez,et al.  Electric customer classification using Nopfield recurrent ANN , 2008, 2008 5th International Conference on the European Electricity Market.

[53]  Uwe Aickelin,et al.  The Application of a Data Mining Framework to Energy Usage Profiling in Domestic Residences Using UK Data , 2011, ArXiv.

[54]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[55]  Uwe Aickelin,et al.  Finding the Creatures of Habit; Clustering Households Based on Their Flexibility in Using Electricity , 2013, ArXiv.

[56]  Dino Ienco,et al.  LODE: A distance-based classifier built on ensembles of positive and negative observations , 2012, Pattern Recognit..

[57]  G. Chicco,et al.  Support Vector Clustering of Electrical Load Pattern Data , 2009, IEEE Transactions on Power Systems.

[58]  Mohammad Kazem Sheikh-El-Eslami,et al.  An annual framework for clustering-based pricing for an electricity retailer , 2010 .

[59]  Uwe Aickelin,et al.  Creating Personalised Energy Plans: From Groups to Individuals Using Fuzzy C Means Clustering , 2013, ArXiv.

[60]  George J. Tsekouras,et al.  A new classification pattern recognition methodology for power system typical load profiles , 2008 .

[61]  Z. Vale,et al.  An electric energy consumer characterization framework based on data mining techniques , 2005, IEEE Transactions on Power Systems.

[62]  Jeffrey Bailey Load Profiling for Retail Choice: Examining a Complex and Crucial Component of Settlement , 2000 .

[63]  Michalis Vazirgiannis,et al.  Clustering validity checking methods: part II , 2002, SGMD.

[64]  Andrea Tagarelli,et al.  Low-voltage electricity customer profiling based on load data clustering , 2009, IDEAS '09.

[65]  S. Tso,et al.  Study of climatic effects on peak load and regional similarity of load profiles following disturbances based on data mining , 2006 .

[66]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[67]  Hiroyuki Mori,et al.  A SAX-based method for extracting features of electricity price in power markets , 2009, 2009 Transmission & Distribution Conference & Exposition: Asia and Pacific.

[68]  U. M. Feyyad Data mining and knowledge discovery: making sense out of data , 1996 .

[69]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..

[70]  Tatsuya Yamazaki,et al.  Appliance Recognition from Electric Current Signals for Information-Energy Integrated Network in Home Environments , 2009, ICOST.

[71]  Keith Baker,et al.  Improving the prediction of UK domestic energy-demand using annual consumption-data , 2008 .

[72]  David E. Culler,et al.  Design and implementation of a high-fidelity AC metering network , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[73]  J. Jardini,et al.  Daily load profiles for residential, commercial and industrial low voltage consumers , 2000 .

[74]  Mihai Gavrilas,et al.  Application of Honey Bee Mating Optimization algorithm to load profile clustering , 2010, 2010 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[75]  Iain MacLeay,et al.  Digest of United Kingdom Energy Statistics 2014 INTERNET BOOKLET , 2014 .

[76]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[77]  G. Gross,et al.  Short-term load forecasting , 1987, Proceedings of the IEEE.

[78]  Frank Höppner Discovery of Temporal Patterns. Learning Rules about the Qualitative Behaviour of Time Series , 2001, PKDD.

[79]  V. Ismet Ugursal,et al.  Modeling of end-use energy consumption in the residential sector: A review of modeling techniques , 2009 .

[80]  L. Hubert,et al.  Comparing partitions , 1985 .

[81]  India U.S. Consulate Mumbai,et al.  Energy & Climate Change , 2013 .

[82]  Brian Everitt,et al.  Cluster analysis , 1974 .

[83]  Z. Vale,et al.  Data Mining Contributions to Characterize MV Consumers and to Improve the Suppliers-Consumers Settlements , 2007, 2007 IEEE Power Engineering Society General Meeting.

[84]  Daswin De Silva,et al.  A Data Mining Framework for Electricity Consumption Analysis From Meter Data , 2011, IEEE Transactions on Industrial Informatics.

[85]  Lutgarde M. C. Buydens,et al.  Self- and Super-organizing Maps in R: The kohonen Package , 2007 .

[86]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[87]  B. Everitt,et al.  Cluster Analysis: Everitt/Cluster Analysis , 2011 .

[88]  Sally Dibb,et al.  Criteria guiding segmentation implementation: reviewing the evidence , 1999 .

[89]  Z. Vale,et al.  Typical load profiles in the smart grid context — A clustering methods comparison , 2012, 2012 IEEE Power and Energy Society General Meeting.

[90]  Myra Spiliopoulou,et al.  MONIC: modeling and monitoring cluster transitions , 2006, KDD '06.

[91]  H. Allcott,et al.  Rethinking Real Time Electricity Pricing , 2011 .

[92]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[93]  K. Ellegård,et al.  Visualizing energy consumption activities as a tool for making everyday life more sustainable , 2011 .

[94]  D. Kirschen Demand-side view of electricity markets , 2003 .

[95]  Eamonn J. Keogh,et al.  iSAX: indexing and mining terabyte sized time series , 2008, KDD.

[96]  Sunil Sikka,et al.  A Comparative Analysis of Clustering Algorithms , 2014 .

[97]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[98]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[99]  Jason Lines,et al.  Classification of Household Devices by Electricity Usage Profiles , 2011, IDEAL.

[100]  F. Gubina,et al.  Determination and allocation of typical load profiles to the eligible consumers , 2003, 2003 IEEE Bologna Power Tech Conference Proceedings,.

[101]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[102]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[103]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[104]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[105]  Furong Li,et al.  Demand response in the UK's domestic sector , 2009 .

[106]  Bikash Pal,et al.  Statistical Representation of Distribution System Loads Using Gaussian Mixture Model , 2010, IEEE Transactions on Power Systems.

[107]  L. Varga,et al.  Electricity pricing in liberalized market using consumer characterization , 2009, 2009 6th International Conference on the European Energy Market.

[108]  Michael Zeifman,et al.  Nonintrusive appliance load monitoring: Review and outlook , 2011, IEEE Transactions on Consumer Electronics.

[109]  Gianfranco Chicco,et al.  Application of clustering algorithms and self organising maps to classify electricity customers , 2003, 2003 IEEE Bologna Power Tech Conference Proceedings,.

[110]  Z. Zakaria,et al.  Load profiling in the new electricity market , 2002, Student Conference on Research and Development.

[111]  Jean-François Boulicaut,et al.  Application-independent feature construction based on almost-closedness properties , 2010, Knowledge and Information Systems.

[112]  Uwe Aickelin,et al.  Variability of Behaviour in Electricity Load Profile Clustering; Who Does Things at the Same Time Each Day? , 2014 .

[113]  M. Newborough,et al.  Demand-side management opportunities for the UK domestic sector , 1999 .