Recent advances in the analysis of residential electricity consumption and applications of smart meter data

Abstract The emergence of smart grid technologies and applications has meant there is increasing interest in utilising smart meters. Smart meter penetration has significantly increased over the last decade and they are becoming more widespread globally. Companies such as Google, Nest, Intel, General Electric and Amazon are amongst those companies which have been developing end use applications such as home and battery energy management systems which leverage smart meter data. In addition, utilities and networks are becoming more aware of the potential benefits of using household smart meter data in demand side management strategies such as energy efficiency and demand response. Motivated by this fact, the amount of research in this area has grown considerably in recent years. This paper reviews the most recent methods and techniques for using smart meter data such as forecasting, clustering, classification and optimization. The study covers various applications such as Home and Battery Energy Management Systems and demand response strategies enabled by the analysis of smart meter data. From a comprehensive review of the literature, it was observed that there are remarkable discrepancies between the studies, which make in-depth comparison and analysis challenging. Data analysis and reporting guidelines are suggested for studies which use smart meter data. These guidelines could provide a consistent and common framework which could enhance future research.

[1]  R. Rajagopal,et al.  Determinants of residential electricity consumption: Using smart meter data to examine the effect of climate, building characteristics, appliance stock, and occupants' behavior , 2013 .

[2]  Bing Dong,et al.  A hybrid model approach for forecasting future residential electricity consumption , 2016 .

[3]  Karl Aberer,et al.  Electricity load forecasting for residential customers: Exploiting aggregation and correlation between households , 2013, 2013 Sustainable Internet and ICT for Sustainability (SustainIT).

[4]  Will Steffen,et al.  Independent Review into the Future Security of the National Electricity Market , 2017 .

[5]  E. Caamaño-Martín,et al.  Improving photovoltaics grid integration through short time forecasting and self-consumption , 2014 .

[6]  Daniel Nilsson,et al.  Photovoltaic self-consumption in buildings : A review , 2015 .

[7]  Prashant J. Shenoy,et al.  Preventing Occupancy Detection From Smart Meters , 2015, IEEE Transactions on Smart Grid.

[8]  Ram Rajagopal,et al.  Household Energy Consumption Segmentation Using Hourly Data , 2014, IEEE Transactions on Smart Grid.

[9]  Dejan Mumovic,et al.  A review of bottom-up building stock models for energy consumption in the residential sector , 2010 .

[10]  Holger Ziekow,et al.  The potential of smart home sensors in forecasting household electricity demand , 2013, 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[11]  Merih Aydinalp,et al.  Modeling of the space and domestic hot-water heating energy-consumption in the residential sector using neural networks , 2004 .

[12]  Rayman Preet Singh,et al.  On hourly home peak load prediction , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[13]  R. Weron.  Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[14]  Graeme Burt,et al.  Enhanced Load Profiling for Residential Network Customers , 2014, IEEE Transactions on Power Delivery.

[15]  Ian Richardson,et al.  Smart meter data: Balancing consumer privacy concerns with legitimate applications , 2012 .

[16]  Hamidreza Zareipour,et al.  Residential energy management using a moving window algorithm , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[17]  Zheng Wang,et al.  Clustering based methods for solar power forecasting , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[18]  G. Chicco,et al.  Comparisons among clustering techniques for electricity customer classification , 2006, IEEE Transactions on Power Systems.

[19]  Krzysztof Gajowniczek,et al.  Short Term Electricity Forecasting Using Individual Smart Meter Data , 2014, KES.

[20]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[21]  João Miguel da Costa Sousa,et al.  Fuzzy clustering and prediction of electricity demand based on household characteristics , 2015, IFSA-EUSFLAT.

[22]  Karl Aberer,et al.  Cluster-based aggregate forecasting for residential electricity demand using smart meter data , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[23]  R. Larson,et al.  The Energy Box: Locally Automated Optimal Control of Residential Electricity Usage , 2009 .

[24]  Saeid Nahavandi,et al.  Improving load forecast accuracy by clustering consumers using smart meter data , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[25]  Alistair B. Sproul,et al.  Short-term forecasting of individual household electricity loads with investigating impact of data resolution and forecast horizon , 2018 .

[26]  Demba Ndiaye,et al.  Principal component analysis of the electricity consumption in residential dwellings , 2011 .

[27]  D. Aigner,et al.  Conditional Demand Analysis for Estimating Residential End-Use Load Profiles , 1984 .

[28]  Stamatis Karnouskos,et al.  The Impact of Smart Grid Prosumer Grouping on Forecasting Accuracy and Its Benefits for Local Electricity Market Trading , 2014, IEEE Transactions on Smart Grid.

[29]  Ram Rajagopal,et al.  Short Term Electricity Load Forecasting on Varying Levels of Aggregation , 2014, ArXiv.

[30]  Yu-Hsiang Hsiao,et al.  Household Electricity Demand Forecast Based on Context Information and User Daily Schedule Analysis From Meter Data , 2015, IEEE Transactions on Industrial Informatics.

[31]  Michael E. Webber,et al.  Clustering analysis of residential electricity demand profiles , 2014 .

[32]  Mohammad Yusri Hassan,et al.  A review on applications of ANN and SVM for building electrical energy consumption forecasting , 2014 .

[33]  Carlos Cardeira,et al.  The Daily and Hourly Energy Consumption and Load Forecasting Using Artificial Neural Network Method: A Case Study Using a Set of 93 Households in Portugal☆ , 2014 .

[34]  Andrew Wirth,et al.  Improving the on-line control of energy storage via forecast error metric customization , 2016 .

[35]  Soumyadip Ghosh,et al.  Short‐term forecasting of the daily load curve for residential electricity usage in the Smart Grid , 2013 .

[36]  N. Theera-Umpon,et al.  Short-term load forecasting using wavelet transform and support vector machines , 2007, 2007 International Power Engineering Conference (IPEC 2007).

[37]  Heng Huang,et al.  Using Smart Meter Data to Improve the Accuracy of Intraday Load Forecasting Considering Customer Behavior Similarities , 2015, IEEE Transactions on Smart Grid.

[38]  Fredrik Wallin,et al.  A Comprehensive Review of Smart Energy Meters in Intelligent Energy Networks , 2016, IEEE Internet of Things Journal.

[39]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .

[40]  Sunliang Cao,et al.  Impact of simulation time-resolution on the matching of PV production and household electric demand , 2014 .

[41]  Merih Aydinalp,et al.  Modeling of the appliance, lighting, and space-cooling energy consumptions in the residential sector using neural networks , 2002 .

[42]  Michael Nye,et al.  Making energy visible: A qualitative field study of how householders interact with feedback from smart energy monitors , 2010 .

[43]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[44]  A. Wright,et al.  The nature of domestic electricity-loads and effects of time averaging on statistics and on-site generation calculations , 2007 .

[45]  Benjamin C. M. Fung,et al.  A decision tree method for building energy demand modeling , 2010 .

[46]  Frédéric Magoulès,et al.  A review on the prediction of building energy consumption , 2012 .

[47]  Ali T. Alouani,et al.  A new technique for short-term residential electric load forecasting including weather and lifestyle influences , 1992, [1992] Proceedings of the 35th Midwest Symposium on Circuits and Systems.

[48]  Yuting Wang,et al.  Very Short-Term Load Forecasting: Wavelet Neural Networks With Data Pre-Filtering , 2013, IEEE Transactions on Power Systems.

[49]  Z. Vale,et al.  An electric energy consumer characterization framework based on data mining techniques , 2005, IEEE Transactions on Power Systems.

[50]  Inês Matos,et al.  Inferring daily routines from electricity meter data , 2016 .

[51]  Abhay Gupta,et al.  Is disaggregation the holy grail of energy efficiency? The case of electricity , 2013 .

[52]  Siobhán Clarke,et al.  Residential electrical demand forecasting in very small scale: An evaluation of forecasting methods , 2013, 2013 2nd International Workshop on Software Engineering Challenges for the Smart Grid (SE4SG).

[53]  Nursyarizal Mohd Nor,et al.  A review on optimized control systems for building energy and comfort management of smart sustainable buildings , 2014 .

[54]  C. Monteiro,et al.  Optimum residential load management strategy for real time pricing (RTP) demand response programs , 2012 .

[55]  J. Torriti.  A review of time use models of residential electricity demand , 2014 .

[56]  Sunil Kumar,et al.  An Intelligent Home Energy Management System to Improve Demand Response , 2013, IEEE Transactions on Smart Grid.

[57]  Lynne E. Parker,et al.  Energy and Buildings , 2012 .

[58]  Vincent W. S. Wong,et al.  Tackling the Load Uncertainty Challenges for Energy Consumption Scheduling in Smart Grid , 2013, IEEE Transactions on Smart Grid.

[59]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[60]  K. M. U. Ahmed,et al.  Application of short term energy consumption forecasting for household energy management system , 2015, 2015 3rd International Conference on Green Energy and Technology (ICGET).

[61]  L. Suganthi,et al.  Energy models for demand forecasting—A review , 2012 .

[62]  V. I. Ugursal,et al.  A residential end‐use energy consumption model for Canada , 1998 .

[63]  Diane J. Cook,et al.  The role of prediction algorithms in the MavHome smart home architecture , 2002, IEEE Wirel. Commun..

[64]  J. Widén,et al.  A high-resolution stochastic model of domestic activity patterns and electricity demand , 2010 .

[65]  Francisco Santamaria,et al.  Modeling for home electric energy management: A review , 2015 .

[66]  Regina Lamedica,et al.  A bottom-up approach to residential load modeling , 1994 .

[67]  Siobhán Clarke,et al.  A dynamic forecasting method for small scale residential electrical demand , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[68]  Mary Ann Piette,et al.  Solutions for Summer Electric Power Shortages: Demand Response andits Applications in Air Conditioning and Refrigerating Systems , 2007 .

[69]  P. Postolache,et al.  Load pattern-based classification of electricity customers , 2004, IEEE Transactions on Power Systems.

[70]  Thillainathan Logenthiran,et al.  Demand Side Management in Smart Grid Using Heuristic Optimization , 2012, IEEE Transactions on Smart Grid.

[71]  Fredrik Wallin,et al.  Forecasting for demand response in smart grids: An analysis on use of anthropologic and structural data and short term multiple loads forecasting , 2012 .

[72]  Peter Grindrod,et al.  Analysis and Clustering of Residential Customers Energy Behavioral Demand Using Smart Meter Data , 2016, IEEE Transactions on Smart Grid.

[73]  Yoshikuni Yoshida,et al.  Determining the relationship between a household’s lifestyle and its electricity consumption in Japan by analyzing measured electric load profiles , 2016 .

[74]  M. Etezadi-Amoli,et al.  Smart meter based short-term load forecasting for residential customers , 2011, 2011 North American Power Symposium.

[75]  H. Fan,et al.  Statistical analysis of driving factors of residential energy demand in the greater Sydney region, Australia , 2015 .

[76]  Stéphane Ploix,et al.  Prediction of appliances energy use in smart homes , 2012 .

[77]  Hongseok Kim,et al.  Deep Neural Network Based Demand Side Short Term Load Forecasting , 2016 .

[78]  Aidan Duffy,et al.  Evaluation of time series techniques to characterise domestic electricity demand , 2013 .

[79]  Stéphane Ploix,et al.  A prediction system for home appliance usage , 2013 .

[80]  V. Ismet Ugursal,et al.  Comparison of neural network, conditional demand analysis, and engineering approaches for modeling end-use energy consumption in the residential sector , 2008 .

[81]  João Gouveia,et al.  Unraveling electricity consumption profiles in households through clusters: Combining smart meters and door-to-door surveys , 2016 .

[82]  Antonio Messineo,et al.  Using Recurrent Artificial Neural Networks to Forecast Household Electricity Consumption , 2012 .

[83]  Matthew Richardson,et al.  Do Deep Convolutional Nets Really Need to be Deep and Convolutional? , 2016, ICLR.

[84]  Víctor Manuel Fernandes Mendes,et al.  Classification of new electricity customers based on surveys and smart metering data , 2016 .

[85]  Akin Tascikaraoglu,et al.  A demand side management strategy based on forecasting of residential renewable sources: A smart home system in Turkey , 2014 .

[86]  Hong-Tzer Yang,et al.  A load forecasting method for HEMS applications , 2013, 2013 IEEE Grenoble Conference.

[87]  Melvin Robinson,et al.  Prediction of residential building energy consumption: A neural network approach , 2016 .

[88]  V. Ismet Ugursal,et al.  Modeling of end-use energy consumption in the residential sector: A review of modeling techniques , 2009 .

[89]  Victor C. M. Leung,et al.  Electricity Theft Detection in AMI Using Customers’ Consumption Patterns , 2016, IEEE Transactions on Smart Grid.

[90]  Mohamed Chaouch,et al.  Clustering-Based Improvement of Nonparametric Functional Time Series Forecasting: Application to Intra-Day Household-Level Load Curves , 2014, IEEE Transactions on Smart Grid.

[91]  Michael Angelo A. Pedrasa,et al.  The value of accurate forecasts and a probabilistic method for robust scheduling of residential distributed energy resources , 2010, 2010 IEEE 11th International Conference on Probabilistic Methods Applied to Power Systems.

[92]  R.A. Brooks,et al.  The Intelligent Room project , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.

[93]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[94]  B. Rudolf,et al.  World Map of the Köppen-Geiger climate classification updated , 2006 .

[95]  Jose I. Bilbao,et al.  A review and analysis of regression and machine learning models on commercial building electricity load forecasting , 2017 .

[96]  Jaime Lloret,et al.  A Survey on Electric Power Demand Forecasting: Future Trends in Smart Grids, Microgrids and Smart Buildings , 2014, IEEE Communications Surveys & Tutorials.

[97]  Gianfranco Chicco,et al.  Overview and performance assessment of the clustering methods for electrical load pattern grouping , 2012 .

[98]  A. Grandjean,et al.  A review and an analysis of the residential electric load curve models , 2012 .

[99]  Hamidreza Zareipour,et al.  Home energy management systems: A review of modelling and complexity , 2015 .

[100]  R. Urraca,et al.  Review of photovoltaic power forecasting , 2016 .

[101]  M. A. Rafe Biswas,et al.  Regression analysis for prediction of residential energy consumption , 2015 .

[102]  Shira R. Horowitz,et al.  Forecasting residential air conditioning loads , 2014 .

[103]  K. Sathish Kumar,et al.  A survey on residential Demand Side Management architecture, approaches, optimization models and methods , 2016 .

[104]  Hendrik Kondziella,et al.  Assessing the influence of the temporal resolution of electrical load and PV generation profiles on self-consumption and sizing of PV-battery systems , 2016 .

[105]  Denzil G. Fiebig,et al.  A random coefficient approach to the estimation of residential end-use load profiles , 1991 .

[106]  Gerard J. M. Smit,et al.  Management and Control of Domestic Smart Grid Technology , 2010, IEEE Transactions on Smart Grid.

[107]  Peter Grindrod,et al.  A new error measure for forecasts of household-level, high resolution electrical energy consumption , 2014 .

[108]  Fintan McLoughlin,et al.  Characterising Domestic Electricity Demand for Customer Load Profile Segmentation , 2013 .

[109]  Kevin M. Smith,et al.  Forecasting energy consumption of multi-family residential buildings using support vector regression: Investigating the impact of temporal and spatial monitoring granularity on performance accuracy , 2014 .

[110]  Chongqing Kang,et al.  Load profiling and its application to demand response: A review , 2015 .

[111]  Francisco C. Pereira,et al.  Using pattern recognition to identify habitual behavior in residential electricity consumption , 2012 .

[112]  Alessandro Di Giorgio,et al.  Near real time load shifting control for residential electricity prosumers under designed and market indexed pricing models , 2014 .

[113]  R. Lumsdaine,et al.  An end-use electricity load simulation model : Delmod , 1992 .

[114]  Ong Hang See,et al.  A review of residential demand response of smart grid , 2016 .

[115]  Kelvin K. W. Yau,et al.  Predicting electricity energy consumption: A comparison of regression analysis, decision tree and neural networks , 2007 .

[116]  Michael Conlon,et al.  A clustering approach to domestic electricity load profile characterisation using smart metering data , 2015 .

[117]  David Veitch,et al.  Wavelet Neural Networks and their application in the study of dynamical systems , 2005 .

[118]  Antonio Capone,et al.  Forecasting the usage of household appliances through power meter sensors for demand management in the smart grid , 2011, 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[119]  Yasuhiro Hayashi,et al.  A Versatile Clustering Method for Electricity Consumption Pattern Analysis in Households , 2013, IEEE Transactions on Smart Grid.

[120]  Davide Brunelli,et al.  Electricity demand forecasting of single residential units , 2013, 2013 IEEE Workshop on Environmental Energy and Structural Monitoring Systems.

[121]  Borhan M. Sanandaji,et al.  Short-term residential electric load forecasting: A compressive spatio-temporal approach , 2016 .

[122]  Jun Guo,et al.  The Role of Data Analysis in the Development of Intelligent Energy Networks , 2017, IEEE Network.

[123]  Minghong Lin,et al.  Stochastic analysis of file-swarming systems , 2007, Perform. Evaluation.

[124]  Helge Langseth,et al.  EFFECTS OF SCALE ON LOAD PREDICTION ALGORITHMS , 2013 .

[125]  Gianfranco Chicco,et al.  Load pattern clustering for short-term load forecasting of anomalous days , 2001, 2001 IEEE Porto Power Tech Proceedings (Cat. No.01EX502).

[126]  Wil L. Kling,et al.  Comparison of machine learning methods for estimating energy consumption in buildings , 2014, 2014 International Conference on Probabilistic Methods Applied to Power Systems (PMAPS).

[127]  M. Parti,et al.  The Total and Appliance-Specific Conditional Demand for Electricity in the Household Sector , 1980 .

[128]  Stephen B. Wicker,et al.  Inferring Personal Information from Demand-Response Systems , 2010, IEEE Security & Privacy.

[129]  Lingfeng Wang,et al.  Autonomous Appliance Scheduling for Household Energy Management , 2014, IEEE Transactions on Smart Grid.

[130]  Abbas Khosravi,et al.  A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings , 2015 .

[131]  Paul Denholm,et al.  Grid flexibility and storage required to achieve very high penetration of variable renewable electricity , 2011 .

[132]  Kelum A. A. Gamage,et al.  Demand side management in smart grid: A review and proposals for future direction , 2014 .

[133]  Hamidreza Zareipour,et al.  Residential Energy Management Using a Two-Horizon Algorithm , 2014, IEEE Transactions on Smart Grid.

[134]  Sylvain Robert,et al.  State of the art in building modelling and energy performances prediction: A review , 2013 .