The role of digital trace data in supporting the collection of population statistics – the case for smart metered electricity consumption data

Debates over the future of the UK's traditional decadal census have led to the exploration of supplementary data sources, which could support the provision of timely and enhanced statistics on population and housing in small areas. This paper reviews the potential value of a number of commercial datasets before focusing on high temporal resolution household electricity load data collected via smart metering. We suggest that such data could provide indicators of household characteristics that could then be aggregated at the census output area level to generate more frequent official small area statistics. These could directly supplement existing census indicators or even enable development of novel small area indicators. The paper explores this potential through preliminary analysis of a ‘smart meter-like’ dataset, and when set alongside the limited literature to date, the results suggest that aggregated household load profiles may reveal key household and householder characteristics of interest to census users and national statistical organisations. The paper concludes that complete coverage, quasi-real time reporting, and household level detail of electricity consumption data in particular could support the delivery of population statistics and area-based social indicators, and we outline a research programme to address these opportunities.

[1]  Andrew J. Wright What is the relationship between built form and energy use in dwellings , 2008 .

[2]  Michael Conlon,et al.  Characterising domestic electricity consumption patterns by dwelling and occupant socio-economic variables: An Irish case study , 2012 .

[3]  Terry L. Hunt,et al.  Scoring Points: How Tesco Continues to Win Customer Loyalty , 2004 .

[4]  Gj Raw,et al.  Energy Demand Research Project: final analysis , 2011 .

[5]  A. Druckman,et al.  Household energy consumption in the UK: A highly geographically and socio-economically disaggregated model , 2008 .

[6]  Aidan Duffy,et al.  Evaluation of time series techniques to characterise domestic electricity demand , 2013 .

[7]  Christoph Teller,et al.  Retailing in the United Kingdom - a Synopsis , 2010 .

[8]  Ofcom International communications market report 2015 , 2015 .

[9]  Alex Pentl,et al.  Reality Mining of Mobile Communications: Toward A New Deal On Data , 2009 .

[10]  A. Pentland,et al.  Computational Social Science , 2009, Science.

[11]  A. Rogers,et al.  Bus, bike and random journeys: Crowdsourcing aid distribution in Ivory Coast , 2013 .

[12]  John W. Emerson,et al.  Don't drown in the data , 2012 .

[13]  Kevin J. Lomas,et al.  Identifying trends in the use of domestic appliances from household electricity consumption measurements , 2008 .

[14]  Piet Daas,et al.  Official statistics and Big Data , 2014 .

[15]  Fintan McLoughlin,et al.  Characterising Domestic Electricity Demand for Customer Load Profile Segmentation , 2013 .

[16]  P. Furness Real time geodemographics: New services and business opportunities (and risks) from analysing people in time and space , 2008 .

[17]  Keith Dugmore Information Collected by Commercial Companies: What Might be of Value to Official Statistics? The Case of the UK Office for National Statistics , 2010 .

[18]  Silvia Santini,et al.  Automatic socio-economic classification of households using electricity consumption data , 2013, e-Energy '13.

[19]  Ian Gray,et al.  Three maps and three misunderstandings: A digital mapping of climate diplomacy , 2014, Big Data Soc..

[20]  Nick Malleson,et al.  New Insights into Individual Activity Spaces using Crowd-Sourced Big Data , 2014 .

[21]  R. Webber Response to `The Coming Crisis of Empirical Sociology': An Outline of the Research Potential of Administrative and Transactional Data , 2009 .

[22]  Silvia Santini,et al.  Occupancy Detection from Electricity Consumption Data , 2013, BuildSys@SenSys.

[23]  J. Gareth Polhill,et al.  The North East Scotland Energy Monitoring Project: Exploring relationships between household occupants and energy usage , 2014, Energy and Buildings.

[24]  Joeri Naus,et al.  Smart grids, information flows and emerging domestic energy practices , 2014 .

[25]  P. James,et al.  Initial effects of a community-based initiative for energy saving: an experimental analysis , 2013 .

[26]  A. Wright,et al.  The nature of domestic electricity-loads and effects of time averaging on statistics and on-site generation calculations , 2007 .

[27]  Daniel Vickers,et al.  Introducing the area classification of output areas. , 2006, Population trends.

[28]  Michael Batty,et al.  Big data, smart cities and city planning , 2013, Dialogues in human geography.

[29]  Barry Leventhal,et al.  Beyond the 2011 Census in the United Kingdom: With an International Perspective , 2011 .

[30]  Lada A. Adamic,et al.  Computational Social Science , 2009, Science.

[31]  J. Reades,et al.  On the value of Digital Traces for commercial strategy and public policy: Telecommunications data as a case study , 2012 .

[32]  EXPLORATION OF ELECTRICITY USAGE DATA FROM SMART METERS TO INVESTIGATE HOUSEHOLD COMPOSITION , 2013 .

[33]  Ichiro Hagiwara,et al.  540 A NEW ERROR-MEASURE FOR COMPARISON SHAPES , 2005 .

[34]  Rob Kitchin What does big data mean for official statistics , 2015 .

[35]  Peter Grindrod,et al.  A new error measure for forecasts of household-level, high resolution electrical energy consumption , 2014 .

[36]  Brian Norton,et al.  Real-life energy use in the UK: How occupancy and dwelling characteristics affect domestic electricity use , 2008 .

[37]  Mark Graham,et al.  Geography and the future of big data, big data and the future of geography , 2013 .

[38]  Silvia Santini,et al.  Towards automatic classification of private households using electricity consumption data , 2012, BuildSys@SenSys.