Benchmarking Big Data Technologies for Energy Procurement Efficiency

The electrical power industry is undergoing radical change due to the push for renewable energy that makes energy supply less predictable. Smart meters along with analytics software can grant insights into customerspecific consumption and thereby enable a better match between the demand and supply side for an electric utility. However, the vast amount of allocatable smart metering data and complexity of analytics pose challenges to database system. We address the implementation of an analytics approach to optimize customer portfolios, eventually preventing excess energy procurement. Using real-world and simulated data, we test the suitability of big data approaches as well as traditional relational database technology. Furthermore, we present solutions based on big data platforms and demonstrate their cost effectiveness and performance. Our findings suggest economic feasibility of big data solutions for large utilities. Small and medium-sized utilities are advised to invest in more cost-effective solutions such as cluster-based systems.

[1]  George K. Karagiannidis,et al.  Big Data Analytics for Dynamic Energy Management in Smart Grids , 2015, Big Data Res..

[2]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[3]  E. F. CODD,et al.  A relational model of data for large shared data banks , 1970, CACM.

[4]  Holger Ziekow,et al.  Dealing with Data Quality in Smart Home Environments - Lessons Learned from a Smart Grid Pilot , 2016, J. Sens. Actuator Networks.

[5]  Holger Ziekow,et al.  Targeting customers for an optimized energy procurement , 2017, Computer Science - Research and Development.

[6]  Gordana Dodig Crnkovic,et al.  Constructive Research and Info-computational Knowledge Generation , 2010 .

[7]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[8]  Wojciech M. Golab,et al.  Benchmarking Smart Meter Data Analytics , 2015, EDBT.

[9]  Ram Rajagopal,et al.  Pricing Residential Electricity Based on Individual Consumption Behaviors , 2013, PES 2013.

[10]  Nathan Marz,et al.  Big Data: Principles and best practices of scalable realtime data systems , 2015 .

[11]  Holger Ziekow,et al.  Forecasting household electricity demand with complex event processing: insights from a prototypical solution , 2013, Middleware Industry '13.

[12]  Ram Rajagopal,et al.  Cost-of-Service Segmentation of Energy Consumers , 2014, IEEE Transactions on Power Systems.

[13]  Martin Grund,et al.  Impala: A Modern, Open-Source SQL Engine for Hadoop , 2015, CIDR.

[14]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[15]  Oliver D. Doleski,et al.  Einführung in den Smart Meter Rollout , 2013 .