Smart Meter Analysis Using Big Data Techniques

In the present-day, many government firms and global companies pay emphasis on energy conservation and efficient use of energy. The smart meter data have mapped a way to use energy efficiently. The need to use energy in an efficient way is very much required for developing countries like India. The emergence of smart meter gave us access to huge amounts of energy consumption data. It is an electronic component that records utilization of electric energy at regular intervals of time, be it hours, minutes, or seconds. This paper proposes a different method for grouping electricity consumption. Through smart meter, we get a huge amount of energy consumption data. These data are analyzed by various energy distribution companies which further leads to prediction of demand and consumption of user. Our paper uses a business intelligence tool such as map reduction to handle these data sets. Taking the advantage of this tool, energy distribution companies can reduce the investment by making the use of community hardware. Using distributed computing tools we can reduce the processing time appreciably to enable real-time monitoring and decision-making. Further, R is integrated to it to perform analysis. Various data sets are used to check the potential of the proposed models and approaches.

[1]  Heng Huang,et al.  Using Smart Meter Data to Improve the Accuracy of Intraday Load Forecasting Considering Customer Behavior Similarities , 2015, IEEE Transactions on Smart Grid.

[2]  Pete Wyckoff,et al.  Hive - A Warehousing Solution Over a Map-Reduce Framework , 2009, Proc. VLDB Endow..

[3]  Christoforos E. Kozyrakis,et al.  On the energy (in)efficiency of Hadoop clusters , 2010, OPSR.

[4]  Kunle Olukotun,et al.  Map-Reduce for Machine Learning on Multicore , 2006, NIPS.

[5]  Meina Song,et al.  THE optimization of HDFS based on small files , 2010, 2010 3rd IEEE International Conference on Broadband Network and Multimedia Technology (IC-BNMT).

[6]  Siddharth Swarup Rautaray,et al.  Big Data Analytics for Medical Applications , 2018 .

[7]  Liang Dong,et al.  Starfish: A Self-tuning System for Big Data Analytics , 2011, CIDR.

[8]  Keith W. Miller,et al.  Big Data: New Opportunities and New Challenges [Guest editors' introduction] , 2013, Computer.

[9]  Jan Szargut,et al.  Exergy Analysis of Thermal, Chemical, and Metallurgical Processes , 1988 .

[10]  Ankush Pramod Deshmukh,et al.  Introduction to Hadoop Distributed File System , 2012 .

[11]  Karthik Ranganathan,et al.  Apache hadoop goes realtime at Facebook , 2011, SIGMOD '11.

[12]  Martin Nilsson,et al.  Investigating the energy consumption of a wireless network interface in an ad hoc networking environment , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[13]  Albert G. Greenberg,et al.  Reining in the Outliers in Map-Reduce Clusters using Mantri , 2010, OSDI.

[14]  Aditya B. Patel,et al.  Addressing big data problem using Hadoop and Map Reduce , 2012, 2012 Nirma University International Conference on Engineering (NUiCONE).

[15]  Siddharth Swarup Rautaray,et al.  A Proposal for Optimization of Horizontal Scaling in Big Data Environment , 2018 .

[16]  R. Rajagopal,et al.  Determinants of residential electricity consumption: Using smart meter data to examine the effect of climate, building characteristics, appliance stock, and occupants' behavior , 2013 .

[17]  Georgios Kalogridis,et al.  Smart Grid Privacy via Anonymization of Smart Metering Data , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[18]  Xubin He,et al.  Implementing WebGIS on Hadoop: A case study of improving small file I/O performance on HDFS , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.