Anomaly detection in Smart Grid data: An experience report

In recent years, we have been witnessing profound transformation of energy distribution systems fueled by Information and Communication Technologies (ICT), towards the so called Smart Grid. However, while the Smart Grid design strategies have been studied by academia, only anecdotal guidance is provided to the industry with respect to increasing the level of grid intelligence. In this paper, we report on a successful project in assisting the industry in this way, via conducting a large anomaly-detection study on the data of one of the power distribution companies in the Czech Republic. In the study, we move away from the concept of single events identified as anomaly to the concept of collective anomaly, that is itemsets of events that may be anomalous based on their patterns of appearance. This can assist the operators of the distribution system in the transformation of their grid to a smarter grid. By analyzing Smart Meters data streams, we used frequent itemset mining and categorical clustering with clustering silhouette thresholding to detect anomalous behaviour. As the main result, we provided to stakeholders both a visual representation of the candidate anomalies and the identification of the top-10 anomalies for a subset of Smart Meters.

[1]  Chris Develder,et al.  Combining Power and Communication Network Simulation for Cost-Effective Smart Grid Analysis , 2014, IEEE Communications Surveys & Tutorials.

[2]  Pierluigi Siano,et al.  Failure Identification in Smart Grids Based on Petri Net Modeling , 2011, IEEE Transactions on Industrial Electronics.

[3]  Miao He,et al.  A Dependency Graph Approach for Fault Detection and Localization Towards Secure Smart Grid , 2011, IEEE Transactions on Smart Grid.

[4]  William H. Sanders,et al.  Intrusion Detection for Advanced Metering Infrastructures: Requirements and Architectural Directions , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[5]  Yi Li,et al.  Bootstrapping a data mining intrusion detection system , 2003, SAC '03.

[6]  亮 高橋 First IEEE International Conference on Smart Grid Communications(SmartGridComm 2010)に参加して(国際会議の報告) , 2011 .

[7]  P. Rousseeuw,et al.  Displaying a clustering with CLUSPLOT , 1999 .

[8]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[9]  Svetha Venkatesh,et al.  Recognition of emergent human behaviour in a smart home: A data mining approach , 2007, Pervasive Mob. Comput..

[10]  Zhuo Lu,et al.  Cyber security in the Smart Grid: Survey and challenges , 2013, Comput. Networks.

[11]  Loi Lei Lai,et al.  Application of Big Data in Smart Grid , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[13]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[14]  Tzung-Pei Hong,et al.  A Brief Introduction to Classification for Smart Grid , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[15]  Yi Li,et al.  COOLCAT: an entropy-based algorithm for categorical clustering , 2002, CIKM '02.

[16]  João Gama,et al.  Holistic distributed stream clustering for smart grids , 2013 .

[17]  Hamid Sharif,et al.  A Survey on Cyber Security for Smart Grid Communications , 2012, IEEE Communications Surveys & Tutorials.

[18]  Xi Fang,et al.  3. Full Four-channel 6.3-gb/s 60-ghz Cmos Transceiver with Low-power Analog and Digital Baseband Circuitry 7. Smart Grid — the New and Improved Power Grid: a Survey , 2022 .

[19]  Taskin Koçak,et al.  A Survey on Smart Grid Potential Applications and Communication Requirements , 2013, IEEE Transactions on Industrial Informatics.

[20]  Michael Zeifman,et al.  Smart meter data analytics: Prediction of enrollment in residential energy efficiency programs , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[21]  Robert C. Green,et al.  Intrusion Detection System in A Multi-Layer Network Architecture of Smart Grids by Yichi , 2015 .

[22]  James D. B. Nelson,et al.  Online joint classification and anomaly detection via sparse coding , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[23]  Chen-Ching Liu,et al.  Anomaly Detection for Cybersecurity of the Substations , 2011, IEEE Transactions on Smart Grid.