An Incremental Clustering Algorithm with Pattern Drift Detection for IoT-Enabled Smart Grid System

The IoT-enabled smart grid system provides smart meter data for electricity consumers to record their energy consumption behaviors, the typical features of which can be represented by the load patterns extracted from load data clustering. The changeability of consumption behaviors requires load pattern update for achieving accurate consumer segmentation and effective demand response. In order to save training time and reduce computation scale, we propose a novel incremental clustering algorithm with probability strategy, ICluster-PS, instead of overall load data clustering to update load patterns. ICluster-PS first conducts new load pattern extraction based on the existing load patterns and new data. Then, it intergrades new load patterns with the existing ones. Finally, it optimizes the intergraded load pattern sets by a further modification. Moreover, ICluster-PS can be performed continuously with new coming data due to parameter updating and generalization. Extensive experiments are implemented on real-world dataset containing diverse consumer types in various districts. The experimental results are evaluated by both clustering validity indices and accuracy measures, which indicate that ICluster-PS outperforms other related incremental clustering algorithm. Additionally, according to the further case studies on pattern evolution analysis, ICluster-PS is able to present any pattern drifts through its incremental clustering results.

[1]  Ming-Hung Chen,et al.  A Smart Home Energy Management System Using Two-Stage Non-Intrusive Appliance Load Monitoring over Fog-Cloud Analytics Based on Tridium’s Niagara Framework for Residential Demand-Side Management , 2021, Sensors.

[2]  Abdulsalam Yassine,et al.  Consumer Segmentation: Improving Energy Demand Management through Households Socio-Analytics , 2019, 2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech).

[3]  Zibin Zheng,et al.  Wide and Deep Convolutional Neural Networks for Electricity-Theft Detection to Secure Smart Grids , 2018, IEEE Transactions on Industrial Informatics.

[4]  Lachlan L. H. Andrew,et al.  Short-term residential load forecasting: Impact of calendar effects and forecast granularity , 2017 .

[5]  Soroush Omidvar Tehrani,et al.  Filter Based Time-Series Anomaly Detection in AMI using AI Approaches , 2021, IoT.

[6]  Ghulam Hafeez,et al.  Electric load forecasting based on deep learning and optimized by heuristic algorithm in smart grid , 2020 .

[7]  Hyo-Sik Yang,et al.  A Comprehensive Review on IoT Protocols’ Features in Smart Grid Communication , 2020, Energies.

[8]  Heiko Wersing,et al.  Incremental on-line learning: A review and comparison of state of the art algorithms , 2018, Neurocomputing.

[9]  Yi Wang,et al.  Clustering of Electricity Consumption Behavior Dynamics Toward Big Data Applications , 2016, IEEE Transactions on Smart Grid.

[10]  Eenjun Hwang,et al.  Recurrent inception convolution neural network for multi short-term load forecasting , 2019, Energy and Buildings.

[11]  Hao Liang,et al.  Blockchain for Cybersecurity in Smart Grid: A Comprehensive Survey , 2021, IEEE Transactions on Industrial Informatics.

[12]  Hans-Peter Kriegel,et al.  Density Based Subspace Clustering over Dynamic Data , 2011, SSDBM.

[13]  Daniel Berrar,et al.  SOINN+, a Self-Organizing Incremental Neural Network for Unsupervised Learning from Noisy Data Streams , 2020, Expert Syst. Appl..

[14]  Preeti Mulay,et al.  A bibliometric survey on incremental clustering algorithm for electricity smart meter data analysis , 2019, Iran Journal of Computer Science.

[15]  Chunyan Miao,et al.  Learning Relative Similarity from Data Streams: Active Online Learning Approaches , 2015, CIKM.

[16]  MarxerRicard,et al.  Unsupervised incremental online learning and prediction of musical audio signals , 2016 .

[17]  Mustapha Lebbah,et al.  State-of-the-art on clustering data streams , 2016 .

[18]  Chongqing Kang,et al.  Load profiling and its application to demand response: A review , 2015 .

[19]  Yingjie Tian,et al.  A Comprehensive Survey of Clustering Algorithms , 2015, Annals of Data Science.

[20]  Chris Develder,et al.  Two-Stage Load Pattern Clustering Using Fast Wavelet Transformation , 2016, IEEE Transactions on Smart Grid.

[21]  Khaled Salah,et al.  Blockchain Technology for Smart Grids: Decentralized NIST Conceptual Model , 2020, IEEE Access.

[22]  Jean Paul Barddal,et al.  SNCStream+: Extending a high quality true anytime data stream clustering algorithm , 2016, Inf. Syst..

[23]  Wilson S. Melo,et al.  When Measurements Meet Blockchain: On Behalf of an Inter-NMI Network † , 2021, Sensors.

[24]  Barbara Hammer,et al.  Incremental learning algorithms and applications , 2016, ESANN.

[25]  Vladimir Braverman,et al.  Clustering High Dimensional Dynamic Data Streams , 2017, ICML.

[26]  Jeonghun Cha,et al.  Machine learning based distributed big data analysis framework for next generation web in IoT , 2021, Comput. Sci. Inf. Syst..

[27]  Gianfranco Chicco,et al.  Overview and performance assessment of the clustering methods for electrical load pattern grouping , 2012 .

[28]  Fangchun Yang,et al.  A Fused Load Curve Clustering Algorithm Based on Wavelet Transform , 2018, IEEE Transactions on Industrial Informatics.

[29]  Erick de Andrade Barboza,et al.  A Low-Cost IoT System for Real-Time Monitoring of Climatic Variables and Photovoltaic Generation for Smart Grid Application , 2021, Sensors.

[30]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Plamen Angelov,et al.  Fully online clustering of evolving data streams into arbitrarily shaped clusters , 2017, Inf. Sci..

[32]  Wee Keong Ng,et al.  A survey on data stream clustering and classification , 2015, Knowledge and Information Systems.

[33]  Shauhrat S. Chopra,et al.  Distributed Energy Resources and the Application of AI, IoT, and Blockchain in Smart Grids , 2020, Energies.

[34]  Sushil Kumar Singh,et al.  OTS Scheme Based Secure Architecture for Energy-Efficient IoT in Edge Infrastructure , 2021 .

[35]  Hongjie Jia,et al.  Study on density peaks clustering based on k-nearest neighbors and principal component analysis , 2016, Knowl. Based Syst..

[36]  Philip S. Yu,et al.  A Framework for Projected Clustering of High Dimensional Data Streams , 2004, VLDB.

[37]  Laurence T. Yang,et al.  An Incremental CFS Algorithm for Clustering Large Data in Industrial Internet of Things , 2017, IEEE Transactions on Industrial Informatics.

[38]  Fangchun Yang,et al.  Incremental Electricity Consumer Behavior Learning Using Smart Meter Data , 2019, ICBDC 2019.

[39]  Dan Wang,et al.  Data stream clustering based on Fuzzy C-Mean algorithm and entropy theory , 2016, Signal Process..

[40]  J. Garibaldi,et al.  A new accuracy measure based on bounded relative error for time series forecasting , 2017, PloS one.

[41]  Volkan Atalay,et al.  Data stream clustering: a review , 2020, Artificial Intelligence Review.

[42]  Ioannis P. Panapakidis,et al.  Enhancing the clustering process in the category model load profiling , 2015 .

[43]  Yuan Yan Tang,et al.  New Incremental Learning Algorithm With Support Vector Machines , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[44]  Abbas Z. Kouzani,et al.  Cluster Analysis and Model Comparison Using Smart Meter Data , 2021, Sensors.

[45]  Ricardo J. G. B. Campello,et al.  On the Comparison of Relative Clustering Validity Criteria , 2009, SDM.

[46]  Bo Sheng,et al.  An Algorithm for Mining Gradual Moving Object Clusters Pattern From Trajectory Streams , 2019 .

[47]  Meng Li,et al.  An Efficient Supervised Energy Disaggregation Scheme for Power Service in Smart Grid , 2019 .

[48]  Athanasios V. Vasilakos,et al.  Designing Blockchain-Based Access Control Protocol in IoT-Enabled Smart-Grid System , 2021, IEEE Internet of Things Journal.

[49]  Fangchun Yang,et al.  A Hybrid Machine Learning Model for Electricity Consumer Categorization Using Smart Meter Data , 2018, Energies.

[50]  Peter A. Flach,et al.  Feature Construction and Calibration for Clustering Daily Load Curves from Smart-Meter Data , 2016, IEEE Trans. Ind. Informatics.

[51]  Benahmed Khelifa,et al.  A Cryptographic-Based Approach For Electricity Theft Detection in Smart Grid , 2020 .