A deep learning approach for anomaly detection and prediction in power consumption data

Anomaly detection in power consumption data can be very useful to building managers. It allows them to detect unexpected power consumption values, identify unusual behaviors, and foresee uncommon events. This paper proposes a novel unsupervised approach to detect anomalies in power consumption data. We combine the clustering-based methods with the prediction-based ones to learn typical behavior scenarios and to predict the power consumption of the next hour. These scenarios are explored by applying the K-means algorithm on 24 different K-means groups representing the 24 h of the day. This is based on the assumption that identical daily consumption behavior can appear repeatedly due to users’ living habits. In order to detect the anomaly 1 h before its occurrence, a Long Short-Term Memory (LSTM) has been trained to predict the next power consumption value. This predicted value with some earlier data values are concatenated into a vector then compared with the learned typical scenarios. We used Auto-Encoders to detect anomalous days in general and this novel method to specify at what time the anomaly has occurred. Our approach not only detectss anomalies in off-line mode but also allows real-time detection on live data streams.

[1]  Jui-Sheng Chou,et al.  Real-time detection of anomalous power consumption , 2014 .

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[4]  Jürgen Maier,et al.  UNEP – United Nations Environment Programme , 2000, A Concise Encyclopedia of the United Nations.

[5]  David C. Hoaglin,et al.  Some Implementations of the Boxplot , 1989 .

[6]  Maarten van Someren,et al.  Short-term anomaly detection in gas consumption through ARIMA and Artificial Neural Network forecast , 2015, EESMS 2015.

[7]  B. Abraham,et al.  Outlier detection and time series modeling , 1989 .

[8]  Pedro Antmann,et al.  Reducing Technical and Non-Technical Losses in the Power Sector , 2009 .

[9]  Weiwei Chen,et al.  Anomaly detection in premise energy consumption data , 2011, 2011 IEEE Power and Energy Society General Meeting.

[10]  Young M. Lee,et al.  IBM Research Report Statistical Modeling for Anomaly Detection, Forecasting and Root Cause Analysis of Energy Consumption for a Portfolio of Buildings , 2011 .

[11]  Éric Gaussier,et al.  Generalized k-means-based clustering for temporal data under weighted and kernel time warp , 2016, Pattern Recognit. Lett..

[12]  Victor C. M. Leung,et al.  Electricity Theft Detection in AMI Using Customers’ Consumption Patterns , 2016, IEEE Transactions on Smart Grid.

[13]  G. Box,et al.  Bayesian analysis of some outlier problems in time series , 1979 .

[14]  Salvatore J. Stolfo,et al.  Real time data mining-based intrusion detection , 2001, Proceedings DARPA Information Survivability Conference and Exposition II. DISCEX'01.

[15]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[16]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..