Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems Monitoring Data

Due to the growing amount of data from in-situ sensors in wastewater systems, it becomes necessary to automatically identify abnormal behaviours and ensure high data quality. This paper proposes an anomaly detection method based on a deep autoencoder for in-situ wastewater systems monitoring data. The autoencoder architecture is based on 1D Convolutional Neural Network (CNN) layers where the convolutions are performed over the inputs across the temporal axis of the data. Anomaly detection is then performed based on the reconstruction error of the decoding stage. The approach is validated on multivariate time series from in-sewer process monitoring data. We discuss the results and the challenge of labelling anomalies in complex time series. We suggest that our proposed approach can support the domain experts in the identification of anomalies.

[1]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[2]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[3]  M Mourad,et al.  A method for automatic validation of long time series of data in urban hydrology. , 2002, Water science and technology : a journal of the International Association on Water Pollution Research.

[4]  Janelcy Alferes,et al.  Advanced monitoring of water systems using in situ measurement stations: data validation and fault detection. , 2013, Water science and technology : a journal of the International Association on Water Pollution Research.

[5]  Andreas Dengel,et al.  DeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series , 2019, IEEE Access.

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Marimuthu Palaniswami,et al.  Anomaly Detection in Environmental Monitoring Networks [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[8]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[9]  Bryan R. Conroy,et al.  Ensemble of feature-based and deep learning-based classifiers for detection of abnormal heart sounds , 2016, 2016 Computing in Cardiology Conference (CinC).

[10]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[11]  L. Montestruque,et al.  Using Embedded Sensor Networks to Monitor, Control, and Reduce CSO Events: A Pilot Study , 2007 .

[12]  Kerrie Mengersen,et al.  A framework for automated anomaly detection in high frequency water-quality data from in situ sensors. , 2018, The Science of the total environment.

[13]  Waldo Hasperué,et al.  The master algorithm: how the quest for the ultimate learning machine will remake our world , 2015 .

[14]  Charu C. Aggarwal,et al.  Outlier Analysis , 2013, Springer New York.

[15]  N Branisavljević,et al.  Automatic, semi-automatic and manual validation of urban drainage data. , 2010, Water science and technology : a journal of the International Association on Water Pollution Research.

[16]  Frank Blumensaat,et al.  Synchronous LoRa Mesh Network to Monitor Processes in Underground Infrastructure , 2019, IEEE Access.

[17]  S Matteoli,et al.  A tutorial overview of anomaly detection in hyperspectral images , 2010, IEEE Aerospace and Electronic Systems Magazine.

[18]  David J. Hill,et al.  Anomaly detection in streaming environmental sensor data: A data-driven modeling approach , 2010, Environ. Model. Softw..

[19]  Subutai Ahmad,et al.  Unsupervised real-time anomaly detection for streaming data , 2017, Neurocomputing.

[20]  Li Ren,et al.  Abrupt Event Monitoring for Water Environment System Based on KPCA and SVM , 2012, IEEE Transactions on Instrumentation and Measurement.

[21]  Simin Nadjm-Tehrani,et al.  Anomaly Detection in Water Management Systems , 2012, Critical Infrastructure Protection.

[22]  Tingxi Wen,et al.  Deep Convolution Neural Network and Autoencoders-Based Unsupervised Feature Learning of EEG Signals , 2018, IEEE Access.