Automated Anomaly Detection Assisted by Discrimination Model for Time Series

As more and more sensor data have been recorded, automated anomaly detection of high reliability is urgently needed to lessen the increasing monitoring burden and reduce the risk of system faults. To this end, this paper proposes a method named Anomaly Detection Assisted by Discrimination Model (ADADM). In ADADM, the anomaly score for each point in sequences is calculated using an LSTM-based Encoder-Decoder model. In the mean time, a discrimination model based on ALSTM-FCN distinguishes the subsequences containing the Known Type Anomalies (KTAs) from others. Finally, we set two different thresholds for above two types of subsequences respectively and determine the anomalous points according to the anomaly scores and the corresponding threshold. Experiments on four real datasets of periodicity/aperiodicity and univariable/multivariable demonstrate that not only ADADM can improve the overall performance significantly, but also can improve the precision and recall of the anomaly detection simultaneously.

[1]  Houshang Darabi,et al.  Multivariate LSTM-FCNs for Time Series Classification , 2018, Neural Networks.

[2]  Eamonn J. Keogh,et al.  HOT SAX: efficiently finding the most unusual time series subsequence , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[3]  Andreas Theissler,et al.  Detecting known and unknown faults in automotive systems using ensemble-based anomaly detection , 2017, Knowl. Based Syst..

[4]  Valentino Constantinou,et al.  Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding , 2018, KDD.

[5]  Ehab Al-Shaer,et al.  Automated Anomaly Detector Adaptation using Adaptive Threshold Tuning , 2013, TSEC.

[6]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Chang Ouk Kim,et al.  A Convolutional Neural Network for Fault Classification and Diagnosis in Semiconductor Manufacturing Processes , 2017, IEEE Transactions on Semiconductor Manufacturing.

[8]  Lars Schmidt-Thieme,et al.  INSIGHT: Efficient and Effective Instance Selection for Time-Series Classification , 2011, PAKDD.

[9]  Lance Sherry,et al.  Anomaly detection in aircraft data using Recurrent Neural Networks (RNN) , 2016, 2016 Integrated Communications Navigation and Surveillance (ICNS).

[10]  Marius Kloft,et al.  Toward Supervised Anomaly Detection , 2014, J. Artif. Intell. Res..

[11]  Lovekesh Vig,et al.  LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection , 2016, ArXiv.

[12]  Nathalie Japkowicz,et al.  Anomaly Detection in Automobile Control Network Data with Long Short-Term Memory Networks , 2016, 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[13]  Charles C. Kemp,et al.  A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder , 2017, IEEE Robotics and Automation Letters.

[14]  Gustavo E. A. P. A. Batista,et al.  Time Series Classification with Representation Ensembles , 2015, IDA.

[15]  James D. B. Nelson,et al.  Online joint classification and anomaly detection via sparse coding , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[16]  Nhien-An Le-Khac,et al.  Collective Anomaly Detection Based on Long Short-Term Memory Recurrent Neural Networks , 2016, FDSE.

[17]  Peter Schegner,et al.  Classification and identification of anomalies in time series of power quality measurements , 2016, 2016 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe).

[18]  Yanchun Zhang,et al.  Supervised Anomaly Detection in Uncertain Pseudoperiodic Data Streams , 2016, ACM Trans. Internet Techn..

[19]  Dominique T. Shipmon,et al.  Time Series Anomaly Detection; Detection of anomalous drops with limited features and sparse examples in noisy highly periodic data , 2017, ArXiv.

[20]  Junyu Dong,et al.  Dual channel LSTM based multi-feature extraction in gait for diagnosis of Neurodegenerative diseases , 2018, Knowl. Based Syst..

[21]  Francesco Piazza,et al.  Acoustic novelty detection with adversarial autoencoders , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[22]  Justin A. Blanco,et al.  Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement , 2011, Journal of neural engineering.