GAN-Based Anomaly Detection and Localization of Multivariate Time Series Data for Power Plant

Recently, as real-time sensor data collection increases in various fields such as power plants, smart factories, and health care systems, anomaly detection for multivariate time series data analysis becomes more important. However, extracting significant features from multivariate time series data is still challenging because it simultaneously takes into account the correlation between the pair of sensors and temporal information of each time series. Meanwhile, in the field of image based anomaly detection, Generative Adversarial Networks(GANs) is developed due to its ability to model the complex high-dimensional distribution of images. In this paper, we propose a novel GAN-based anomaly detection and localization framework along with a transformation method for time series imaging, called distance image. Our goal is to learn a mapping a series of distance image to the next distance image. The transforming multivariate time series into 2D image allows us to exploit encoder and decoder structure. Especially, the encoder with pointwise convolution in a series of images ensures to encode temporal information of each time series data as well the correlation between each variable. As a result, an anomaly can be detected and localized by conducting a residual image and an anomaly score function. We empirically demonstrate the effectiveness of our approach for anomaly detection tasks on a real-world power plant data.

[1]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[2]  Toby P. Breckon,et al.  GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training , 2018, ACCV.

[3]  See-Kiong Ng,et al.  Anomaly Detection with Generative Adversarial Networks for Multivariate Time Series , 2018, ArXiv.

[4]  B. Ravi Kiran,et al.  An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos , 2018, J. Imaging.

[5]  Bo Zong,et al.  A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data , 2018, AAAI.

[6]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Raghavendra Chalapathy University of Sydney,et al.  Deep Learning for Anomaly Detection: A Survey , 2019, ArXiv.

[8]  Lei Shi,et al.  MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks , 2019, ICANN.

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[11]  Georg Langs,et al.  Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery , 2017, IPMI.

[12]  Tim Oates,et al.  Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks , 2014 .

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[15]  S. Lele,et al.  Euclidean distance matrix analysis: a coordinate-free approach for comparing biological shapes using landmark data. , 1991, American journal of physical anthropology.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[17]  Man-Ki Yoon,et al.  Grouped Convolutional Neural Networks for Multivariate Time Series , 2017, ArXiv.

[18]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.