One-Class Graph Neural Networks for Anomaly Detection in Attributed Networks

Nowadays, graph-structured data are increasingly used to model complex systems. Meanwhile, detecting anomalies from graph has become a vital research problem of pressing societal concerns. Anomaly detection is an unsupervised learning task of identifying rare data that differ from the majority. As one of the dominant anomaly detection algorithms, One Class Support Vector Machine has been widely used to detect outliers. However, those traditional anomaly detection methods lost their effectiveness in graph data. Since traditional anomaly detection methods are stable, robust and easy to use, it is vitally important to generalize them to graph data. In this work, we propose One Class Graph Neural Network (OCGNN), a one-class classification framework for graph anomaly detection. OCGNN is designed to combine the powerful representation ability of Graph Neural Networks along with the classical one-class objective. Compared with other baselines, OCGNN achieves significant improvements in extensive experiments.

[1]  Klemens Böhm,et al.  Statistical Selection of Congruent Subspaces for Mining Attributed Graphs , 2013, 2013 IEEE 13th International Conference on Data Mining.

[2]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[3]  Tommy W. S. Chow,et al.  Tree2Vector: Learning a Vectorial Representation for Tree-Structured Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Yizhou Sun,et al.  On community outliers and their efficient detection in information networks , 2010, KDD.

[5]  Yupu Yang,et al.  Self-adversarial Variational Autoencoder with Gaussian Anomaly Prior Distribution for Anomaly Detection , 2019, Knowl. Based Syst..

[6]  Wenwu Zhu,et al.  Deep Learning on Graphs: A Survey , 2018, IEEE Transactions on Knowledge and Data Engineering.

[7]  R.J. Marks,et al.  Implicit learning in autoencoder novelty assessment , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[8]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[9]  Jundong Li,et al.  SpecAE: Spectral AutoEncoder for Anomaly Detection in Attributed Networks , 2019, CIKM.

[10]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[11]  Alex Fout,et al.  Protein Interface Prediction using Graph Convolutional Networks , 2017, NIPS.

[12]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[13]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[14]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[15]  Toyotaro Suzumura,et al.  Scalable Graph Learning for Anti-Money Laundering: A First Look , 2018, ArXiv.

[16]  Qinghua Zheng,et al.  ANOMALOUS: A Joint Modeling Approach for Anomaly Detection on Attributed Networks , 2018, IJCAI.

[17]  Huan Liu,et al.  Deep Anomaly Detection on Attributed Networks , 2019, SDM.

[18]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[19]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[20]  David J. Olive,et al.  Principal Component Analysis , 2011, International Encyclopedia of Statistical Science.

[21]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD 2000.

[22]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[23]  Xavier Bresson,et al.  Residual Gated Graph ConvNets , 2017, ArXiv.

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Ken-ichi Kawarabayashi,et al.  Representation Learning on Graphs with Jumping Knowledge Networks , 2018, ICML.

[26]  Alexander Binder,et al.  Deep One-Class Classification , 2018, ICML.

[27]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[28]  Emmanuel Müller,et al.  Focused clustering and outlier detection in large attributed graphs , 2014, KDD.

[29]  Jun Zhou,et al.  A Semi-Supervised Graph Attentive Network for Financial Fraud Detection , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[30]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[31]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[32]  Alex Smola,et al.  Deep Graph Library: Towards Efficient and Scalable Deep Learning on Graphs , 2019, ArXiv.

[33]  Huan Liu,et al.  Radar: Residual Analysis for Anomaly Detection in Attributed Networks , 2017, IJCAI.

[34]  Jing Wang,et al.  Actor Model Anomaly Detection Using Kernel Principal Component Analysis , 2018, ICONIP.

[35]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[36]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[37]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[38]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[39]  Meng Wang,et al.  Generative Adversarial Active Learning for Unsupervised Outlier Detection , 2018, IEEE Transactions on Knowledge and Data Engineering.

[40]  Chien-Liang Liu,et al.  Model-Based Synthetic Sampling for Imbalanced Data , 2020, IEEE Transactions on Knowledge and Data Engineering.

[41]  Daniel R. Figueiredo,et al.  struc2vec: Learning Node Representations from Structural Identity , 2017, KDD.

[42]  Leman Akoglu,et al.  Scalable Anomaly Ranking of Attributed Neighborhoods , 2016, SDM.

[43]  Charu C. Aggarwal,et al.  Outlier Detection with Autoencoder Ensembles , 2017, SDM.

[44]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[45]  David A. Clifton,et al.  A review of novelty detection , 2014, Signal Process..

[46]  Philip S. Yu,et al.  Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks , 2019, IJCAI.

[47]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[48]  Randy C. Paffenroth,et al.  Anomaly Detection with Robust Deep Autoencoders , 2017, KDD.

[49]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[50]  Hazem N. Nounou,et al.  Iterated Robust kernel Fuzzy Principal Component Analysis and application to fault detection , 2016, J. Comput. Sci..

[51]  I. Jolliffe.  Principal Component Analysis , 2002 .