ResGCN: attention-based deep residual modeling for anomaly detection on attributed networks

Effectively detecting anomalous nodes in attributed networks is crucial for the success of many real-world applications such as fraud and intrusion detection. Existing approaches have difficulties with three major issues: sparsity and nonlinearity capturing, residual modeling, and network smoothing. We propose Residual Graph Convolutional Network (ResGCN), an attention-based deep residual modeling approach that can tackle these issues: modeling the attributed networks with GCN allows to capture the sparsity and nonlinearity; utilizing a deep neural network allows to directly learn residual from the input, and a residual-based attention mechanism reduces the adverse effect from anomalous nodes and prevents over-smoothing. Extensive experiments on several real-world attributed networks demonstrate the effectiveness of ResGCN in detecting anomalies.

[1]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[2]  Rushed Kanawati,et al.  Community detection in Attributed Network , 2018, WWW.

[3]  Yizhou Sun,et al.  On community outliers and their efficient detection in information networks , 2010, KDD.

[4]  Xiao Huang,et al.  Accelerated Attributed Network Embedding , 2017, SDM.

[5]  Huan Liu,et al.  Interactive Anomaly Detection on Attributed Networks , 2019, WSDM.

[6]  Wenwu Zhu,et al.  Disentangled Graph Convolutional Networks , 2019, ICML.

[7]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[8]  Srinivasan Parthasarathy,et al.  SEANO: Semi-supervised Embedding in Attributed Networks with Outliers , 2017, SDM.

[9]  Julien Velcin,et al.  Link Prediction with Mutual Attention for Text-Attributed Networks , 2019, WWW.

[10]  Nicola Barbieri,et al.  Who to follow and why: link prediction with explanations , 2014, KDD.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Wenwu Zhu,et al.  Robust Graph Convolutional Networks Against Adversarial Attacks , 2019, KDD.

[13]  Yanchun Zhang,et al.  Community Detection in Attributed Graphs: An Embedding Approach , 2018, AAAI.

[14]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[15]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[16]  M. Narasimha Murty,et al.  Outlier Resistant Unsupervised Deep Architectures for Attributed Network Embedding , 2020, WSDM.

[17]  Lawrence B. Holder,et al.  Discovering Structural Anomalies in Graph-Based Data , 2007, Seventh IEEE International Conference on Data Mining Workshops (ICDMW 2007).

[18]  Katia P. Sycara,et al.  Nonnegative Matrix Tri-Factorization with Graph Regularization for Community Detection in Social Networks , 2015, IJCAI.

[19]  Sanjay Ranka,et al.  Conditional Anomaly Detection , 2007, IEEE Transactions on Knowledge and Data Engineering.

[20]  Jugal K. Kalita,et al.  Network Anomaly Detection: Methods, Systems and Tools , 2014, IEEE Communications Surveys & Tutorials.

[21]  Huan Liu,et al.  Radar: Residual Analysis for Anomaly Detection in Attributed Networks , 2017, IJCAI.

[22]  Huan Liu,et al.  Deep Anomaly Detection on Attributed Networks , 2019, SDM.

[23]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[24]  Charu C. Aggarwal,et al.  Outlier Detection for Text Data , 2017, SDM.

[25]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[26]  Jingrui He,et al.  SPARC: Self-Paced Network Representation for Few-Shot Rare Category Characterization , 2018, KDD.

[27]  M. Narasimha Murty,et al.  Outlier Aware Network Embedding for Attributed Networks , 2018, AAAI.

[28]  Leman Akoglu,et al.  Scalable Anomaly Ranking of Attributed Neighborhoods , 2016, SDM.

[29]  Klemens Böhm,et al.  Ranking outlier nodes in subspaces of attributed graphs , 2013, 2013 IEEE 29th International Conference on Data Engineering Workshops (ICDEW).

[30]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[31]  G. Fletcher,et al.  struc2gauss: Structural role preserving network embedding via Gaussian embedding , 2020, Data Mining and Knowledge Discovery.

[32]  Xiangliang Zhang,et al.  Co-Embedding Attributed Networks , 2019, WSDM.

[33]  Ken-ichi Kawarabayashi,et al.  Representation Learning on Graphs with Jumping Knowledge Networks , 2018, ICML.

[34]  David B. Skillicorn,et al.  Detecting Anomalies in Graphs , 2007, 2007 IEEE Intelligence and Security Informatics.

[35]  Charu C. Aggarwal,et al.  Outlier Detection for Temporal Data: A Survey , 2014, IEEE Transactions on Knowledge and Data Engineering.

[36]  Kewei Cheng,et al.  Streaming Link Prediction on Dynamic Attributed Networks , 2018, WSDM.

[37]  Diane J. Cook,et al.  Graph-based anomaly detection , 2003, KDD '03.

[38]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[39]  Wenwu Zhu,et al.  Deep Variational Network Embedding in Wasserstein Space , 2018, KDD.

[40]  Jundong Li,et al.  SpecAE: Spectral AutoEncoder for Anomaly Detection in Attributed Networks , 2019, CIKM.

[41]  Yarin Gal,et al.  Real Time Image Saliency for Black Box Classifiers , 2017, NIPS.

[42]  Emmanuel Müller,et al.  Focused clustering and outlier detection in large attributed graphs , 2014, KDD.

[43]  Qinghua Zheng,et al.  ANOMALOUS: A Joint Modeling Approach for Anomaly Detection on Attributed Networks , 2018, IJCAI.

[44]  Marius Kloft,et al.  Self-Attentive, Multi-Context One-Class Classification for Unsupervised Anomaly Detection on Text , 2019, ACL.

[45]  Vangelis Metsis,et al.  Spam Filtering with Naive Bayes - Which Naive Bayes? , 2006, CEAS.