GADMSL: Graph Anomaly Detection on Attributed Networks via Multi-scale Substructure Learning

—Recently, graph anomaly detection has attracted increasing attention in data mining and machine learning com-munities. Apart from existing attribute anomalies, graph anomaly detection also captures suspicious topological-abnormal nodes that differ from the major counterparts. Although massive graph- based detection approaches have been proposed, most of them focus on node-level comparison while pay insufficient attention on the surrounding topology structures. Nodes with more dissimilar neighborhood substructures have more suspicious to be abnormal. To enhance the local substructure detection ability, we propose a novel Graph Anomaly Detection framework via Multi-scale Substructure Learning (GADMSL for abbreviation). Unlike previous algorithms, we manage to capture anomalous substructures where the inner similarities are relatively low in dense-connected regions. Specifically, we adopt a region proposal module to find high-density substructures in the network as suspicious regions. Their inner-node embedding similarities indicate the anomaly degree of the detected substructures. Generally, a lower degree of embedding similarities means a higher prob- ability that the substructure contains topology anomalies. To distill better embeddings of node attributes, we further introduce a graph contrastive learning scheme, which observes attribute anomalies in the meantime. In this way, GADMSL can detect both topology and attribute anomalies. Ultimately, extensive experiments on benchmark datasets show that GADMSL greatly improves detection performance (up to 7.30% AUC and 17.46% AUPRC gains) compared to state-of-the-art attributed networks anomaly detection algorithms.

[1]  Songcan Chen,et al.  Reconstruction Enhanced Multi-View Contrastive Learning for Anomaly Detection on Attributed Networks , 2022, IJCAI.

[2]  Richang Hong,et al.  A Review-aware Graph Contrastive Learning Framework for Recommendation , 2022, SIGIR.

[3]  Yang Wang,et al.  Progressive learning with multi-scale attention network for cross-domain vehicle re-identification , 2022, Science China Information Sciences.

[4]  Jianliang Gao,et al.  eFraudCom: An E-commerce Fraud Detection System via Competitive Graph Neural Networks , 2022, ACM Trans. Inf. Syst..

[5]  Zhikui Chen,et al.  Higher-order Structure Based Anomaly Detection on Attributed Networks , 2021, 2021 IEEE International Conference on Big Data (Big Data).

[6]  Shirui Pan,et al.  ANEMONE: Graph Anomaly Detection with Multi-Scale Contrastive Learning , 2021, CIKM.

[7]  Kaize Ding,et al.  Towards Anomaly-resistant Graph Neural Networks via Reinforcement Learning , 2021, CIKM.

[8]  Korris Fu-Lai Chung,et al.  Subtractive Aggregation for Attributed Network Anomaly Detection , 2021, CIKM.

[9]  Khoa T. Phan,et al.  Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detection , 2021, IEEE Transactions on Knowledge and Data Engineering.

[10]  Tarunpreet Bhatia,et al.  A review on social spam detection: Challenges, open issues, and future directions , 2021, Expert Syst. Appl..

[11]  Quan Z. Sheng,et al.  A Comprehensive Survey on Graph Anomaly Detection With Deep Learning , 2021, IEEE Transactions on Knowledge and Data Engineering.

[12]  Quan Z. Sheng,et al.  A Comprehensive Survey on Community Detection With Deep Learning , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Chuan Shi,et al.  Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning , 2021, KDD.

[14]  Mykola Pechenizkiy,et al.  Hop-Count Based Self-Supervised Anomaly Detection on Attributed Networks , 2021, ECML/PKDD.

[15]  Philip S. Yu,et al.  Graph Self-Supervised Learning: A Survey , 2021, IEEE Transactions on Knowledge and Data Engineering.

[16]  G. Karypis,et al.  Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Chuan Zhou,et al.  Graph Geometry Interaction Learning , 2020, NeurIPS.

[18]  Yuxiao Dong,et al.  GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training , 2020, KDD.

[19]  Liang Wang,et al.  Deep Graph Contrastive Representation Learning , 2020, ArXiv.

[20]  Kaveh Hassani,et al.  Contrastive Multi-View Representation Learning on Graphs , 2020, ICML.

[21]  Xiangnan He,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[22]  Meng Wang,et al.  Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach , 2020, AAAI.

[23]  Yongdong Zhang,et al.  Deep Adversarial Graph Attention Convolution Network for Text-Based Person Search , 2019, ACM Multimedia.

[24]  Huan Liu,et al.  Deep Anomaly Detection on Attributed Networks , 2019, SDM.

[25]  Huan Liu,et al.  Interactive Anomaly Detection on Attributed Networks , 2019, WSDM.

[26]  Meng Wang,et al.  SocialGCN: An Efficient Graph Convolutional Network based Model for Social Recommendation , 2018, ArXiv.

[27]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[28]  Qinghua Zheng,et al.  ANOMALOUS: A Joint Modeling Approach for Anomaly Detection on Attributed Networks , 2018, IJCAI.

[29]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[30]  Huan Liu,et al.  Radar: Residual Analysis for Anomaly Detection in Attributed Networks , 2017, IJCAI.

[31]  Leman Akoglu,et al.  Scalable Anomaly Ranking of Attributed Neighborhoods , 2016, SDM.

[32]  Hanghang Tong,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[33]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[34]  Yang Wang,et al.  Towards metric fusion on multi-view data: a cross-view based graph random walk approach , 2013, CIKM.

[35]  Konstantin Beznosov,et al.  Graph-based Sybil Detection in social and information systems , 2013, 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013).

[36]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[37]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2008, J. Assoc. Inf. Sci. Technol..

[38]  R. Real,et al.  AUC: a misleading measure of the performance of predictive distribution models , 2008 .

[39]  Xiaowei Xu,et al.  SCAN: a structural clustering algorithm for networks , 2007, KDD '07.

[40]  David B. Skillicorn,et al.  Detecting Anomalies in Graphs , 2007, 2007 IEEE Intelligence and Security Informatics.

[41]  Sanjay Ranka,et al.  Conditional Anomaly Detection , 2007, IEEE Transactions on Knowledge and Data Engineering.

[42]  Christos Faloutsos,et al.  Fast Random Walk with Restart and Its Applications , 2006, Sixth International Conference on Data Mining (ICDM'06).

[43]  Vladimir Batagelj,et al.  An O(m) Algorithm for Cores Decomposition of Networks , 2003, ArXiv.

[44]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[45]  Michal Valko,et al.  Bootstrapped Representation Learning on Graphs , 2021, ArXiv.

[46]  Philip S. Yu,et al.  Algorithms for Estimating the Partition Function of Restricted Boltzmann Machines (Extended Abstract) , 2020 .

[47]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Lin Wu,et al.  Unsupervised Metric Fusion Over Multiview Data by Graph Random Walk-Based Cross-View Diffusion , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[49]  Ambuj K. Singh,et al.  NetSpot: Spotting Significant Anomalous Regions on Dynamic Networks , 2013, SDM.