Anomaly Subgraph Detection with Feature Transfer

Anomaly detection in multilayer graphs becomes more critical in many application scenarios, i.e., identifying crime hotspots in urban areas by discovering suspicious and illicit behaviors in social networks. However, it is a big challenge to identify anomalies in a layer graph due to the insufficient anomaly features. Most existing methods of anomaly detection determine whether a node is abnormal by looking at the observable anomalous feature values. However, these methods are not suitable for scenarios in which the abnormal features are scarce, e.g., geometric graphs or non-public data in social network services. In this paper, to detect anomaly in a graph with insufficient anomalous features, we propose a pioneering approach ASD-FT (Anomaly Subgraph Detection with Feature Transfer) based on a strategy of anomalous feature transfers between different layers of a multilayer graph. The proposed ASD-FT detects anomaly subgraphs from the graph of the target layer by analyzing the anomalous features in the graph of another layer. We demonstrate the effectiveness and robustness of our approach ASD-FT with extensive experiments on five real-world datasets.

[1]  Robert Patro,et al.  Global network alignment using multiscale spectral signatures , 2012, Bioinform..

[2]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[3]  Daniel B. Neill,et al.  Fast subset scan for spatial pattern detection , 2012 .

[4]  Wenjing Hu,et al.  Anomaly detection and fault analysis of wind turbine components based on deep learning network , 2018, Renewable Energy.

[5]  Harith Alani,et al.  SentiCircles for Contextual and Conceptual Semantic Sentiment Analysis of Twitter , 2014, ESWC.

[6]  Sergio Gómez,et al.  Ranking in interconnected multilayer networks reveals versatile nodes , 2015, Nature Communications.

[7]  Bonnie Berger,et al.  Global alignment of multiple protein interaction networks with application to functional orthology detection , 2008, Proceedings of the National Academy of Sciences.

[8]  Douglas H. Jones,et al.  Goodness-of-fit test statistics that dominate the Kolmogorov statistics , 1979 .

[10]  Danai Koutra,et al.  BIG-ALIGN: Fast Bipartite Graph Alignment , 2013, 2013 IEEE 13th International Conference on Data Mining.

[11]  Naren Ramakrishnan,et al.  A Nonparametric Approach to Uncovering Connected Anomalies by Tree Shaped Priors , 2019, IEEE Transactions on Knowledge and Data Engineering.

[12]  Hanghang Tong,et al.  FASTEN: Fast Sylvester Equation Solver for Graph Mining , 2018, KDD.

[13]  Jianxin Li,et al.  Efficient Nonparametric Subgraph Detection Using Tree Shaped Priors , 2016, AAAI.

[14]  SalehiMahsa,et al.  A Survey on Anomaly detection in Evolving Data , 2018 .

[15]  Akshay Krishnamurthy,et al.  Near-optimal Anomaly Detection in Graphs using Lovasz Extended Scan Statistic , 2013, NIPS.

[16]  David Pisinger A minimal algorithm for the Multiple-choice Knapsack Problem , 1995 .

[17]  Jianxin Li,et al.  Query-Driven Discovery of Anomalous Subgraphs in Attributed Graphs , 2017, IJCAI.

[18]  L. Schmetterer Zeitschrift fur Wahrscheinlichkeitstheorie und Verwandte Gebiete. , 1963 .

[19]  Venkatesh Saligrama,et al.  Connected Sub-graph Detection , 2014, AISTATS.

[20]  D. Donoho,et al.  Higher criticism for detecting sparse heterogeneous mixtures , 2004, math/0410072.

[21]  Chuan Sheng Foo,et al.  Efficient GAN-Based Anomaly Detection , 2018, ArXiv.

[22]  Jingrui He,et al.  HiDDen: Hierarchical Dense Subgraph Detection with Application to Financial Fraud Detection , 2017, SDM.

[23]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[24]  Mahsa Salehi,et al.  A Survey on Anomaly detection in Evolving Data: [with Application to Forest Fire Risk Prediction] , 2018, SKDD.

[25]  Longbing Cao,et al.  SVDD-based outlier detection on uncertain data , 2012, Knowledge and Information Systems.

[26]  P. Santhi Thilagam,et al.  Discovering suspicious behavior in multilayer social networks , 2017, Comput. Hum. Behav..

[27]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[28]  Anna Monreale,et al.  Multidimensional networks: foundations of structural analysis , 2013, World Wide Web.

[29]  Thomas G. Dietterich,et al.  Sequential Feature Explanations for Anomaly Detection , 2019, ACM Trans. Knowl. Discov. Data.

[30]  Le Thanh Sach,et al.  An anomaly-based network intrusion detection system using Deep learning , 2017, 2017 International Conference on System Science and Engineering (ICSSE).

[31]  Hanghang Tong,et al.  iNEAT: Incomplete Network Alignment , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[32]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[33]  Hila Becker,et al.  Beyond Trending Topics: Real-World Event Identification on Twitter , 2011, ICWSM.

[34]  Rushed Kanawati,et al.  Multiplex Network Mining: A Brief Survey , 2015, IEEE Intell. Informatics Bull..

[35]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[36]  Daniel B. Neill,et al.  Non-parametric scan statistics for event detection and forecasting in heterogeneous social media graphs , 2014, KDD.

[37]  Christos Faloutsos,et al.  LOCI: fast outlier detection using the local correlation integral , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[38]  Maciej Szmit,et al.  Usage of Holt-Winters Model and Multilayer Perceptron in Network Traffic Modelling and Anomaly Detection , 2012, Informatica.

[39]  Jianxin Li,et al.  Uncovering Specific-Shape Graph Anomalies in Attributed Graphs , 2019, AAAI.