Anomaly Detection by Learning Dynamics From a Graph

There exist relations, which vary with time or by an event, between high dimensional elements in most real-world datasets. A dynamic graph or network has been used as one of the remarkable approaches to represent and analyze them. In spite of the advantages of representing data in the form of graphs, it is difficult to apply representation (deep) learning to graphs. Recently, AlphaFold by DeepMind has shown remarkable results in applying deep learning to graphs. This research is part of the current effort to extend the input domain of deep learning to arbitrarily graphs and their dynamics of variations. In this paper, we propose a method to predict the evolution of graphs by learning spatio-temporal features called dynamics. The method involves two main processes: extracting spatial features from static graphs obtained at different times and learning temporal features from the time-varying connection structure. Instead of predicting the overall changes of a highly complex graph, we detect the dynamic anomaly by predicting the affinity score with respect to a node (e.g., a hub as an important factor) of a dynamics graph. This facilitates the learning dynamics of graphs having sparsity of connections by alleviating the curse of dimensions using the fact that most graphs of real-world problems are scale-free. To justify our approach, we apply our method to real-world problems such as computer networks and public transportation. Experimental results show that our approach is competitive with other existing methods.

[1]  Nicola De Cao,et al.  MolGAN: An implicit generative model for small molecular graphs , 2018, ArXiv.

[2]  Danai Koutra,et al.  RolX: structural role extraction & mining in large graphs , 2012, KDD.

[3]  Danai Koutra,et al.  DELTACON: A Principled Massive-Graph Similarity Function , 2013, SDM.

[4]  Ying Sun,et al.  Amalgamation of anomaly-detection indices for enhanced process monitoring , 2016 .

[5]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[6]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[7]  Geoffrey E. Hinton,et al.  Training Recurrent Neural Networks , 2013 .

[8]  Mark Crovella,et al.  Diagnosing network-wide traffic anomalies , 2004, SIGCOMM '04.

[9]  Sungroh Yoon,et al.  Measuring Large-Scale Dynamic Graph Similarity by RICom: RWR with Intergraph Compression , 2015, 2015 IEEE International Conference on Data Mining.

[10]  Ana Paula Appel,et al.  HADI: Mining Radii of Large Graphs , 2011, TKDD.

[11]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[12]  Lisa Zhang,et al.  Inference in Probabilistic Graphical Models by Graph Neural Networks , 2018, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[13]  Herbert J. Mattord,et al.  Principles of Information Security , 2004 .

[14]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[15]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[17]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[18]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[19]  Jing Jiang,et al.  Graph WaveNet for Deep Spatial-Temporal Graph Modeling , 2019, IJCAI.

[20]  Leman Akoglu,et al.  An Ensemble Approach for Event Detection and Characterization in Dynamic Graphs , 2014 .

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[23]  D. Fell,et al.  The small world inside large metabolic networks , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[24]  Hui Li,et al.  A Deep Learning Approach to Link Prediction in Dynamic Networks , 2014, SDM.

[25]  Apurva Narayan,et al.  Learning Graph Dynamics using Deep Neural Networks , 2018 .

[26]  Yoshua Bengio,et al.  End-to-end attention-based large vocabulary speech recognition , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[28]  Yixin Chen,et al.  Link Prediction Based on Graph Neural Networks , 2018, NeurIPS.

[29]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[30]  Sungroh Yoon,et al.  Transfer Learning for Deep Learning on Graph-Structured Data , 2016, AAAI.

[31]  Hari Om,et al.  STATISTICAL TECHNIQUES IN ANOMALY INTRUSION DETECTION SYSTEM , 2012 .

[32]  M. Shyu,et al.  A Novel Anomaly Detection Scheme Based on Principal Component Classifier , 2003 .

[33]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[34]  Taher H. Haveliwala Topic-sensitive PageRank , 2002, IEEE Trans. Knowl. Data Eng..

[35]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[36]  Yang Liu,et al.  graph2vec: Learning Distributed Representations of Graphs , 2017, ArXiv.

[37]  Mohamed Chtourou,et al.  On the training of recurrent neural networks , 2011, Eighth International Multi-Conference on Systems, Signals & Devices.

[38]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[39]  Alessandro Rozza,et al.  Dynamic Graph Convolutional Networks , 2017, Pattern Recognit..

[40]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[41]  Hema Swetha Koppula,et al.  Car that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[42]  Gihwan Cho,et al.  Detecting an Anomalous Traffic Attack Area based on Entropy Distribution and Mahalanobis Distance , 2014 .

[43]  Richard Socher,et al.  Regularizing and Optimizing LSTM Language Models , 2017, ICLR.

[44]  D. Watts Networks, Dynamics, and the Small‐World Phenomenon1 , 1999, American Journal of Sociology.

[45]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[46]  Peter G. Doyle,et al.  Random Walks and Electric Networks: REFERENCES , 1987 .

[47]  Phillip Bonacich,et al.  Eigenvector-like measures of centrality for asymmetric relations , 2001, Soc. Networks.

[48]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[49]  Xavier Bresson,et al.  Matrix Completion on Graphs , 2014, NIPS 2014.

[50]  Silvio Savarese,et al.  Structural-RNN: Deep Learning on Spatio-Temporal Graphs , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[52]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[53]  Heiko Rieger,et al.  Random walks on complex networks. , 2004, Physical review letters.

[54]  S. S. Sonawane,et al.  Graph based Representation and Analysis of Text Document: A Survey of Techniques , 2014 .

[55]  Charu C. Aggarwal,et al.  Managing and Mining Graph Data , 2010, Managing and Mining Graph Data.