Large-scale online multi-view graph neural network and applications

Abstract Recently popularized Graph Neural Network (GNN) has been attaching great attention along with its successful industry applications. This paper focuses on two challenges traditional GNN frameworks face: (i) most of them are transductive and mainly concentrate on homogeneous networks considering single typed nodes and edges; (ii) they are difficult to handle the real-time changing network structures as well as scale to big graph data. To address these issues, a novel attention-based Heterogeneous Multi-view Graph Neural Network (aHMGNN) solution is introduced. aHMGNN models a more intricate heterogeneous multi-view network, where various node and edge types co-exist and each of these objects also contain specific attributes. It is end-to-end, and two stages are designed for node embeddings learning and multi-typed node and edge representations fusion, respectively. Experimental studies on large-scale spam detection and link prediction tasks clearly verify the efficiency and effectiveness of our proposed aHMGNN. Furthermore, we have implemented our approach in one of the largest e-commerce platforms which further verifies that aHMGNN is arguably promising and scalable in real-world applications.

[1]  Dong Li,et al.  Spam Review Detection with Graph Convolutional Networks , 2019, CIKM.

[2]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[3]  Yiqun Liu,et al.  Detecting Crowdturfing "Add to Favorites" Activities in Online Shopping , 2018, WWW.

[4]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[5]  F. Scarselli,et al.  A new model for learning in graph domains , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[6]  Franco Scarselli,et al.  Investigation into the application of graph neural networks to large-scale recommender systems , 2006 .

[7]  Feng Xia,et al.  Community-diversified influence maximization in social networks , 2020, Inf. Syst..

[8]  Zhao Li,et al.  Online E-Commerce Fraud: A Large-Scale Detection and Analysis , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[9]  Irwin King,et al.  MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding , 2020, WWW.

[10]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[11]  Sabeur Aridhi,et al.  Special issue on "Advances on Large Evolving Graphs" , 2020, Future Gener. Comput. Syst..

[12]  Yixin Chen,et al.  Link Prediction Based on Graph Neural Networks , 2018, NeurIPS.

[13]  Bo An,et al.  Impression Allocation for Combating Fraud in E-commerce Via Deep Reinforcement Learning with Action Norm Penalty , 2018, IJCAI.

[14]  Kay Chen Tan,et al.  Manifold Learning-Inspired Mating Restriction for Evolutionary Multiobjective Optimization With Complicated Pareto Sets. , 2019, IEEE transactions on cybernetics.

[15]  Claudio Gallicchio,et al.  Graph Echo State Networks , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[16]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[17]  Mert R. Sabuncu,et al.  Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels , 2018, NeurIPS.

[18]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[19]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[20]  Zhao Li,et al.  MV-GCN: Multi-View Graph Convolutional Networks for Link Prediction , 2019, IEEE Access.

[21]  Weiwei Liu,et al.  Discrete Network Embedding , 2018, IJCAI.

[22]  Guoxian Yu,et al.  Link Inference via Heterogeneous Multi-view Graph Neural Networks , 2020, DASFAA.

[23]  Oluwasanmi Koyejo,et al.  Consistent Binary Classification with Generalized Performance Metrics , 2014, NIPS.

[24]  Liwei Qiu,et al.  Scalable Multiplex Network Embedding , 2018, IJCAI.

[25]  Lei Zhang,et al.  Dynamic network embedding enhanced advisor-advisee relationship identification based on internet of scholars , 2020, Future Gener. Comput. Syst..

[26]  Zhoujun Li,et al.  SSDMV: Semi-Supervised Deep Social Spammer Detection by Multi-view Data Fusion , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[27]  Donghyun Kim,et al.  Unsupervised Attributed Multiplex Network Embedding , 2020, AAAI.

[28]  Jie Tang,et al.  Representation Learning for Attributed Multiplex Heterogeneous Network , 2019, KDD.

[29]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Bo An,et al.  Securing the Deep Fraud Detector in Large-Scale E-Commerce Platform via Adversarial Machine Learning Approach , 2019, WWW.

[31]  Bowen Zhou,et al.  A Structured Self-attentive Sentence Embedding , 2017, ICLR.

[32]  Amol Deshpande,et al.  Managing large dynamic graphs efficiently , 2012, SIGMOD Conference.

[33]  Jun Won Choi,et al.  Deep neural network-based automatic modulation classification technique , 2016, 2016 International Conference on Information and Communication Technology Convergence (ICTC).

[34]  Weimao Ke,et al.  MGNN: A Multimodal Graph Neural Network for Predicting the Survival of Cancer Patients , 2020, SIGIR.

[35]  Zhao Li,et al.  Collaboration Based Multi-Label Propagation for Fraud Detection , 2020, IJCAI.

[36]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[37]  Wang-Chien Lee,et al.  HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning , 2017, CIKM.

[38]  Jie Chen,et al.  EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs , 2020, AAAI.

[39]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[40]  Jianping Fan,et al.  A decentralised approach for link inference in large signed graphs , 2020, Future Gener. Comput. Syst..

[41]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[42]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[43]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[44]  Jun Gao,et al.  FAIR: Fraud Aware Impression Regulation System in Large-Scale Real-Time E-Commerce Search Platform , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[45]  Jiliang Tang,et al.  Streaming Graph Neural Networks , 2018, SIGIR.

[46]  Jian Li,et al.  AddGraph: Anomaly Detection in Dynamic Graph Using Attention-based Temporal GCN , 2019, IJCAI.

[47]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[48]  Philip S. Yu,et al.  Heterogeneous Graph Matching Networks , 2019, ArXiv.

[49]  Jiajun Bu,et al.  ANRL: Attributed Network Representation Learning via Deep Neural Networks , 2018, IJCAI.

[50]  Shouling Ji,et al.  CATS: Cross-Platform E-Commerce Fraud Detection , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[51]  Le Song,et al.  Heterogeneous Graph Neural Networks for Malicious Account Detection , 2018, CIKM.

[52]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.