Motif-Preserving Dynamic Attributed Network Embedding

Network embedding has emerged as a new learning paradigm to embed complex network into a low-dimensional vector space while preserving node proximities in both network structures and properties. It advances various network mining tasks, ranging from link prediction to node classification. However, most existing works primarily focus on static networks while many networks in real-life evolve over time with addition/deletion of links and nodes, naturally with associated attribute evolution. In this work, we present Motif-preserving Temporal Shift Network (MTSN), a novel dynamic network embedding framework that simultaneously models the local high-order structures and temporal evolution for dynamic attributed networks. Specifically, MTSN learns node representations by stacking the proposed TIME module to capture both local high-order structural proximities and node attributes by motif-preserving encoder and temporal dynamics by temporal shift operation in a dynamic attributed network. Finally, we perform extensive experiments on four real-world network datasets to demonstrate the superiority of MTSN against state-of-the-art network embedding baselines in terms of both effectiveness and efficiency. The source code of our method is available at: https://github.com/ZhijunLiu95/MTSN.

[1]  Hao Wang,et al.  PME: Projected Metric Embedding on Heterogeneous Networks for Link Prediction , 2018, KDD.

[2]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[3]  Philip S. Yu,et al.  Temporal Network Embedding with Micro- and Macro-dynamics , 2019, CIKM.

[4]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[5]  Jie Chen,et al.  EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs , 2020, AAAI.

[6]  Nitesh V. Chawla,et al.  Online Purchase Prediction via Multi-Scale Modeling of Behavior Dynamics , 2019, KDD.

[7]  Xiangji Huang,et al.  Graph-Enhanced Multi-Task Learning of Multi-Level Transition Dynamics for Session-based Recommendation , 2021, AAAI.

[8]  Chuang Gan,et al.  TSM: Temporal Shift Module for Efficient Video Understanding , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Liang Gou,et al.  DySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention Networks , 2020, WSDM.

[10]  Rui Chen,et al.  Real-Time Streaming Graph Embedding Through Local Actions , 2019, WWW.

[11]  Yilun Jin,et al.  GraLSP: Graph Neural Networks with Local Structural Patterns , 2019, AAAI.

[12]  Guojie Song,et al.  Dynamic Network Embedding : An Extended Approach for Skip-gram based Network Embedding , 2018, IJCAI.

[13]  Yan Liu,et al.  DynGEM: Deep Embedding Method for Dynamic Graphs , 2018, ArXiv.

[14]  Da Xu,et al.  Inductive Representation Learning on Temporal Graphs , 2020, ICLR.

[15]  Vasant Honavar,et al.  MEGAN: A Generative Adversarial Network for Multi-View Network Embedding , 2019, IJCAI.

[16]  Wenwu Zhu,et al.  DepthLGP: Learning Embeddings of Out-of-Sample Nodes in Dynamic Networks , 2018, AAAI.

[17]  Ryan A. Rossi,et al.  Efficient Graphlet Counting for Large Networks , 2015, 2015 IEEE International Conference on Data Mining.

[18]  Xiaoyong Du,et al.  Modeling Large-Scale Dynamic Social Networks via Node Embeddings , 2019, IEEE Transactions on Knowledge and Data Engineering.

[19]  Jian Pei,et al.  TIMERS: Error-Bounded SVD Restart on Dynamic Networks , 2017, AAAI.

[20]  Huan Liu,et al.  Attributed Network Embedding for Learning in a Dynamic Environment , 2017, CIKM.

[21]  Xiao Wang,et al.  Motif-Preserving Temporal Network Embedding , 2020, IJCAI.

[22]  Richard Weber,et al.  Overlapping Community Detection in Static and Dynamic Social Networks , 2019, WSDM.

[23]  Mark Heimann,et al.  node2bits: Compact Time- and Attribute-aware Node Representations for User Stitching , 2019, ECML/PKDD.

[24]  Junjie Wu,et al.  Embedding Temporal Network via Neighborhood Formation , 2018, KDD.

[25]  Nitesh V. Chawla,et al.  Similarity-Aware Network Embedding with Self-Paced Learning , 2019, CIKM.

[26]  Zhenhui Li,et al.  Inferring Mobility Relationship via Graph Embedding , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[27]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[28]  Huzefa Rangwala,et al.  Learning Dynamic Context Graphs for Predicting Social Events , 2019, KDD.

[29]  Jian Pei,et al.  High-Order Proximity Preserved Embedding for Dynamic Networks , 2018, IEEE Transactions on Knowledge and Data Engineering.

[30]  Ryan A. Rossi,et al.  Continuous-Time Dynamic Network Embeddings , 2018, WWW.

[31]  Ido Guy,et al.  Node Embedding over Temporal Graphs , 2019, IJCAI.

[32]  Kathleen M. Carley,et al.  Patterns and dynamics of users' behavior and interaction: Network analysis of an online community , 2009, J. Assoc. Inf. Sci. Technol..

[33]  Zhiwu Lu,et al.  RUM: Network Representation Learning Using Motifs , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[34]  Maoguo Gong,et al.  Community-aware dynamic network embedding by using deep autoencoder , 2020, Inf. Sci..

[35]  Xianfeng Tang,et al.  Representation Learning for Large-Scale Dynamic Networks , 2018, DASFAA.

[36]  Xiangnan He,et al.  Attributed Social Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[37]  Jure Leskovec,et al.  Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks , 2019, KDD.

[38]  Ryan A. Rossi,et al.  Graph Convolutional Networks with Motif-based Attention , 2019, CIKM.

[39]  Junyu Dong,et al.  Dynamic Representation Learning for Large-Scale Attributed Networks , 2020, CIKM.

[40]  Junyu Dong,et al.  Fast Attributed Multiplex Heterogeneous Network Embedding , 2020, International Conference on Information and Knowledge Management.

[41]  Iadh Ounis,et al.  Jointly Learning Representations of Nodes and Attributes for Attributed Networks , 2020, ACM Trans. Inf. Syst..

[42]  Han Zhang,et al.  Dynamic Heterogeneous Graph Neural Network for Real-time Event Prediction , 2020, KDD.

[43]  Jie Zhou,et al.  Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View , 2020, AAAI.

[44]  Philip S. Yu,et al.  DynGraphGAN: Dynamic Graph Embedding via Generative Adversarial Networks , 2019, DASFAA.

[45]  Gillian Dobbie,et al.  Network Embedding and Change Modeling in Dynamic Heterogeneous Networks , 2019, SIGIR.

[46]  Fan Yang,et al.  Large-Scale Heterogeneous Feature Embedding , 2019, AAAI.

[47]  Heng Huang,et al.  Deep Attributed Network Embedding , 2018, IJCAI.

[48]  Bart Baesens,et al.  Combining Temporal Aspects of Dynamic Networks with Node2Vec for a more Efficient Dynamic Link Prediction , 2018, 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[49]  Xun Liang,et al.  Joint Learning of Evolving Links for Dynamic Network Embedding , 2018, AAAI.

[50]  Aynaz Taheri,et al.  Learning to Represent the Evolution of Dynamic Graphs with Recurrent Models , 2019, WWW.

[51]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[52]  Chen Ma,et al.  Hierarchical Gating Networks for Sequential Recommendation , 2019, KDD.

[53]  Hongyuan Zha,et al.  DyRep: Learning Representations over Dynamic Graphs , 2019, ICLR.

[54]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[55]  Palash Goyal,et al.  dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learning , 2018, Knowl. Based Syst..

[56]  Alessandro Rozza,et al.  Dynamic Graph Convolutional Networks , 2017, Pattern Recognit..