Network Together: Node Classification via Cross-Network Deep Network Embedding

Network embedding is a highly effective method to learn low-dimensional node vector representations with original network structures being well preserved. However, existing network embedding algorithms are mostly developed for a single network, which fails to learn generalized feature representations across different networks. In this article, we study a cross-network node classification problem, which aims at leveraging the abundant labeled information from a source network to help classify the unlabeled nodes in a target network. To succeed in such a task, transferable features should be learned for nodes across different networks. To this end, a novel cross-network deep network embedding (CDNE) model is proposed to incorporate domain adaptation into deep network embedding in order to learn label-discriminative and network-invariant node vector representations. On the one hand, CDNE leverages network structures to capture the proximities between nodes within a network, by mapping more strongly connected nodes to have more similar latent vector representations. On the other hand, node attributes and labels are leveraged to capture the proximities between nodes across different networks by making the same labeled nodes across networks have aligned latent vector representations. Extensive experiments have been conducted, demonstrating that the proposed CDNE model significantly outperforms the state-of-the-art network embedding algorithms in cross-network node classification.

[1]  Jie Tang,et al.  ArnetMiner: extraction and mining of academic social networks , 2008, KDD.

[2]  Shih-Fu Chang,et al.  Deep Transfer Network: Unsupervised Domain Adaptation , 2015, ArXiv.

[3]  Chengqi Zhang,et al.  Tri-Party Deep Network Representation , 2016, IJCAI.

[4]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[5]  Ruslan Salakhutdinov,et al.  Revisiting Semi-Supervised Learning with Graph Embeddings , 2016, ICML.

[6]  Korris Fu-Lai Chung,et al.  Deep Domain Adaptation Based on Multi-layer Joint Kernelized Distance , 2018, SIGIR.

[7]  Heng Huang,et al.  Deep Attributed Network Embedding , 2018, IJCAI.

[8]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[10]  Joel J. P. C. Rodrigues,et al.  Heterogeneous domain adaptation network based on autoencoder , 2017, J. Parallel Distributed Comput..

[11]  Dan Wang,et al.  Adversarial Network Embedding , 2017, AAAI.

[12]  Jie Yin,et al.  Transfer Learning across Networks for Collective Classification , 2013, 2013 IEEE 13th International Conference on Data Mining.

[13]  Srinivasan Parthasarathy,et al.  SEANO: Semi-supervised Embedding in Attributed Networks with Outliers , 2017, SDM.

[14]  Mark Heimann On Generalizing Neural Node Embedding Methods to Multi-Network Problems , 2017 .

[15]  Omer Levy,et al.  Neural Word Embedding as Implicit Matrix Factorization , 2014, NIPS.

[16]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[17]  Jiajun Bu,et al.  ANRL: Attributed Network Representation Learning via Deep Neural Networks , 2018, IJCAI.

[18]  Xuelong Li,et al.  Spectral Embedded Adaptive Neighbors Clustering , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Korris Fu-Lai Chung,et al.  Deep Network Embedding with Aggregated Proximity Preserving , 2017, 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[20]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[21]  Yiming Yang,et al.  A re-examination of text categorization methods , 1999, SIGIR '99.

[22]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[23]  Fu-Lai Chung,et al.  Cross-Network Learning With Fuzzy Labels for Seed Selection and Graph Sparsification in Influence Maximization , 2020, IEEE Transactions on Fuzzy Systems.

[24]  Fangzhao Wu,et al.  Collaboratively Training Sentiment Classifiers for Multiple Domains , 2017, IEEE Transactions on Knowledge and Data Engineering.

[25]  Cheng Wu,et al.  Domain Space Transfer Extreme Learning Machine for Domain Adaptation , 2019, IEEE Transactions on Cybernetics.

[26]  Mark Heimann,et al.  REGAL: Representation Learning-based Graph Alignment , 2018, CIKM.

[27]  Huan Liu,et al.  Unsupervised Streaming Feature Selection in Social Media , 2015, CIKM.

[28]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[29]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[30]  Yun Fu,et al.  Deep Transfer Low-Rank Coding for Cross-Domain Learning , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[32]  Li Liu,et al.  Aligning Users across Social Networks Using Network Embedding , 2016, IJCAI.

[33]  Ke Lu,et al.  Transfer Independently Together: A Generalized Framework for Domain Adaptation , 2019, IEEE Transactions on Cybernetics.

[34]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[35]  Enhong Chen,et al.  Learning Deep Representations for Graph Clustering , 2014, AAAI.

[36]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[37]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[38]  Charu C. Aggarwal,et al.  Heterogeneous Network Embedding via Deep Architectures , 2015, KDD.

[39]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[40]  Daniel R. Figueiredo,et al.  struc2vec: Learning Node Representations from Structural Identity , 2017, KDD.

[41]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[42]  Korris Fu-Lai Chung,et al.  Leveraging Cross-Network Information for Graph Sparsification in Influence Maximization , 2017, SIGIR.

[43]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[44]  Fangzhao Wu,et al.  Sentiment Domain Adaptation with Multiple Sources , 2016, ACL.

[45]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[46]  Qiang Li,et al.  Adversarial Training Methods for Network Embedding , 2019, WWW.

[47]  Xiaolong Jin,et al.  Predict Anchor Links across Social Networks via an Embedding Approach , 2016, IJCAI.

[48]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[49]  Bernhard Schölkopf,et al.  A Kernel Method for the Two-Sample-Problem , 2006, NIPS.

[50]  Minghua Chen,et al.  Predicting positive and negative links in signed social networks by transfer learning , 2013, WWW.

[51]  Yu-Chiang Frank Wang,et al.  Learning Cross-Domain Landmarks for Heterogeneous Domain Adaptation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  A. Maćkiewicz,et al.  Principal Components Analysis (PCA) , 1993 .

[53]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[54]  Chengqi Zhang,et al.  Homophily, Structure, and Content Augmented Network Representation Learning , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[55]  Fu-Lai Chung,et al.  Deep Network Embedding for Graph Representation Learning in Signed Networks , 2019, IEEE Transactions on Cybernetics.

[56]  Jie Tang,et al.  Inferring social ties across heterogenous networks , 2012, WSDM '12.

[57]  Steven Skiena,et al.  Don't Walk, Skip!: Online Learning of Multi-scale Network Embeddings , 2016, ASONAM.