DA-HGT: Domain Adaptive Heterogeneous Graph Transformer

Domain adaptation using graph networks is to learn label-discriminative and network-invariant node embeddings by sharing graph parameters. Most existing works focus on domain adaptation of homogeneous networks, and just a few works begin to study heterogeneous cases that only consider the shared node types but ignore the private node types in individual networks. However, for a given source and target heterogeneous networks, they generally contain shared and private node types, where private types bring an extra challenge for graph domain adaptation. In this paper, we investigate Heterogeneous Information Networks (HINs) with partial shared node types and propose a novel domain adaptive heterogeneous graph transformer (DA-HGT) to handle the domain shift between them. DA-HGT can not only align the distributions of identical-type nodes and edges in two HINs but also make full use of different-type nodes and edges to improve the performance of knowledge transfer. Extensive experiments on several datasets demonstrate that DA-HGT can outperform state-of-the-art methods in various domain adaptation tasks across heterogeneous networks.

[1]  Yizhou Sun,et al.  Heterogeneous Graph Transformer , 2020, WWW.

[2]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[3]  Kup-Sze Choi,et al.  Network Together: Node Classification via Cross-Network Deep Network Embedding , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[5]  Linmei Hu,et al.  Relation Structure-Aware Heterogeneous Information Network Embedding , 2019, AAAI.

[6]  Philip S. Yu,et al.  PathSim , 2011, Proc. VLDB Endow..

[7]  Yizhou Sun,et al.  Graph Regularized Transductive Classification on Heterogeneous Information Networks , 2010, ECML/PKDD.

[8]  Wouter M. Kouw An introduction to domain adaptation and transfer learning , 2018, ArXiv.

[9]  Xiang Li,et al.  Meta Structure: Computing Relevance in Large Heterogeneous Information Networks , 2016, KDD.

[10]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[11]  Korris Fu-Lai Chung,et al.  Adversarial Deep Network Embedding for Cross-network Node Classification , 2020, AAAI.

[12]  Xiangliang Zhang,et al.  ActiveHNE: Active Heterogeneous Network Embedding , 2019, IJCAI.

[13]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[14]  Alex C. Kot,et al.  Heterogeneous Transfer Learning via Deep Matrix Completion with Adversarial Kernel Embedding , 2019, AAAI.

[15]  Shuwen Yang,et al.  Domain Adaptive Classification on Heterogeneous Information Networks , 2020, IJCAI.

[16]  Yiming Yang,et al.  XLNet: Generalized Autoregressive Pretraining for Language Understanding , 2019, NeurIPS.

[17]  Hui Xiong,et al.  A Comprehensive Survey on Transfer Learning , 2021, Proceedings of the IEEE.

[18]  Xiao Wang,et al.  Hyperbolic Heterogeneous Information Network Embedding , 2019, AAAI.

[19]  Shirui Pan,et al.  Unsupervised Domain Adaptive Graph Convolutional Networks , 2020, WWW.

[20]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[21]  Jaewoo Kang,et al.  Graph Transformer Networks , 2019, NeurIPS.

[22]  Min Wu,et al.  Metagraph-Based Learning on Heterogeneous Graphs , 2021, IEEE Transactions on Knowledge and Data Engineering.

[23]  Shuwen Yang,et al.  DANE: Domain Adaptive Network Embedding , 2019, IJCAI.

[24]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[25]  Yang Song,et al.  An Overview of Microsoft Academic Service (MAS) and Applications , 2015, WWW.

[26]  Yu He,et al.  HeteSpaceyWalk: A Heterogeneous Spacey Random Walk for Heterogeneous Information Network Embedding , 2019, CIKM.

[27]  Tiancheng Huang,et al.  Homogenization with Explicit Semantics Preservation for Heterogeneous Information Network , 2020, CIKM.

[28]  Chuan Shi,et al.  Adversarial Learning on Heterogeneous Information Networks , 2019, KDD.

[29]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[30]  MarchandMario,et al.  Domain-adversarial training of neural networks , 2016 .

[31]  Irwin King,et al.  MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding , 2020, WWW.

[32]  Min Xiao,et al.  A Novel Two-Step Method for Cross Language Representation Learning , 2013, NIPS.

[33]  Jie Tang,et al.  ArnetMiner: extraction and mining of academic social networks , 2008, KDD.

[34]  Ralph Grishman,et al.  Domain Adaptation for Relation Extraction with Domain Adversarial Neural Network , 2017, IJCNLP.

[35]  Qingming Huang,et al.  Towards Discriminability and Diversity: Batch Nuclear-Norm Maximization Under Label Insufficient Situations , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).