Heterogeneous Hyper-Network Embedding

Heterogeneous hyper-networks is used to represent multi-modal and composite interactions between data points. In such networks, several different types of nodes form a hyperedge. Heterogeneous hyper-network embedding learns a distributed node representation under such complex interactions while preserving the network structure. However, this is a challenging task due to the multiple modalities and composite interactions. In this study, a deep approach is proposed to embed heterogeneous attributed hyper-networks with complicated and non-linear node relationships. In particular, a fully-connected and graph convolutional layers are designed to project different types of nodes into a common low-dimensional space, a tuple-wise similarity function is proposed to preserve the network structure, and a ranking based loss function is used to improve the similarity scores of hyperedges in the embedding space. The proposed approach is evaluated on synthetic and real world datasets and a better performance is obtained compared with baselines.

[1]  Deng Cai,et al.  Heterogeneous hypergraph embedding for document recommendation , 2016, Neurocomputing.

[2]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[3]  Qiaozhu Mei,et al.  PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks , 2015, KDD.

[4]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[5]  Charu C. Aggarwal,et al.  Heterogeneous Network Embedding via Deep Architectures , 2015, KDD.

[6]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[7]  Jiawei Han,et al.  Embedding Learning with Events in Heterogeneous Information Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[8]  Yueting Zhuang,et al.  Multiple hypergraph clustering of web images by mining Word2Image correlations , 2010 .

[9]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[10]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[11]  Xiangnan He,et al.  Attributed Social Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[12]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[13]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[14]  Yueting Zhuang,et al.  Multiple Hypergraph Clustering of Web Images by MiningWord2Image Correlations , 2010, Journal of Computer Science and Technology.

[15]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[16]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[17]  Srinivasan Parthasarathy,et al.  SEANO: Semi-supervised Embedding in Attributed Networks with Outliers , 2017, SDM.

[18]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[19]  Fei Wang,et al.  Structural Deep Embedding for Hyper-Networks , 2017, AAAI.

[20]  Ping Zhang,et al.  Computational Drug Discovery with Dyadic Positive-Unlabeled Learning , 2017, SDM.

[21]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[22]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[23]  Noah A. Smith,et al.  Contrastive Estimation: Training Log-Linear Models on Unlabeled Data , 2005, ACL.

[24]  Ryan A. Rossi,et al.  Deep Feature Learning for Graphs , 2017, ArXiv.

[25]  Jiawei Han,et al.  Meta-Path Guided Embedding for Similarity Search in Large-Scale Heterogeneous Information Networks , 2016, ArXiv.

[26]  Wang-Chien Lee,et al.  HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning , 2017, CIKM.