DINE: A Framework for Deep Incomplete Network Embedding

Network representation learning (NRL) plays a vital role in a variety of tasks such as node classification and link prediction. It aims to learn low-dimensional vector representations for nodes based on network structures or node attributes. While embedding techniques on complete networks have been intensively studied, in real-world applications, it is still a challenging task to collect complete networks. To bridge the gap, in this paper, we propose a Deep Incomplete Network Embedding method, namely DINE. Specifically, we first complete the missing part including both nodes and edges in a partially observable network by using the expectation-maximization framework. To improve the embedding performance, we consider both network structures and node attributes to learn node representations. Empirically, we evaluate DINE over three networks on multi-label classification and link prediction tasks. The results demonstrate the superiority of our proposed approach compared against state-of-the-art baselines.

[1]  Gueorgi Kossinets Effects of missing data in social networks , 2006, Soc. Networks.

[2]  Christos Faloutsos,et al.  Kronecker Graphs: An Approach to Modeling Networks , 2008, J. Mach. Learn. Res..

[3]  Feng Xia,et al.  Protein Complexes Detection Based on Global Network Representation Learning , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[4]  Matthew J. Salganik,et al.  How Many People Do You Know?: Efficiently Estimating Personal Network Size , 2010, Journal of the American Statistical Association.

[5]  Francesco Buccafurri,et al.  Discovering missing me edges across social networks , 2015, Inf. Sci..

[6]  Xiaoming Zhang,et al.  From Properties to Links: Deep Network Embedding on Incomplete Graphs , 2017, CIKM.

[7]  Roger Guimerà,et al.  Missing and spurious interactions and the reconstruction of complex networks , 2009, Proceedings of the National Academy of Sciences.

[8]  Feng Xia,et al.  Socially Aware Conference Participant Recommendation With Personality Traits , 2017, IEEE Systems Journal.

[9]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[10]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[11]  Jingzhou Liu,et al.  Visualizing Large-scale and High-dimensional Data , 2016, WWW.

[12]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[13]  Yihong Gong,et al.  Combining content and link for classification using matrix factorization , 2007, SIGIR.

[14]  Jure Leskovec,et al.  The Network Completion Problem: Inferring Missing Nodes and Edges in Networks , 2011, SDM.

[15]  Alexander J. Smola,et al.  Distributed large-scale natural graph factorization , 2013, WWW.

[16]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[17]  Ryan A. Rossi,et al.  Deep Inductive Network Representation Learning , 2018, WWW.

[18]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[19]  Heng Huang,et al.  Deep Attributed Network Embedding , 2018, IJCAI.

[20]  Feng Xia,et al.  Scholarly impact assessment: a survey of citation weighting solutions , 2018, Scientometrics.

[21]  Ludovic Denoyer,et al.  Temporal link prediction by integrating content and structure information , 2011, CIKM '11.

[22]  Feng Xia,et al.  The Role of Positive and Negative Citations in Scientific Evaluation , 2017, IEEE Access.

[23]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[24]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[25]  Feng Xia,et al.  Sustainable Collaborator Recommendation Based on Conference Closure , 2019, IEEE Transactions on Computational Social Systems.

[26]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[27]  Chengqi Zhang,et al.  Network Representation Learning: A Survey , 2017, IEEE Transactions on Big Data.

[28]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, 2009 IEEE International Symposium on Information Theory.

[29]  Graham Cormode,et al.  Node Classification in Social Networks , 2011, Social Network Data Analytics.

[30]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.