Learning Subgraph Structure with LSTM for Complex Network Link Prediction

Link prediction is a hot research topic in complex network. Traditional link prediction is based on similarities between nodes, such as common neighbors and Jaccard index. These methods are easy to understand and widely used. However, most existing works use a single relationship between two target nodes, lacking the use of information around the two target nodes. Due to the poor scalability of these methods, the performances of link prediction are not good. In this paper, we propose a novel link prediction method, learning Subgraph structure with Long-Short Term Memory network (SG-LSTM), which uses a recurrent neural network to learn the subgraph patterns to predict links. First, we extract the enclosing subgraph of the target link. Second, we use a graph labeling algorithm called the hash-based Weisfeiler-Lehman (HWL) algorithm to re-label the extracted closed subgraphs, which maps the subgraphs to the sequential data that reflects the subgraph structure. Finally, these sequential data are trained using long-short term memory network (LSTM) to learn the link prediction model. This learned LSTM model is used to predict the link. Large-scale experiments verify that our proposed method has superior link prediction performances to traditional link prediction methods.

[1]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Zhen Liu,et al.  Local degree blocking model for link prediction in complex networks. , 2014, Chaos.

[4]  Yixin Chen,et al.  Link Prediction Based on Graph Neural Networks , 2018, NeurIPS.

[5]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[6]  Linyuan Lü,et al.  Predicting missing links via local information , 2009, 0901.0553.

[7]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[8]  Zhen Liu,et al.  Local degree blocking model for missing link prediction in complex networks , 2014, ArXiv.

[9]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[10]  Sharon Meraz Using Time Series Analysis to Measure Intermedia Agenda-Setting Influence in Traditional Media and Political Blog Networks , 2011 .

[11]  Yixin Chen,et al.  Weisfeiler-Lehman Neural Machine for Link Prediction , 2017, KDD.

[12]  Kurt Mehlhorn,et al.  Weisfeiler-Lehman Graph Kernels , 2011, J. Mach. Learn. Res..

[13]  Lada A. Adamic,et al.  Friends and neighbors on the Web , 2003, Soc. Networks.

[14]  Ratul Mahajan,et al.  Measuring ISP topologies with rocketfuel , 2002, TNET.

[15]  Sean Wilkinson,et al.  The vulnerability of the European air traffic network to spatial hazards , 2012, Natural Hazards.

[16]  Li Zhou,et al.  Graph kernel based link prediction for signed social networks , 2019, Inf. Fusion.

[17]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[18]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[19]  Roman Garnett,et al.  Power Iterated Color Refinement , 2014, AAAI.

[20]  David Liben-Nowell,et al.  The link-prediction problem for social networks , 2007 .

[21]  Ratul Mahajan,et al.  Measuring ISP topologies with rocketfuel , 2002, SIGCOMM 2002.