Link prediction by deep non-negative matrix factorization

Abstract Link prediction aims to predict missing links or eliminate spurious links and new links in future network by known network structure information. Most existing link prediction methods are shallow models and did not consider network noise. To address these issues, in this paper, we propose a novel link prediction model based on deep non-negative matrix factorization, which elegantly fuses topology and sparsity-constrained to perform link prediction tasks. Specifically, our model fully exploits the observed link information for each hidden layer by deep non-negative matrix factorization. Then, we utilize the common neighbor method to calculate the similarity scores and map it to multi-layer low-dimensional latent space to obtain the topological information of each hidden layer. Simultaneously, we employ the l 2 , 1 -norm constrained factor matrix at each hidden layer to remove the random noise. Besides, we provide an effective the multiplicative updating rules to learn the parameter of this model with the convergence guarantees. Extensive experiments results on eight real-world datasets demonstrate that our proposed model significantly outperforms the state-of-the-art methods.

[1]  MengChu Zhou,et al.  Temporal Pattern-Aware QoS Prediction via Biased Non-Negative Latent Factorization of Tensors , 2020, IEEE Transactions on Cybernetics.

[2]  Lada A. Adamic,et al.  Friends and neighbors on the Web , 2003, Soc. Networks.

[3]  Peng Wang,et al.  Link prediction in social networks: the state-of-the-art , 2014, Science China Information Sciences.

[4]  Zhiping Zhou,et al.  Structural Deep Nonnegative Matrix Factorization for community detection , 2020, Appl. Soft Comput..

[5]  Yuan Zhang,et al.  COSINE: Community-Preserving Social Network Embedding From Information Diffusion Cascades , 2018, AAAI.

[6]  Fernando Berzal Galiano,et al.  A Survey of Link Prediction in Complex Networks , 2016, ACM Comput. Surv..

[7]  Chris H. Q. Ding,et al.  Robust nonnegative matrix factorization using L21-norm , 2011, CIKM '11.

[8]  Zi Huang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence ℓ2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning , 2022 .

[9]  Bhaskar Biswas,et al.  Link prediction techniques, applications, and performance: A survey , 2020 .

[10]  M. Newman Clustering and preferential attachment in growing networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Nicola Parolini,et al.  Link Prediction in Criminal Networks: A Tool for Criminal Intelligence Analysis , 2016, PloS one.

[12]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[13]  Jingyi Wang,et al.  Graph regularization weighted nonnegative matrix factorization for link prediction in weighted complex network , 2019, Neurocomputing.

[14]  Bin Li,et al.  Link prediction in multi-relational networks based on relational similarity , 2017, Inf. Sci..

[15]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[16]  Albert-László Barabási,et al.  Network-based prediction of protein interactions , 2018, Nature Communications.

[17]  Ludovic Denoyer,et al.  Temporal link prediction by integrating content and structure information , 2011, CIKM '11.

[18]  P. Jaccard Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines , 1901 .

[19]  Timothy Ravasi,et al.  From link-prediction in brain connectomes and protein interactomes to the local-community-paradigm in complex networks , 2013, Scientific Reports.

[20]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[21]  Yu Wang,et al.  Graph regularized nonnegative matrix factorization for temporal link prediction in dynamic networks , 2018 .

[22]  Carl Yang,et al.  Heterogeneous Network Representation Learning: A Unified Framework With Survey and Benchmark , 2020, IEEE Transactions on Knowledge and Data Engineering.

[23]  Fanghua Ye,et al.  Deep Autoencoder-like Nonnegative Matrix Factorization for Community Detection , 2018, CIKM.

[24]  Xiaoke Ma,et al.  Nonnegative matrix factorization algorithms for link prediction in temporal networks using graph communicability , 2017, Pattern Recognit..

[25]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[26]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[27]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[28]  Nitesh V. Chawla,et al.  Evaluating link prediction methods , 2014, Knowledge and Information Systems.

[29]  MengChu Zhou,et al.  Incorporation of Efficient Second-Order Solvers Into Latent Factor Models for Accurate Prediction of Missing QoS Data , 2018, IEEE Transactions on Cybernetics.

[30]  Jian Yang,et al.  Link prediction based on path entropy , 2015, ArXiv.

[31]  Huaiyu Wan,et al.  Predicting top-L missing links with node and link clustering information in large-scale networks , 2016 .

[32]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[33]  Thomas L. Griffiths,et al.  Nonparametric Latent Feature Models for Link Prediction , 2009, NIPS.

[34]  Pengfei Jiao,et al.  A perturbation-based framework for link prediction via non-negative matrix factorization , 2016, Scientific Reports.

[35]  Jiye Liang,et al.  A fusion probability matrix factorization framework for link prediction , 2018, Knowl. Based Syst..

[36]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[37]  Pengfei Jiao,et al.  Link predication based on matrix factorization by fusion of multi class organizations of the network , 2017, Scientific Reports.

[38]  Linyuan Lü,et al.  Similarity index based on local paths for link prediction of complex networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Zhen Liu,et al.  Link prediction in complex networks: A local naïve Bayes model , 2011, ArXiv.

[40]  Linyuan Lü,et al.  Toward link predictability of complex networks , 2015, Proceedings of the National Academy of Sciences.

[41]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[42]  Chengqi Zhang,et al.  Network Representation Learning: A Survey , 2017, IEEE Transactions on Big Data.

[43]  Roger Guimerà,et al.  Missing and spurious interactions and the reconstruction of complex networks , 2009, Proceedings of the National Academy of Sciences.

[44]  Jing Ren,et al.  Network embedding: Taxonomies, frameworks and applications , 2020, Comput. Sci. Rev..

[45]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[46]  Jing Wang,et al.  Link prediction with node clustering coefficient , 2015, 1510.07819.

[47]  Jingyi Wang,et al.  Robust non-negative matrix factorization for link prediction in complex networks using manifold regularization and sparse learning , 2020, Physica A: Statistical Mechanics and its Applications.

[48]  Qunsheng Peng,et al.  Vectorization of line drawing image based on junction analysis , 2014, Science China Information Sciences.

[49]  Zenglin Xu,et al.  Auto-weighted multi-view clustering via deep matrix decomposition , 2020, Pattern Recognit..

[50]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[51]  Jian Pei,et al.  Arbitrary-Order Proximity Preserved Network Embedding , 2018, KDD.

[52]  S. Phinn,et al.  Australian vegetated coastal ecosystems as global hotspots for climate change mitigation , 2019, Nature Communications.

[53]  Wei Yu,et al.  Kernel framework based on non-negative matrix factorization for networks reconstruction and link prediction , 2017, Knowl. Based Syst..

[54]  Naixue Xiong,et al.  Deep Matrix Factorization With Implicit Feedback Embedding for Recommendation System , 2019, IEEE Transactions on Industrial Informatics.

[55]  Ye Yuan,et al.  Link prediction via linear optimization , 2018, Physica A: Statistical Mechanics and its Applications.

[56]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[57]  Alireza Abdollahpouri,et al.  CNDP: Link prediction based on common neighbors degree penalization , 2020, Physica A: Statistical Mechanics and its Applications.