Hyperbolic Node Embedding for Signed Networks

The rapid evolving World Wide Web has produced a large amount of complex and heterogeneous network data. To facilitate network analysis algorithms, signed network embedding methods automatically learn feature vectors of nodes in signed networks. However, existing algorithms only managed to embed the networks into Euclidean spaces, although many features of signed networks reported are more suitable for non-Euclidean space. Besides, previous works also do not consider the hierarchical organization of networks, which is widely existed in real-world networks. In this work, we investigate the problem of whether the hyperbolic space is a better choice to represent signed networks. We develop a non-Euclidean signed network embedding method based on structural balance theory and Riemannian optimization. Our method embeds signed networks into a Poincare ball, which is a hyperbolic space can be seen as a continuous tree. This feature enables our approach to capture underlying hierarchical structure in signed networks. We empirically compare our method with three Euclidean-based baselines in visualization, sign prediction, and reconstruction tasks on six real-world datasets. The results show that our hyperbolic embedding performs better than Euclidean counterparts and can extract a meaningful latent hierarchical structure from signed networks.

[1]  Amin Vahdat,et al.  Hyperbolic Geometry of Complex Networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Bo Yang,et al.  Learning node and edge embeddings for signed networks , 2018, Neurocomputing.

[3]  Michal Pilipczuk,et al.  Sitting Closer to Friends than Enemies, Revisited , 2014, Theory of Computing Systems.

[4]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[5]  Huan Liu,et al.  "Bridge": Enhanced Signed Directed Network Embedding , 2018, CIKM.

[6]  Christopher De Sa,et al.  Representation Tradeoffs for Hyperbolic Embeddings , 2018, ICML.

[7]  Blair D. Sullivan,et al.  Tree-Like Structure in Large Social and Information Networks , 2013, 2013 IEEE 13th International Conference on Data Mining.

[8]  Chris H. Q. Ding,et al.  A min-max cut algorithm for graph partitioning and data clustering , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[9]  Jure Leskovec,et al.  Exploiting Social Network Structure for Person-to-Person Sentiment Analysis , 2014, TACL.

[10]  Mason A. Porter,et al.  Social Structure of Facebook Networks , 2011, ArXiv.

[11]  Jia Wu,et al.  Link Prediction with Signed Latent Factors in Signed Social Networks , 2019, KDD.

[12]  Patrick Doreian,et al.  Structural Balance and Signed International Relations , 2015, J. Soc. Struct..

[13]  Philip S. Yu,et al.  Deep Learning for Community Detection: Progress, Challenges and Opportunities , 2020, IJCAI.

[14]  Anne-Marie Kermarrec,et al.  Can Everybody Sit Closer to Their Friends Than Their Enemies? , 2011, MFCS.

[15]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[16]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[17]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[18]  Mohammad Raihanul Islam,et al.  SIGNet: Scalable Embeddings for Signed Networks , 2017, PAKDD.

[19]  Jianbin Qiu,et al.  Adaptive Fuzzy Control for Nontriangular Structural Stochastic Switched Nonlinear Systems With Full State Constraints , 2019, IEEE Transactions on Fuzzy Systems.

[20]  Christian Bauckhage,et al.  The slashdot zoo: mining a social network with negative edges , 2009, WWW.

[21]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[22]  Jure Leskovec,et al.  Signed networks in social media , 2010, CHI.

[23]  Charu C. Aggarwal,et al.  A Survey of Signed Network Mining in Social Media , 2015, ACM Comput. Surv..

[24]  Huan Liu,et al.  Is distrust the negation of trust?: the value of distrust in social media , 2014, HT.

[25]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[26]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[27]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[28]  Michal Pilipczuk,et al.  Sitting Closer to Friends Than Enemies, Revisited , 2012, MFCS.

[29]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[30]  Jiliang Tang,et al.  Signed Graph Convolutional Network , 2018, ArXiv.

[31]  Chris Cornelis,et al.  Trust- and Distrust-Based Recommendations for Controversial Reviews , 2011, IEEE Intelligent Systems.

[32]  Jure Leskovec,et al.  Predicting positive and negative links in online social networks , 2010, WWW '10.

[33]  Paolo Massa,et al.  Trustlet, Open Research on Trust Metrics , 2001, BIS.

[34]  Sahin Albayrak,et al.  Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization , 2010, SDM.

[35]  Silvere Bonnabel,et al.  Stochastic Gradient Descent on Riemannian Manifolds , 2011, IEEE Transactions on Automatic Control.

[36]  Xiao Wang,et al.  Hyperbolic Heterogeneous Information Network Embedding , 2019, AAAI.

[37]  Xuehua Zhao,et al.  Network modelling and variational Bayesian inference for structure analysis of signed networks , 2018, Applied Mathematical Modelling.

[38]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[39]  Yang Xiang,et al.  SNE: Signed Network Embedding , 2017, PAKDD.

[40]  Douwe Kiela,et al.  Poincaré Embeddings for Learning Hierarchical Representations , 2017, NIPS.

[41]  Michael R. Lyu,et al.  Learning to recommend with trust and distrust relationships , 2009, RecSys '09.

[42]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[43]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[44]  Koray Kavukcuoglu,et al.  Learning word embeddings efficiently with noise-contrastive estimation , 2013, NIPS.

[45]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  Junghwan Kim,et al.  SIDE: Representation Learning in Signed Directed Networks , 2018, WWW.

[47]  Yaping Wang,et al.  SSNE: Status Signed Network Embedding , 2019, PAKDD.

[48]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[49]  Thomas Hofmann,et al.  Hyperbolic Entailment Cones for Learning Hierarchical Embeddings , 2018, ICML.

[50]  Jiliang Tang,et al.  Signed Graph Convolutional Networks , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[51]  Chengqi Zhang,et al.  Network Representation Learning: A Survey , 2017, IEEE Transactions on Big Data.

[52]  Enys Mones,et al.  Hierarchy Measure for Complex Networks , 2012, PloS one.

[53]  Graham Cormode,et al.  Node Classification in Social Networks , 2011, Social Network Data Analytics.

[54]  Gary Bécigneul,et al.  Poincaré GloVe: Hyperbolic Word Embeddings , 2018, ICLR.

[55]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[56]  Charu C. Aggarwal,et al.  Signed Network Embedding in Social Media , 2017, SDM.

[57]  Daniel Dajun Zeng,et al.  Social balance in signed networks , 2014, Information Systems Frontiers.

[58]  M. Ghasempour-Mouziraji,et al.  The Hierarchy Structure in Directed and Undirected Signed Networks , 2017 .

[59]  Lada A. Adamic,et al.  The political blogosphere and the 2004 U.S. election: divided they blog , 2005, LinkKDD '05.

[60]  Michael Szell,et al.  Multirelational organization of large-scale social networks in an online world , 2010, Proceedings of the National Academy of Sciences.