Learning node and edge embeddings for signed networks

Abstract Machine learning tasks for edges and nodes in networks heavily rely on feature engineering which requires expert knowledge and careful effort. Recent years, people become interested in the low dimensional vector representation of nodes and edges. However, existing methods on signed networks only aim to learn the node vectors, resulting in omitting edge information and extra effort to design edge vectors. In this work, we develop a framework for learning both nodes and edge vectors for signed networks. Thus, we can directly use edge vectors to represent the properties of the edges, and thereby improving the performance of link-oriented tasks. Our framework for learning network features is as below. We assume that there is a global mapping between the node and edge vector spaces. This assumption allows us to transform the problem into learning the mapping function and the node vectors. We propose node proximity for signed networks, a definition that is generalized from the second-order node proximity for unsigned networks. It provides a unified objective function that can preserve both the node and edge pattern of the network. Based on this definition, we propose two signed network representation methods. The first method is neural network signed network embedding (nSNE). It learns the node vectors and the mapping function via neural networks approach, which can uses the power of deep learning to fit with the data. The second method is light signed network embedding (lSNE). It specifies the mapping function as simply and linear function. It has fewer parameters to estimate and is equal to factorize both similarity and sign matrixes. We compare our methods with three state-of-the-art methods on four datasets. The results show that our methods are competitive.

[1]  Daniel Dajun Zeng,et al.  Social balance in signed networks , 2014, Information Systems Frontiers.

[2]  Dong Yu,et al.  Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[3]  David Liben-Nowell,et al.  The link-prediction problem for social networks , 2007 .

[4]  Haijun Zhang,et al.  Understanding Subtitles by Character-Level Sequence-to-Sequence Learning , 2017, IEEE Transactions on Industrial Informatics.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[7]  Yang Xiang,et al.  SNE: Signed Network Embedding , 2017, PAKDD.

[8]  Zhiyuan Liu,et al.  Fast Network Embedding Enhancement via High Order Proximity Approximation , 2017, IJCAI.

[9]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[10]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[11]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[12]  Chris H. Q. Ding,et al.  A min-max cut algorithm for graph partitioning and data clustering , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[13]  Michal Pilipczuk,et al.  Sitting Closer to Friends than Enemies, Revisited , 2014, Theory of Computing Systems.

[14]  Omer Levy,et al.  Neural Word Embedding as Implicit Matrix Factorization , 2014, NIPS.

[15]  Huan Liu,et al.  Is distrust the negation of trust?: the value of distrust in social media , 2014, HT.

[16]  Kewei Cheng,et al.  Unsupervised Feature Selection in Signed Social Networks , 2017, KDD.

[17]  Chris Cornelis,et al.  Trust- and Distrust-Based Recommendations for Controversial Reviews , 2011, IEEE Intelligent Systems.

[18]  Nitish Srivastava,et al.  Multimodal learning with deep Boltzmann machines , 2012, J. Mach. Learn. Res..

[19]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[20]  Yoshua Bengio,et al.  Exploring Strategies for Training Deep Neural Networks , 2009, J. Mach. Learn. Res..

[21]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[22]  Geoffrey E. Hinton,et al.  A Scalable Hierarchical Distributed Language Model , 2008, NIPS.

[23]  Charu C. Aggarwal,et al.  Signed Network Embedding in Social Media , 2017, SDM.

[24]  Sahin Albayrak,et al.  Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization , 2010, SDM.

[25]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[26]  Jure Leskovec,et al.  Predicting positive and negative links in online social networks , 2010, WWW '10.

[27]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[28]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[29]  Jure Leskovec,et al.  Exploiting Social Network Structure for Person-to-Person Sentiment Analysis , 2014, TACL.

[30]  Charu C. Aggarwal,et al.  Attributed Signed Network Embedding , 2017, CIKM.

[31]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[32]  Tommy W. S. Chow,et al.  Object-Level Video Advertising: An Optimization Framework , 2017, IEEE Transactions on Industrial Informatics.

[33]  Jure Leskovec,et al.  Signed networks in social media , 2010, CHI.

[34]  Charu C. Aggarwal,et al.  A Survey of Signed Network Mining in Social Media , 2015, ACM Comput. Surv..

[35]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[36]  Dayou Liu,et al.  Characterizing and Extracting Multiplex Patterns in Complex Networks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Graham Cormode,et al.  Node Classification in Social Networks , 2011, Social Network Data Analytics.