SpEC: Sparse Embedding-Based Community Detection in Attributed Graphs

Community detection, also known as graph clustering, is a widely studied task to find the subgraphs (communities) of related nodes in a graph. Existing methods based on non-negative matrix factorization can solve the task of both non-overlapping community detection and overlapping community detection, but the probability vector obtained by factorization is too dense and ambiguous, and the difference between these probabilities is too small to judge which community the corresponding node belongs to. This will lead to a lack of interpretability and poor performance in community detection. Besides, there are always many sparse subgraphs in a graph, which will cause unstable iterations. Accordingly, we propose SpEC (Sparse Embedding-based Community detection) for solving the above problems. First, sparse embeddings has stronger interpretability than dense ones. Second, sparse embeddings consume less space. Third, sparse embeddings can be computed more efficiently. For traditional matrix factorization-based models, their iteration update rules do not guarantee the convergence for sparse embeddings. SpEC elaborately designs the update rules to ensure convergence and efficiency for sparse embeddings. Crucially, SpEC takes full advantage of attributed graphs and learns the neighborhood patterns, which imply inherent relationships between node attributes and topological structure information. By coupled recurrent neural networks, SpEC recovers the missing edges and predicts the relationship between pairs of nodes. In addition, SpEC ensures stable convergence and improving performance. Furthermore, the results of the experiments show that our model outperforms other state-of-the-art community detection methods.

[1]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[2]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[3]  Lise Getoor,et al.  Link-Based Classification , 2003, Encyclopedia of Machine Learning and Data Mining.

[4]  Jure Leskovec,et al.  GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models , 2018, ICML.

[5]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[6]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[7]  Jure Leskovec,et al.  Overlapping community detection at scale: a nonnegative matrix factorization approach , 2013, WSDM.

[8]  Yanchun Zhang,et al.  Community Detection in Attributed Graphs: An Embedding Approach , 2018, AAAI.

[9]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[10]  Jure Leskovec,et al.  Learning to Discover Social Circles in Ego Networks , 2012, NIPS.

[11]  Jure Leskovec,et al.  Community Detection in Networks with Node Attributes , 2013, 2013 IEEE 13th International Conference on Data Mining.

[12]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[13]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[14]  Haesun Park,et al.  Sparse Nonnegative Matrix Factorization for Clustering , 2008 .

[15]  Jianjiang Feng,et al.  Smooth Representation Clustering , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Fei Wang,et al.  Community discovery using nonnegative matrix factorization , 2011, Data Mining and Knowledge Discovery.

[17]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..

[18]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[19]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[20]  V. P. Pauca,et al.  Nonnegative matrix factorization for spectral data analysis , 2006 .

[21]  Philip S. Yu,et al.  Relational clustering by symmetric convex coding , 2007, ICML '07.

[22]  Zhaoshui He,et al.  Symmetric Nonnegative Matrix Factorization: Algorithms and Applications to Probabilistic Clustering , 2011, IEEE Transactions on Neural Networks.

[23]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[24]  Feiping Nie,et al.  Clustering and projected clustering with adaptive neighbors , 2014, KDD.

[25]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[27]  Xiaochun Cao,et al.  Semantic Community Identification in Large Attribute Networks , 2016, AAAI.

[28]  Yun Chi,et al.  Combining link and content for community detection: a discriminative approach , 2009, KDD.

[29]  Ruoyu Li,et al.  Data Mining Based Full Ceramic Bearing Fault Diagnostic System Using AE Sensors , 2011, IEEE Transactions on Neural Networks.