DNC: A Deep Neural Network-based Clustering-oriented Network Embedding Algorithm

Abstract Deep Neural Networks (DNNs) have achieved impressive success in the domain of Euclidean data such as image. However, designing deep neural network to cluster nodes especially in social networks is still a challenging task. Moreover, recent advanced methods for node clustering have focused on learning node embedding, upon which classic clustering algorithms like K-means are applied. Nevertheless, the resulting node embeddings are customarily task-agnostic. This results in the fact that the performance of clustering is difficult to guarantee. To effectively mitigate the problem, in this paper, we propose a novel clustering-oriented node embedding method named Deep Node Clustering (DNC) for non-attributed network data by resorting to deep neural networks. We first present a preprocessing method via adopting a random surfing model to capture graph structural information directly. Subsequently, we propose to learn a deep clustering network, which could jointly learn node embeddings and cluster assignments. Extensive experiments on three real-world network datasets for node clustering are conducted, which demonstrate that the proposed DNC substantially outperforms the state-of-the-art node clustering methods.

[1]  Qing Yang,et al.  Social-aware cooperative caching mechanism in mobile social networks , 2020, J. Netw. Comput. Appl..

[2]  Omer Levy,et al.  Neural Word Embedding as Implicit Matrix Factorization , 2014, NIPS.

[3]  Feng Xia,et al.  Academic social networks: Modeling, analysis, mining and applications , 2019, J. Netw. Comput. Appl..

[4]  Kay Chen Tan,et al.  Manifold Learning-Inspired Mating Restriction for Evolutionary Multiobjective Optimization With Complicated Pareto Sets. , 2019, IEEE transactions on cybernetics.

[5]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[6]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[7]  Alexander J. Smola,et al.  Distributed large-scale natural graph factorization , 2013, WWW.

[8]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[9]  Shuicheng Yan,et al.  Dual Adversarial Autoencoders for Clustering , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Xiao Wang,et al.  One2Multi Graph Autoencoder for Multi-view Graph Clustering , 2020, WWW.

[11]  Xudong Jiang,et al.  Deep Clustering With Variational Autoencoder , 2020, IEEE Signal Processing Letters.

[12]  Bo Zhang,et al.  Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoders , 2017, Pattern Recognit..

[13]  Giacomo Spigler,et al.  Denoising Autoencoders for Overgeneralization in Neural Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[15]  Weijia Jia,et al.  Influence analysis in social networks: A survey , 2018, J. Netw. Comput. Appl..

[16]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[17]  Bo Zhang,et al.  Discriminative Deep Random Walk for Network Classification , 2016, ACL.

[18]  Keith C. C. Chan,et al.  Deep Graph Clustering in Social Network , 2017, WWW.

[19]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[20]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[21]  Fanghua Ye,et al.  Deep Autoencoder-like Nonnegative Matrix Factorization for Community Detection , 2018, CIKM.

[22]  Dechang Pi,et al.  Multi-source information fusion based heterogeneous network embedding , 2020, Inf. Sci..

[23]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[24]  Qiang Ma,et al.  Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification , 2018, WWW.

[25]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[26]  Dechang Pi,et al.  Network representation learning: a systematic literature review , 2020, Neural Computing and Applications.

[27]  Lina Yao,et al.  Adversarially Regularized Graph Autoencoder , 2018, IJCAI.

[28]  Charles A. Sutton,et al.  GEMSEC: Graph Embedding with Self Clustering , 2018, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[29]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Cheng Deng,et al.  Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  Bo Yuan,et al.  An Efficient Evolutionary User Interest Community Discovery Model in Dynamic Social Networks for Internet of People , 2019, IEEE Internet of Things Journal.

[32]  Xiangnan He,et al.  Attributed Social Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[33]  Bing Xue,et al.  A survey on feature selection approaches for clustering , 2020, Artificial Intelligence Review.

[34]  Siddique Latif,et al.  Community detection in networks: A multidisciplinary review , 2018, J. Netw. Comput. Appl..