Auto-weighted Multi-view learning for Semi-Supervised graph clustering

Abstract Despite the popularity of graph clustering, existing methods are haunted by two problems. One is the implicit assumption that all attributes are treated equally with the same weights. The other is that they treat graph as objects of pure topology, which cannot fully capture the structure of the graphs from each view. In this paper, to solve these problems, we first formulate the relationships between node attributes and various prior information as multi-view fusion. Then, by analyzing the modularity measure, a new edge function is devised, which provides a channel to allocate ideal weight for each attribute automatically and incorporate topology into graph clustering. Further, we propose a new similarity measure directly performing in the multi-view fusion, where not only the topology of a graph but also the additive information hidden in the graph is revealed. To verify the importance of different attributes from multi-view on clustering performance, we build an Auto-weighted Multi-view framework for Semi-Supervised (AMSS) graph clustering. Extensive experiments conducted on nine real-world datasets demonstrate the effectiveness and efficiency of the proposed method.

[1]  Weifeng Liu,et al.  Multiview Hessian Regularization for Image Annotation , 2013, IEEE Transactions on Image Processing.

[2]  Xuelong Li,et al.  Self-weighted Multiview Clustering with Multiple Graphs , 2017, IJCAI.

[3]  Xueqi Ma,et al.  Hypergraph $p$ -Laplacian Regularization for Remotely Sensed Image Recognition , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[5]  Xuelong Li,et al.  Multiview Clustering via Adaptively Weighted Procrustes , 2018, KDD.

[6]  Philip S. Yu,et al.  Community detection with partially observable links and node attributes , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[7]  Xiaoyun Chen,et al.  Active Semi-Supervised Community Detection Based on Must-Link and Cannot-Link Constraints , 2014, PloS one.

[8]  Xuelong Li,et al.  Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours , 2017, AAAI.

[9]  M. Parimala,et al.  Graph clustering based on Structural Attribute Neighborhood Similarity (SANS) , 2015, 2015 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT).

[10]  Dapeng Tao,et al.  Domain-Weighted Majority Voting for Crowdsourcing , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[11]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Xuelong Li,et al.  Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification , 2018, IEEE Transactions on Image Processing.

[13]  Leto Peel,et al.  Active discovery of network roles for predicting the classes of network nodes , 2013, J. Complex Networks.

[14]  Fei Wang,et al.  Community discovery using nonnegative matrix factorization , 2011, Data Mining and Knowledge Discovery.

[15]  Armen E. Allahverdyan,et al.  Community detection with and without prior information , 2009, ArXiv.

[16]  Tao Xu,et al.  Learning community structures: Global and local perspectives , 2017, Neurocomputing.

[17]  Rong Ge,et al.  Joint Cluster Analysis of Attribute Data and Relationship Data: the Connected k-Center Problem , 2006, SDM.

[18]  Yoshiyuki Kabashima,et al.  Limitations in the spectral method for graph partitioning: detectability threshold and localization of eigenvectors , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[20]  Yun Chi,et al.  Combining link and content for community detection: a discriminative approach , 2009, KDD.

[21]  Osmar R. Zaïane,et al.  Generating Attributed Networks with Communities , 2015, PloS one.

[22]  Carey E. Priebe,et al.  Community Detection and Classification in Hierarchical Stochastic Blockmodels , 2015, IEEE Transactions on Network Science and Engineering.

[23]  Hong Cheng,et al.  Clustering Large Attributed Graphs: A Balance between Structural and Attribute Similarities , 2011, TKDD.

[24]  Mark E. J. Newman,et al.  Generalized communities in networks , 2015, Physical review letters.

[25]  Zhong-Yuan Zhang,et al.  Enhanced Community Structure Detection in Complex Networks with Partial Background Information , 2013, Scientific reports.

[26]  Jure Leskovec,et al.  Community Detection in Networks with Node Attributes , 2013, 2013 IEEE 13th International Conference on Data Mining.

[27]  Mark E. J. Newman,et al.  Structure and inference in annotated networks , 2015, Nature Communications.

[28]  Philip S. Yu,et al.  Community Detection with Prior Knowledge , 2013, SDM.

[29]  Weifeng Liu,et al.  Multiview dimension reduction via Hessian multiset canonical correlations , 2018, Inf. Fusion.

[30]  Xiaochun Cao,et al.  Semantic Community Identification in Large Attribute Networks , 2016, AAAI.

[31]  Yong Wang,et al.  Overlapping Community Detection in Complex Networks using Symmetric Binary Matrix Factorization , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Leto Peel,et al.  The ground truth about metadata and community detection in networks , 2016, Science Advances.

[33]  Eric Eaton,et al.  A Spin-Glass Model for Semi-Supervised Community Detection , 2012, AAAI.

[34]  Cristopher Moore,et al.  Phase transition in the detection of modules in sparse networks , 2011, Physical review letters.

[35]  Xiaoke Ma,et al.  Semi-supervised clustering algorithm for community structure detection in complex networks , 2010 .

[36]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[37]  Xueqi Ma,et al.  $p$ -Laplacian Regularization for Scene Recognition , 2019, IEEE Transactions on Cybernetics.

[38]  Santo Fortunato,et al.  Community detection in networks: A user guide , 2016, ArXiv.

[39]  Anima Anandkumar,et al.  A tensor approach to learning mixed membership community models , 2013, J. Mach. Learn. Res..

[40]  Hongfang Zhou,et al.  A graph clustering method for community detection in complex networks , 2017 .

[41]  Xinbo Gao,et al.  Triplet-Based Deep Hashing Network for Cross-Modal Retrieval , 2018, IEEE Transactions on Image Processing.