TW-Co-k-means: Two-level weighted collaborative k-means for multi-view clustering

Abstract Multi-view clustering has attracted an increasing amount of attention in recent years due to its ability to analyze data from multiple sources or views. Despite significant success, there are still two challenging problems in multi-view clustering, namely, (i) how to satisfy the consistency across different views while preserving the diversity within each view, and (ii) how to weight the different views and the features in each view w.r.t. their importance to improve the clustering result. In this paper, to simultaneously tackle these two problems, we propose a novel multi-view clustering approach termed Two-level Weighted Collaborative k-means (TW-Co-k-means). A new objective function is designed for multi-view clustering, which exploits the distinctive information in each view while taking advantage of the complementariness and consistency across different views in a collaborative manner. The views and the features in each view are assigned with weights that reflect their importance. We introduce an iterative optimization method to optimize the objective function and thereby achieve the final clustering result. Experimental results on multiple real-world datasets demonstrate the effectiveness of our approach.

[1]  Yunming Ye,et al.  DSKmeans: A new kmeans-type approach to discriminative subspace clustering , 2014, Knowl. Based Syst..

[2]  Yunming Ye,et al.  TW-k-means: Automated two-level variable weighting clustering algorithm for multiview data , 2013, IEEE Transactions on Knowledge and Data Engineering.

[3]  Chang-Dong Wang,et al.  Ensemble clustering using factor graph , 2016, Pattern Recognit..

[4]  Guillaume Cleuziou,et al.  CoFKM: A Centralized Method for Multiple-View Clustering , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[5]  Chang-Dong Wang,et al.  Weighted Multi-view Clustering with Feature Selection , 2016, Pattern Recognit..

[6]  Martial Hebert,et al.  Source constrained clustering , 2011, 2011 International Conference on Computer Vision.

[7]  Chang-Dong Wang,et al.  Locally Weighted Ensemble Clustering , 2016, IEEE Transactions on Cybernetics.

[8]  Michael K. Ng,et al.  An Entropy Weighting k-Means Algorithm for Subspace Clustering of High-Dimensional Sparse Data , 2007, IEEE Transactions on Knowledge and Data Engineering.

[9]  Witold Pedrycz,et al.  Collaborative fuzzy clustering , 2002, Pattern Recognit. Lett..

[10]  Michael K. Ng,et al.  Automated variable weighting in k-means type clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Witold Pedrycz,et al.  Rough–Fuzzy Collaborative Clustering , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Pengjiang Qian,et al.  Collaborative Fuzzy Clustering From Multiple Weighted Views , 2015, IEEE Transactions on Cybernetics.

[13]  Aristidis Likas,et al.  Kernel-Based Weighted Multi-view Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining.

[14]  Chang-Dong Wang,et al.  Multi-Exemplar Affinity Propagation , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Nicolò Cesa-Bianchi,et al.  Guest Editorial: Learning from multiple sources , 2010, Machine Learning.

[16]  Germain Forestier,et al.  Collaborative clustering with background knowledge , 2010, Data Knowl. Eng..

[17]  Fuchun Sun,et al.  Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[19]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[20]  Koby Crammer,et al.  Learning from Multiple Sources , 2006, NIPS.

[21]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[22]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[23]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[24]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[25]  Philip S. Yu,et al.  Multi-View Clustering Based on Belief Propagation , 2016, IEEE Transactions on Knowledge and Data Engineering.

[26]  Younès Bennani,et al.  Entropy based probabilistic collaborative clustering , 2017, Pattern Recognit..

[27]  Chang-Dong Wang,et al.  Multi-view Intact Space Clustering , 2017, 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR).