Multi-view collaborative locally adaptive clustering with Minkowski metric

Abstract Recently, many heterogeneous but related views of data have been generated in a number of applications. Different views may represent distinct aspects of the same data, which often have the same or consensus cluster structure. Discovering cluster structure in multi-view data has become a hot research topic and significant progress has been made in multi-view clustering. However, it remains a challenging issue to exploit the diversity within each view and investigate the relationship across multiple views simultaneously. To address the above issues, in this paper, we extend locally adaptive clustering into a multi-view framework with Minkowski metric and propose a novel approach termed multi-view collaborative locally adaptive clustering with Minkowski metric (MV-CoMLAC). Different from the existing multi-view subspace clustering methods, the proposed approach is capable of simultaneously taking into account the subspace diversity within each view as well as the knowledge across different views. A collaborative strategy is designed to exploit the complementary information from different low-dimensional subspaces. Furthermore, Minkowski metric is utilized to take into account the influence of the L-p distance (p ≥ 0), making our method adaptive to different application tasks. Extensive experiments have been conducted on several multi-view datasets, which demonstrate the superiority of our approach over the existing multi-view clustering methods.

[1]  Chang-Dong Wang,et al.  Ensemble clustering using factor graph , 2016, Pattern Recognit..

[2]  Dimitrios Gunopulos,et al.  Automatic Subspace Clustering of High Dimensional Data , 2005, Data Mining and Knowledge Discovery.

[3]  Bo Jiang,et al.  Multi-view clustering via simultaneous weighting on views and features , 2016, Appl. Soft Comput..

[4]  Michael K. Ng,et al.  An Entropy Weighting k-Means Algorithm for Subspace Clustering of High-Dimensional Sparse Data , 2007, IEEE Transactions on Knowledge and Data Engineering.

[5]  Renato Cordeiro de Amorim,et al.  Minkowski metric, feature weighting and anomalous cluster initializing in K-Means clustering , 2012, Pattern Recognit..

[6]  Steffen Bickel,et al.  Multi-view clustering , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[7]  Younès Bennani,et al.  Collaborative multi-view clustering , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[8]  Christopher J. C. Burges,et al.  Spectral clustering and transductive learning with multiple views , 2007, ICML '07.

[9]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[10]  Wei Tang,et al.  Clustering with Multiple Graphs , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[11]  Philip S. Yu,et al.  A General Model for Multiple View Unsupervised Learning , 2008, SDM.

[12]  Michael K. Ng,et al.  Automated variable weighting in k-means type clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Grigorios Tzortzis,et al.  Multiple View Clustering Using a Weighted Combination of Exemplar-Based Mixture Models , 2010, IEEE Transactions on Neural Networks.

[14]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[15]  Xuran Zhao,et al.  A subspace co-training framework for multi-view clustering , 2014, Pattern Recognit. Lett..

[16]  Chang-Dong Wang,et al.  Incremental Support Vector Clustering , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[17]  Yunming Ye,et al.  A feature group weighting method for subspace clustering of high-dimensional data , 2012, Pattern Recognit..

[18]  Younès Bennani,et al.  Collaborative MultiView Clustering , 2013 .

[19]  Chang-Dong Wang,et al.  Weighted Multi-view Clustering with Feature Selection , 2016, Pattern Recognit..

[20]  Witold Pedrycz,et al.  Collaborative fuzzy clustering , 2002, Pattern Recognit. Lett..

[21]  Guillaume Cleuziou,et al.  CoFKM: A Centralized Method for Multiple-View Clustering , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[22]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[23]  Michael K. Ng,et al.  Subspace clustering with automatic feature grouping , 2015, Pattern Recognit..

[24]  Chang-Dong Wang,et al.  Robust Ensemble Clustering Using Probability Trajectories , 2016, IEEE Transactions on Knowledge and Data Engineering.

[25]  Dimitrios Gunopulos,et al.  Locally adaptive metrics for clustering high dimensional data , 2007, Data Mining and Knowledge Discovery.

[26]  Jing Liu,et al.  Collaborative PLSA for multi-view clustering , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[27]  Philip S. Yu,et al.  Multi-View Clustering Based on Belief Propagation , 2016, IEEE Transactions on Knowledge and Data Engineering.

[28]  Dimitrios Gunopulos,et al.  Subspace Clustering of High Dimensional Data , 2004, SDM.

[29]  Yunming Ye,et al.  TW-k-means: Automated two-level variable weighting clustering algorithm for multiview data , 2013, IEEE Transactions on Knowledge and Data Engineering.

[30]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[31]  Christoph H. Lampert,et al.  Correlational spectral clustering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Renato Cordeiro de Amorim,et al.  Applying subclustering and Lp distance in Weighted K-Means with distributed centroids , 2016, Neurocomputing.

[33]  Derek Greene,et al.  A Matrix Factorization Approach for Integrating Multiple Data Views , 2009, ECML/PKDD.

[34]  Witold Pedrycz,et al.  Rough–Fuzzy Collaborative Clustering , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Michael K. Ng,et al.  HARP: a practical projected clustering algorithm , 2004, IEEE Transactions on Knowledge and Data Engineering.

[36]  Chang-Dong Wang,et al.  Graph-Based Multiprototype Competitive Learning and Its Applications , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[37]  Yong Dou,et al.  Multi-view clustering with extreme learning machine , 2016, Neurocomputing.

[38]  Aristidis Likas,et al.  Kernel-Based Weighted Multi-view Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining.

[39]  Chang-Dong Wang,et al.  Multi-Exemplar Affinity Propagation , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[41]  Shenglan Liu,et al.  Multi-view spectral clustering via robust local subspace learning , 2017, Soft Comput..

[42]  Pengjiang Qian,et al.  Collaborative Fuzzy Clustering From Multiple Weighted Views , 2015, IEEE Transactions on Cybernetics.