Multiple kernel clustering with late fusion consensus local graph preserving

Multiple kernel clustering (MKC) methods aim at integrating an optimal partition from a set of precalculated kernel matrices. Though achieving success in various applications, we observe that existing MKC methods: (i) lack of representation flexibility; and (ii) do not considerably preserve the locality structure in partition space. These issues may adversely affect the learning procedure of MKC, leading to unsatisfying clustering performance. In this paper, we propose a late fusion MKC method with local graph refinement to address the aforementioned issues. Different from existing MKC mechanisms, our method unifies the traditional weighted multiple kernel k‐means, kernel partition, and graph construction into a single optimization procedure. The local graph is utilized to preserve the locality information in partition space and therefore all of the counterparts can be boosted for mutual clustering improvements. By this way, our approach enhances the local graph structure in partition space and enjoys more flexible kernel representations, leading to significant clustering improvements. Moreover, a three‐step alternate algorithm is developed to solve the resultant optimization problem with proved convergence. Extensive experiments are conducted on several multiple kernel benchmark datasets to compare the proposed algorithm with the state‐of‐the‐art ones, and the results well demonstrate its effectiveness and superiority.

[1]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[2]  Keiji Yanai,et al.  A food image recognition system with Multiple Kernel Learning , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Yong Dou,et al.  Optimal Neighborhood Kernel Clustering with Multiple Kernels , 2017, AAAI.

[4]  En Zhu,et al.  Multi-view Clustering via Late Fusion Alignment Maximization , 2019, IJCAI.

[5]  Lei Shi,et al.  Robust Multiple Kernel K-means Using L21-Norm , 2015, IJCAI.

[6]  Lei Wang,et al.  Multiple Kernel k-Means Clustering with Matrix-Induced Regularization , 2016, AAAI.

[7]  Dijia Wu,et al.  Diagnosis of Coronavirus Disease 2019 (COVID-19) With Structured Latent Multi-View Representation Learning , 2020, IEEE Transactions on Medical Imaging.

[8]  Xiao Xu,et al.  Locally adaptive multiple kernel k-means algorithm based on shared nearest neighbors , 2018, Soft Comput..

[9]  Aristidis Likas,et al.  The global kernel k-means clustering algorithm , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[10]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Feiping Nie,et al.  A New Simplex Sparse Learning Model to Measure Data Similarity for Clustering , 2015, IJCAI.

[12]  Mehmet Gönen,et al.  Localized Data Fusion for Kernel k-Means Clustering with Application to Cancer Biology , 2014, NIPS.

[13]  Jaime Lloret,et al.  Multiple Kernel Driven Clustering With Locally Consistent and Selfish Graph in Industrial IoT , 2021, IEEE Transactions on Industrial Informatics.

[14]  Zenglin Xu,et al.  Partition level multiview subspace clustering , 2019, Neural Networks.

[15]  Changqing Zhang,et al.  Flexible Multi-View Representation Learning for Subspace Clustering , 2019, IJCAI.

[16]  Yong Dou,et al.  Joint diversity regularization and graph regularization for multiple kernel k-means clustering via latent variables , 2016, Neurocomputing.

[17]  Ethem Alpaydin,et al.  Localized multiple kernel learning , 2008, ICML '08.

[18]  Xifeng Guo,et al.  Anchor-Based Multiview Subspace Clustering With Diversity Regularization , 2020, IEEE MultiMedia.

[19]  Han Zhang,et al.  Multiview Clustering: A Scalable and Parameter-Free Bipartite Graph Fusion Method , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jian Xiong,et al.  Multi-View Spectral Clustering With High-Order Optimal Neighborhood Laplacian Matrix , 2020, IEEE Transactions on Knowledge and Data Engineering.

[21]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Lei Wang,et al.  An Efficient Approach to Integrating Radius Information into Multiple Kernel Learning , 2013, IEEE Transactions on Cybernetics.

[23]  En Zhu,et al.  Projective Multiple Kernel Subspace Clustering , 2022, IEEE transactions on multimedia.

[24]  Johan A. K. Suykens,et al.  Optimized Data Fusion for Kernel k-Means Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Xinwang Liu,et al.  Consensus Multiple Kernel K-Means Clustering With Late Fusion Alignment and Matrix-Induced Regularization , 2019, IEEE Access.

[26]  Lei Wang,et al.  Multiple Kernel Clustering with Local Kernel Alignment Maximization , 2016, IJCAI.

[27]  Xiaochun Cao,et al.  Tensorized Multi-view Subspace Representation Learning , 2020, International Journal of Computer Vision.

[28]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[29]  Qing Liao,et al.  Optimal Neighborhood Multiple Kernel Clustering With Adaptive Local Kernels , 2022, IEEE Transactions on Knowledge and Data Engineering.

[30]  Lei Wang,et al.  Multiple Kernel k-Means with Incomplete Kernels , 2017, AAAI.

[31]  Hao Wang,et al.  GMC: Graph-Based Multi-View Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[32]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[33]  Yong Dou,et al.  Multiple kernel learning with hybrid kernel alignment maximization , 2017, Pattern Recognit..