Continual Multi-view Clustering

With the increase of multimedia applications, data are often collected from multiple sensors or modalities, encouraging the rapid development of multi-view (also called multi modal) clustering technique. As a representative, late fusion multi-view clustering algorithm has attracted extensive attention due to its low computation complexity yet promising performance. However, most of them deal with the clustering problem in which all data views are available in advance, and overlook the scenarios where data observations of new views are accumulated over time. To solve this issue, we propose a continual approach on the basis of late fusion multi-view clustering framework. In specific, it only needs to maintain a consensus partition matrix and update knowledge with the incoming one of a new data view rather than keep all of them. This benefits a lot by preventing the previously learned knowledge from recomputing over and over again, saving a large amount of computation resource/time and labor force. Nevertheless, we design an alternate and convergent strategy to solve the resultant optimization problem. Also, the proposed algorithm shows excellent clustering performance and time/space efficiency in the experiment.

[1]  Siwei Wang,et al.  Late Fusion Multi-view Clustering via Global and Local Alignment Maximization , 2022, ArXiv.

[2]  Kuan-Ching Li,et al.  Local Sample-weighted Multiple Kernel Clustering with Consensus Discriminative Graph , 2022, IEEE transactions on neural networks and learning systems.

[3]  Suyuan Liu,et al.  Efficient One-Pass Multi-View Subspace Clustering with Consensus Anchors , 2022, AAAI.

[4]  K. Xu,et al.  Fusion Multiple Kernel K-means , 2022, AAAI.

[5]  Siwei Wang,et al.  Simple Contrastive Graph Clustering , 2022, IEEE transactions on neural networks and learning systems.

[6]  En Zhu,et al.  Deep Graph Clustering via Dual Correlation Reduction , 2021, AAAI.

[7]  En Zhu,et al.  One-Stage Incomplete Multi-view Clustering via Late Fusion , 2021, ACM Multimedia.

[8]  Minmin Miao,et al.  Incremental multi-view spectral clustering with sparse and connected graph learning , 2021, Neural Networks.

[9]  Xinwang Liu,et al.  Multiview Subspace Clustering via Co-Training Robust Data Representation , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Jian Xiong,et al.  Multi-View Spectral Clustering With High-Order Optimal Neighborhood Laplacian Matrix , 2020, IEEE Transactions on Knowledge and Data Engineering.

[11]  Yong Dou,et al.  Absent Multiple Kernel Learning Algorithms , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Yang Wang,et al.  SimpleMKKM: Simple Multiple Kernel K-means , 2020, ArXiv.

[13]  Zenglin Xu,et al.  Large-scale Multi-view Subspace Clustering in Linear Time , 2019, AAAI.

[14]  Chen Min,et al.  Self-Supervised Deep Multi-View Subspace Clustering , 2019, ACML.

[15]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zenglin Xu,et al.  Multi-graph Fusion for Multi-view Spectral Clustering , 2019, Knowl. Based Syst..

[17]  En Zhu,et al.  Multi-view Clustering via Late Fusion Alignment Maximization , 2019, IJCAI.

[18]  Huanhuan Chen,et al.  Multiple Kernel k-Means Clustering by Selecting Representative Kernels , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Yong Dou,et al.  Optimal Neighborhood Kernel Clustering with Multiple Kernels , 2017, AAAI.

[20]  Lei Wang,et al.  Multiple Kernel Clustering with Local Kernel Alignment Maximization , 2016, IJCAI.

[21]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[22]  Lei Wang,et al.  Multiple Kernel k-Means Clustering with Matrix-Induced Regularization , 2016, AAAI.

[23]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Joshua Zhexue Huang,et al.  Stratified feature sampling method for ensemble clustering of high dimensional data , 2015, Pattern Recognit..

[25]  Lei Shi,et al.  Robust Multiple Kernel K-means Using L21-Norm , 2015, IJCAI.

[26]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[27]  Mehmet Gönen,et al.  Localized Data Fusion for Kernel k-Means Clustering with Application to Cancer Biology , 2014, NIPS.

[28]  Johan A. K. Suykens,et al.  Optimized Data Fusion for Kernel k-Means Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  En Zhu,et al.  One Pass Late Fusion Multi-view Clustering , 2021, ICML.