One-Stage Incomplete Multi-view Clustering via Late Fusion

As a representative of multi-view clustering (MVC), late fusion MVC (LF-MVC) algorithm has attracted intensive attention due to its superior clustering accuracy and high computational efficiency. One common assumption adopted by existing LF-MVC algorithms is that all views of each sample are available. However, it is widely observed that there are incomplete views for partial samples in practice. In this paper, we propose One-Stage Late Fusion Incomplete Multi-view Clustering (OS-LF-IMVC) to address this issue. Specifically, we propose to unify the imputation of incomplete views and the clustering task into a single optimization procedure, so that the learning of the consensus partition matrix can directly assist the final clustering task. To optimize the resultant optimization problem, we develop a five-step alternate strategy with theoretically proved convergence. Comprehensive experiments on multiple benchmark datasets are conducted to demonstrate the efficiency and effectiveness of the proposed OS-LF-IMVC algorithm.

[1]  Philip S. Yu,et al.  Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L2, 1 Regularization , 2015, ECML/PKDD.

[2]  En Zhu,et al.  Multi-view Clustering via Late Fusion Alignment Maximization , 2019, IJCAI.

[3]  Qinghua Hu,et al.  Latent Multi-view Subspace Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Vishal M. Patel,et al.  Multimodal sparse and low-rank subspace clustering , 2018, Inf. Fusion.

[5]  Yong Dou,et al.  Multiple Kernel Clustering Framework with Improved Kernels , 2017, IJCAI.

[6]  Chang-Dong Wang,et al.  Robust Ensemble Clustering Using Probability Trajectories , 2016, IEEE Transactions on Knowledge and Data Engineering.

[7]  Juho Rousu,et al.  Multi-view kernel completion , 2016, Machine Learning.

[8]  Jinhui Tang,et al.  Robust Structured Nonnegative Matrix Factorization for Image Representation , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Guizhong Liu,et al.  Localized Multiple Kernel Learning Via Sample-Wise Alternating Optimization , 2014, IEEE Transactions on Cybernetics.

[10]  Junjie Wu,et al.  Spectral Ensemble Clustering via Weighted K-Means: Theoretical and Practical Evidence , 2017, IEEE Transactions on Knowledge and Data Engineering.

[11]  Jianping Yin,et al.  Improved Deep Embedded Clustering with Local Structure Preservation , 2017, IJCAI.

[12]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Yixin Yang,et al.  Localized Multiple Kernel Learning With Dynamical Clustering and Matrix Regularization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Piyush Rai,et al.  Multiview Clustering with Incomplete Views , 2010 .

[15]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[16]  Lei Wang,et al.  Multiple Kernel k-Means with Incomplete Kernels , 2017, AAAI.

[17]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[18]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[19]  Ting Chen,et al.  Multiple Kernel Completion and its application to cardiac disease discrimination , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[20]  Yong Xiang,et al.  Non-Negative Matrix Factorization With Dual Constraints for Image Clustering , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  Lin Wu,et al.  Iterative Views Agreement: An Iterative Low-Rank Based Structured Optimization Method to Multi-View Spectral Clustering , 2016, IJCAI.

[22]  Zenglin Xu,et al.  Clustering with Similarity Preserving , 2019, Neurocomputing.

[23]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[25]  Lirong Qiu,et al.  Semantic Feature Learning for Heterogeneous Multitask Classification via Non-Negative Matrix Factorization , 2018, IEEE Transactions on Cybernetics.

[26]  Xiaoyi Jiang,et al.  Ensemble clustering by means of clustering embedding in vector spaces , 2014, Pattern Recognit..

[27]  Wen Gao,et al.  Localized Incomplete Multiple Kernel k-means , 2018, IJCAI.

[28]  Paul M. Thompson,et al.  Multi-source learning with block-wise missing data for Alzheimer's disease prediction , 2013, KDD.

[29]  Yong Dou,et al.  Multiple kernel clustering with corrupted kernels , 2017, Neurocomputing.

[30]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Steffen Bickel,et al.  Multi-view clustering , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[32]  Hongchuan Yu,et al.  Diverse Non-Negative Matrix Factorization for Multiview Data Representation , 2018, IEEE Transactions on Cybernetics.

[33]  En Zhu,et al.  Deep Clustering with Convolutional Autoencoders , 2017, ICONIP.

[34]  Songcan Chen,et al.  Doubly Aligned Incomplete Multi-view Clustering , 2018, IJCAI.

[35]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[36]  Chang Tang,et al.  Efficient and Effective Regularized Incomplete Multi-View Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.