Self-Paced Multi-View Clustering via a Novel Soft Weighted Regularizer

Multi-view clustering (MVC), which can exploit complementary information of different views to enhance the clustering performance, has attracted people’s increasing attentions in recent years. However, existing multi-view clustering methods typically solve a non-convex problem, therefore are easily stuck into bad local minima. In addition, noisy data and outliers affect the clustering process negatively. In this paper, we propose self-paced multi-view clustering via a novel soft weighted regularizer (SPMVC) to address these issues. Specifically, SPMVC progressively selects samples to train the MVC model from simplicity to complexity in a self-paced manner. A novel soft weighted regularizer is proposed to further reduce the negative impact of outliers and noisy data. Experimental results on real-world data sets demonstrate the effectiveness of the proposed method.

[1]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[2]  Qi Xie,et al.  Self-Paced Co-training , 2017, ICML.

[3]  Zenglin Xu,et al.  Regularized Multi-source Matrix Factorization for Diagnosis of Alzheimer's Disease , 2017, ICONIP.

[4]  Wei Xu,et al.  Multi-modal self-paced learning for image classification , 2018, Neurocomputing.

[5]  A. Raftery,et al.  Model-based Gaussian and non-Gaussian clustering , 1993 .

[6]  Yazhou Ren,et al.  Stratified Feature Sampling for Semi-Supervised Ensemble Clustering , 2019, IEEE Access.

[7]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[8]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[9]  Shiguang Shan,et al.  Self-Paced Curriculum Learning , 2015, AAAI.

[10]  Derek Greene,et al.  A Matrix Factorization Approach for Integrating Multiple Data Views , 2009, ECML/PKDD.

[11]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[12]  Deyu Meng,et al.  Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search , 2014, ACM Multimedia.

[13]  Zenglin Xu,et al.  Robust Softmax Regression for Multi-class Classification with Self-Paced Learning , 2017, IJCAI.

[14]  Zenglin Xu,et al.  Robust multi-view data clustering with multi-view capped-norm K-means , 2018, Neurocomputing.

[15]  Steffen Bickel,et al.  Multi-view clustering , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[16]  Qianqian Wang,et al.  Multi-View Spectral Clustering via Integrating Global and Local Graphs , 2019, IEEE Access.

[17]  Zenglin Xu,et al.  Self-Paced Multi-Task Multi-View Capped-norm Clustering , 2018, ICONIP.

[18]  Carlotta Domeniconi,et al.  A Weighted Adaptive Mean Shift Clustering Algorithm , 2014, SDM.

[19]  Chris H. Q. Ding,et al.  Robust nonnegative matrix factorization using L21-norm , 2011, CIKM '11.

[20]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[21]  Daphne Koller,et al.  Self-Paced Learning for Latent Variable Models , 2010, NIPS.

[22]  Chang-Dong Wang,et al.  Multi-view collaborative locally adaptive clustering with Minkowski metric , 2017, Expert Syst. Appl..

[23]  Deyu Meng,et al.  A theoretical understanding of self-paced learning , 2017, Inf. Sci..

[24]  Zenglin Xu,et al.  Semi-supervised DenPeak Clustering with Pairwise Constraints , 2018, PRICAI.

[25]  Carlotta Domeniconi,et al.  Weighted-object ensemble clustering: methods and analysis , 2016, Knowledge and Information Systems.

[26]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Aristidis Likas,et al.  Kernel-Based Weighted Multi-view Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining.

[28]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[29]  Yueting Zhuang,et al.  Self-Paced Boost Learning for Classification , 2016, IJCAI.

[30]  Fei-Fei Li,et al.  Shifting Weights: Adapting Object Detectors from Image to Video , 2012, NIPS.

[31]  Yina Suo,et al.  Application of Clustering Analysis in Brain Gene Data Based on Deep Learning , 2019, IEEE Access.

[32]  Zenglin Xu,et al.  Self-Paced Multi-Task Clustering , 2018, Neurocomputing.

[33]  Chang-Dong Wang,et al.  Weighted Multi-view Clustering with Feature Selection , 2016, Pattern Recognit..

[34]  C. L. Philip Chen,et al.  Multiple Kernel Fuzzy Clustering With Unsupervised Random Forests Kernel and Matrix-Induced Regularization , 2019, IEEE Access.

[35]  许超.  Multi-View Self-Paced Learning for Clustering , 2015 .

[36]  Deva Ramanan,et al.  Self-Paced Learning for Long-Term Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Zenglin Xu,et al.  Auto-weighted multi-view clustering via kernelized graph learning , 2019, Pattern Recognit..

[38]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[39]  Zenglin Xu,et al.  Semi-supervised deep embedded clustering , 2019, Neurocomputing.

[40]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[41]  Zenglin Xu,et al.  Balanced self-paced learning with feature corruption , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[42]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.