Robust Multi-View Clustering With a Unified Weight Learning Paradigm

Multi-view clustering, which exploits multi-view information to improve the clustering performance has attracted much attention in recent years. However, existing methods seldom consider the diverse quality of data points in different views, and assign each data point with the same importance for clustering. This way degrades the clustering performance due to the interference of low quality data points on the learned clustering indicators. In this paper, a novel robust multi-view clustering method with a unified weight learning paradigm is proposed to address this issue. The unified weight learning paradigm adaptively learns the quality of data points and the clustering capability of each view. Specifically, the reconstruction error of each data point in each view is treated as a factor to depict the quality of data point in this view. Afterwards, the clustering capability of each view is captured from the diverse quality of data points in each view. The clustering capability of each view in turn improves the learning process of data quality. An alternating iterative optimization algorithm with theoretical convergence guarantee and complexity analysis is designed to optimize the objective function. Experimental results on real-world benchmark datasets demonstrate the superiority of the proposed method.

[1]  Bin Jiang,et al.  Incipient winding fault detection and diagnosis for squirrel-cage induction motors equipped on CRH trains. , 2020, ISA transactions.

[2]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[3]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Chang-Dong Wang,et al.  Multi-view Intact Space Clustering , 2017, 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR).

[5]  Xiaofeng Zhu,et al.  One-Step Multi-View Spectral Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[6]  Feiping Nie,et al.  Spectral Rotation versus K-Means in Spectral Clustering , 2013, AAAI.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Xinwang Liu,et al.  Learning a Joint Affinity Graph for Multiview Subspace Clustering , 2019, IEEE Transactions on Multimedia.

[9]  Bin Jiang,et al.  A Descriptor System Approach for Estimation of Incipient Faults With Application to High-Speed Railway Traction Devices , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Seyoung Park,et al.  Spectral clustering based on learning similarity matrix , 2018, Bioinform..

[11]  Xuelong Li,et al.  Multiview Clustering via Adaptively Weighted Procrustes , 2018, KDD.

[12]  Jie Tian,et al.  Saliency detection via affinity graph learning and weighted manifold ranking , 2018, Neurocomputing.

[13]  René Vidal,et al.  Combined central and subspace clustering for computer vision applications , 2006, ICML.

[14]  Brendan J. Frey,et al.  Non-metric affinity propagation for unsupervised image categorization , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[16]  Rong Wang,et al.  Parameter-Free Weighted Multi-View Projected Clustering with Structured Graph Learning , 2020, IEEE Transactions on Knowledge and Data Engineering.

[17]  Feiping Nie,et al.  Scalable Normalized Cut with Improved Spectral Rotation , 2017, IJCAI.

[18]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Yuhong Guo,et al.  Domain Adaptation With Neural Embedding Matching , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Qinghua Hu,et al.  Latent Multi-view Subspace Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[22]  Chang Tang,et al.  Diversity and consistency learning guided spectral embedding for multi-view clustering , 2019, Neurocomputing.

[23]  Xuelong Li,et al.  Large Graph Hashing with Spectral Rotation , 2017, AAAI.

[24]  Derek Greene,et al.  A Matrix Factorization Approach for Integrating Multiple Data Views , 2009, ECML/PKDD.

[25]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[26]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[27]  Xinwang Liu,et al.  Feature Selective Projection with Low-Rank Embedding and Dual Laplacian Regularization , 2020, IEEE Transactions on Knowledge and Data Engineering.

[28]  Xiaochun Cao,et al.  Diversity-induced Multi-view Subspace Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[30]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[32]  Chang-Dong Wang,et al.  An item orientated recommendation algorithm from the multi-view perspective , 2017, Neurocomputing.

[33]  Xuelong Li,et al.  Self-weighted Multiview Clustering with Multiple Graphs , 2017, IJCAI.

[34]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[35]  Chang Tang,et al.  Dual graph regularized compact feature representation for unsupervised feature selection , 2019, Neurocomputing.

[36]  Feiping Nie,et al.  Heterogeneous image feature integration via multi-modal spectral clustering , 2011, CVPR 2011.

[37]  Pichao Wang,et al.  Adaptive Hypergraph Embedded Semi-Supervised Multi-Label Image Annotation , 2019, IEEE Transactions on Multimedia.

[38]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[39]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[40]  Xiaochun Cao,et al.  Constrained Multi-View Video Face Clustering , 2015, IEEE Transactions on Image Processing.

[41]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[42]  Hao Wang,et al.  GMC: Graph-Based Multi-View Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[43]  Hong Yu,et al.  Multi-view clustering via multi-manifold regularized non-negative matrix factorization , 2017, Neural Networks.

[44]  Bernhard Schölkopf,et al.  Measuring Statistical Dependence with Hilbert-Schmidt Norms , 2005, ALT.

[45]  Bo Du,et al.  Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding , 2015, Pattern Recognit..

[46]  Xinwang Liu,et al.  Cross-View Local Structure Preserved Diversity and Consensus Learning for Multi-View Unsupervised Feature Selection , 2019, AAAI.

[47]  Haibo Wang,et al.  Adaptive Structure Concept Factorization for Multiview Clustering , 2018, Neural Computation.

[48]  Zi Huang,et al.  Discrete Nonnegative Spectral Clustering , 2017, IEEE Transactions on Knowledge and Data Engineering.