Incomplete Multiview Spectral Clustering With Adaptive Graph Learning

In this paper, we propose a general framework for incomplete multiview clustering. The proposed method is the first work that exploits the graph learning and spectral clustering techniques to learn the common representation for incomplete multiview clustering. First, owing to the good performance of low-rank representation in discovering the intrinsic subspace structure of data, we adopt it to adaptively construct the graph of each view. Second, a spectral constraint is used to achieve the low-dimensional representation of each view based on the spectral clustering. Third, we further introduce a co-regularization term to learn the common representation of samples for all views, and then use the ${k}$ -means to partition the data into their respective groups. An efficient iterative algorithm is provided to optimize the model. Experimental results conducted on seven incomplete multiview datasets show that the proposed method achieves the best performance in comparison with some state-of-the-art methods, which proves the effectiveness of the proposed method in incomplete multiview clustering.

[1]  Nenghai Yu,et al.  Non-negative low rank and sparse graph for semi-supervised learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Lin Wu,et al.  Beyond Low-Rank Representations: Orthogonal Clustering Basis Reconstruction with Optimized Graph Structure for Multi-view Spectral Clustering , 2017, Neural Networks.

[3]  David Zhang,et al.  A Probabilistic Hierarchical Model for Multi-View and Multi-Feature Classification , 2018, AAAI.

[4]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[5]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[6]  Xuelong Li,et al.  Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification , 2018, IEEE Transactions on Image Processing.

[7]  Lin Wu,et al.  Robust Subspace Clustering for Multi-View Data by Exploiting Correlation Consensus , 2015, IEEE Transactions on Image Processing.

[8]  Andrew B. Kahng,et al.  New spectral methods for ratio cut partitioning and clustering , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[9]  Zengchang Qin,et al.  A SIFT-LBP IMAGE RETRIEVAL MODEL BASED ON BAG-OF-FEATURES , 2011 .

[10]  Xuelong Li,et al.  Graph Regularized Non-Negative Low-Rank Matrix Factorization for Image Clustering , 2017, IEEE Transactions on Cybernetics.

[11]  Jian Yang,et al.  Low rank representation with adaptive distance penalty for semi-supervised subspace classification , 2017, Pattern Recognit..

[12]  Yuhong Guo,et al.  Convex Subspace Representation Learning from Multi-View Data , 2013, AAAI.

[13]  Jianping Gou,et al.  Improving sparsity of coefficients for robust sparse and collaborative representation-based image classification , 2017, Neural Computing and Applications.

[14]  David Zhang,et al.  Generative multi-view and multi-feature learning for classification , 2018, Inf. Fusion.

[15]  Henggui Zhang,et al.  Multi-Views Fusion CNN for Left Ventricular Volumes Estimation on Cardiac MR Images , 2018, IEEE Transactions on Biomedical Engineering.

[16]  Zhenmin Tang,et al.  Double Constrained NMF for Partial Multi-View Clustering , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[17]  Xuelong Li,et al.  Low-Rank 2-D Neighborhood Preserving Projection for Enhanced Robust Image Representation , 2019, IEEE Transactions on Cybernetics.

[18]  Xiaochun Cao,et al.  Low-Rank Tensor Constrained Multiview Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Ling Shao,et al.  Highly-Economized Multi-View Binary Compression for Scalable Image Clustering , 2018, ECCV.

[20]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[21]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[23]  Xuelong Li,et al.  A Multiview-Based Parameter Free Framework for Group Detection , 2017, AAAI.

[24]  Yong Xu,et al.  Enhanced CNN for image denoising , 2018, CAAI Trans. Intell. Technol..

[25]  Yuxing Peng,et al.  Incomplete Multi-view Clustering , 2016, Intelligent Information Processing.

[26]  Yin Zhang,et al.  An Alternating Direction Algorithm for Nonnegative Matrix Factorization , 2010 .

[27]  Shao-Yuan Li,et al.  Partial Multi-View Clustering , 2014, AAAI.

[28]  Lunke Fei,et al.  Robust Sparse Linear Discriminant Analysis , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[30]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[31]  Philip S. Yu,et al.  Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L2, 1 Regularization , 2015, ECML/PKDD.

[32]  Jian Yang,et al.  Discriminative Block-Diagonal Representation Learning for Image Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[34]  Victor C. M. Leung,et al.  Incomplete multi-view clustering via deep semantic mapping , 2018, Neurocomputing.

[35]  Zuoyong Li,et al.  Inter-class sparsity based discriminative least square regression , 2018, Neural Networks.

[36]  Xuelong Li,et al.  Structurally Incoherent Low-Rank 2DLPP for Image Classification , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Kun Zhan,et al.  Graph Learning for Multiview Clustering , 2018, IEEE Transactions on Cybernetics.

[38]  Santanu Chaudhury,et al.  Partial Multi-View Clustering using Graph Regularized NMF , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[39]  Jian Yang,et al.  Robust Subspace Segmentation Via Low-Rank Representation , 2014, IEEE Transactions on Cybernetics.

[40]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[41]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[42]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2009, Information Retrieval.

[43]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Xuelong Li,et al.  Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours , 2017, AAAI.

[45]  Piyush Rai,et al.  Multiview Clustering with Incomplete Views , 2010 .

[46]  Feiping Nie,et al.  The Constrained Laplacian Rank Algorithm for Graph-Based Clustering , 2016, AAAI.

[47]  Derek Greene,et al.  Practical solutions to the problem of diagonal dominance in kernel document clustering , 2006, ICML.

[48]  Zi Huang,et al.  Discrete Nonnegative Spectral Clustering , 2017, IEEE Transactions on Knowledge and Data Engineering.

[49]  Xuelong Li,et al.  Structurally Incoherent Low-Rank Nonnegative Matrix Factorization for Image Classification , 2018, IEEE Transactions on Image Processing.

[50]  Jian Yang,et al.  Adaptive weighted nonnegative low-rank representation , 2018, Pattern Recognit..

[51]  Lin Wu,et al.  Iterative Views Agreement: An Iterative Low-Rank Based Structured Optimization Method to Multi-View Spectral Clustering , 2016, IJCAI.

[52]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[53]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Yong Xu,et al.  Incomplete Multi-view Clustering via Graph Regularized Matrix Factorization , 2018, ECCV Workshops.

[55]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[56]  Yun Fu,et al.  Incomplete Multi-Modal Visual Data Grouping , 2016, IJCAI.

[57]  Lunke Fei,et al.  Low-Rank Preserving Projection Via Graph Regularized Reconstruction , 2019, IEEE Transactions on Cybernetics.

[58]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[59]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.