Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion

An important underlying assumption that guides the success of the existing multiview learning algorithms is the full observation of the multiview data. However, such rigorous precondition clearly violates the common-sense knowledge in practical applications, where in most cases, only incomplete fractions of the multiview data are given. The presence of the incomplete settings generally disables the conventional multiview clustering methods. In this article, we propose a simple but effective incomplete multiview clustering (IMC) framework, which simultaneously considers the local geometric information and the unbalanced discriminating powers of these incomplete multiview observations. Specifically, a novel graph-regularized matrix factorization model, on the one hand, is developed to preserve the local geometric similarities of the learned common representations from different views. On the other hand, the semantic consistency constraint is introduced to stimulate these view-specific representations toward a unified discriminative representation. Moreover, the importance of different views is adaptively determined to reduce the negative influence of the unbalanced incomplete views. Furthermore, an efficient learning algorithm is proposed to solve the resulting optimization problem. Extensive experimental results performed on several incomplete multiview datasets demonstrate that the proposed method can achieve superior clustering performance in comparison with some state-of-the-art multiview learning methods.

[1]  Xiaozhao Fang,et al.  Protein fold recognition based on multi-view modeling , 2019, Bioinform..

[2]  Inderjit S. Dhillon,et al.  Fast coordinate descent methods with variable selection for non-negative matrix factorization , 2011, KDD.

[3]  Xuelong Li,et al.  Nonnegative Discriminant Matrix Factorization , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Lei Wang,et al.  Multiple Kernel k-Means with Incomplete Kernels , 2017, AAAI.

[5]  Shaowei Liu,et al.  General Knowledge Embedded Image Representation Learning , 2018, IEEE Transactions on Multimedia.

[6]  Songcan Chen,et al.  One-Pass Incomplete Multi-view Clustering , 2019, AAAI.

[7]  Jian Yang,et al.  Low rank representation with adaptive distance penalty for semi-supervised subspace classification , 2017, Pattern Recognit..

[8]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[9]  Xinwang Liu,et al.  Efficient and Effective Incomplete Multi-View Clustering , 2019, AAAI.

[10]  Qi Tian,et al.  Multiview Label Sharing for Visual Representations and Classifications , 2018, IEEE Transactions on Multimedia.

[11]  Lin Wu,et al.  Robust Subspace Clustering for Multi-View Data by Exploiting Correlation Consensus , 2015, IEEE Transactions on Image Processing.

[12]  Wangmeng Zuo,et al.  Attention-guided CNN for image denoising , 2020, Neural Networks.

[13]  Santanu Chaudhury,et al.  Partial Multi-View Clustering using Graph Regularized NMF , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[14]  Philip S. Yu,et al.  Online multi-view clustering with incomplete views , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[15]  P. Arabie,et al.  An algorithm for clustering relational data with applications to social network analysis and comparison with multidimensional scaling , 1975 .

[16]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[17]  Ruzena Bajcsy,et al.  Berkeley MHAD: A comprehensive Multimodal Human Action Database , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[18]  Xuelong Li,et al.  Flexible Affinity Matrix Learning for Unsupervised and Semisupervised Classification , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Jun Guo,et al.  Partial Multi-View Outlier Detection Based on Collective Learning , 2018, AAAI.

[20]  Yun Fu,et al.  Incomplete Multi-Modal Visual Data Grouping , 2016, IJCAI.

[21]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Jun Guo,et al.  Anchors Bring Ease: An Embarrassingly Simple Approach to Partial Multi-View Clustering , 2019, AAAI.

[23]  Piyush Rai,et al.  Multiview Clustering with Incomplete Views , 2010 .

[24]  Hong Liu,et al.  Incomplete Multiview Spectral Clustering With Adaptive Graph Learning , 2020, IEEE Transactions on Cybernetics.

[25]  Ming Cao,et al.  Tracing Knowledge Development Trajectories of the Internet of Things Domain: A Main Path Analysis , 2019, IEEE Transactions on Industrial Informatics.

[26]  Lunke Fei,et al.  Low-Rank Preserving Projection Via Graph Regularized Reconstruction , 2019, IEEE Transactions on Cybernetics.

[27]  Xin Zheng,et al.  Partial Multi-view Subspace Clustering , 2018, ACM Multimedia.

[28]  Feiping Nie,et al.  Multi-View Unsupervised Feature Selection with Adaptive Similarity and View Weight , 2017, IEEE Transactions on Knowledge and Data Engineering.

[29]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Yong Xu,et al.  Incomplete Multi-view Clustering via Graph Regularized Matrix Factorization , 2018, ECCV Workshops.

[31]  Victor C. M. Leung,et al.  Incomplete multi-view clustering via deep semantic mapping , 2018, Neurocomputing.

[32]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[33]  Zhang Yi,et al.  Scalable Sparse Subspace Clustering , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Jiawei Han,et al.  Non-negative Matrix Factorization on Manifold , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[35]  Philip S. Yu,et al.  Multi-View Clustering Based on Belief Propagation , 2016, IEEE Transactions on Knowledge and Data Engineering.

[36]  Shao-Yuan Li,et al.  Partial Multi-View Clustering , 2014, AAAI.

[37]  Jian Yang,et al.  Adaptive weighted nonnegative low-rank representation , 2018, Pattern Recognit..

[38]  Xuelong Li,et al.  Structurally Incoherent Low-Rank Nonnegative Matrix Factorization for Image Classification , 2018, IEEE Transactions on Image Processing.

[39]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[40]  Zhenmin Tang,et al.  Double Constrained NMF for Partial Multi-View Clustering , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[41]  Ling Shao,et al.  Highly-Economized Multi-View Binary Compression for Scalable Image Clustering , 2018, ECCV.

[42]  Lihua Dou,et al.  A Multi-Histogram Clustering Approach toward Markov Random Field for Foreground Segmentation , 2011, Int. J. Image Graph..

[43]  Philip S. Yu,et al.  Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L2, 1 Regularization , 2015, ECML/PKDD.

[44]  Shiliang Sun,et al.  A Survey on Multiview Clustering , 2017, IEEE Transactions on Artificial Intelligence.

[45]  Songcan Chen,et al.  Doubly Aligned Incomplete Multi-view Clustering , 2018, IJCAI.

[46]  Ling Shao,et al.  Discriminative Fisher Embedding Dictionary Learning Algorithm for Object Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Zhi-Hua Zhou,et al.  Exploiting Multi-Modal Interactions: A Unified Framework , 2009, IJCAI.

[48]  David Zhang,et al.  Generative multi-view and multi-feature learning for classification , 2018, Inf. Fusion.

[49]  Derek Greene,et al.  Practical solutions to the problem of diagonal dominance in kernel document clustering , 2006, ICML.

[50]  Liang Wang,et al.  Unified subspace learning for incomplete and unlabeled multi-view data , 2017, Pattern Recognit..

[51]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[52]  Yuxing Peng,et al.  Incomplete Multi-view Clustering , 2016, Intelligent Information Processing.

[53]  Yuhong Guo,et al.  Convex Subspace Representation Learning from Multi-View Data , 2013, AAAI.

[54]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[55]  C. J. van Rijsbergen,et al.  The use of hierarchic clustering in information retrieval , 1971, Inf. Storage Retr..

[56]  Yong Dou,et al.  Absent Multiple Kernel Learning Algorithms , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Qi Zhu,et al.  Discriminative margin-sensitive autoencoder for collective multi-view disease analysis , 2019, Neural Networks.

[58]  Lunke Fei,et al.  Robust Sparse Linear Discriminant Analysis , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[59]  Qinghua Hu,et al.  Flexible Multi-View Dimensionality Co-Reduction , 2017, IEEE Transactions on Image Processing.

[60]  Zi Huang,et al.  Discrete Nonnegative Spectral Clustering , 2017, IEEE Transactions on Knowledge and Data Engineering.

[61]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[62]  Xuelong Li,et al.  Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours , 2017, AAAI.