Partial multiview clustering with locality graph regularization

Multiview clustering (MVC) collects complementary and abundant information, which draws much attention in machine learning and data mining community. Existing MVC methods usually hold the assumption that all the views are complete. However, multiple source data are often incomplete in real‐world applications, and so on sensor failure or unfinished collection process, which gives rise to incomplete multiview clustering (IMVC). Although enormous efforts have been devoted in IMVC, there still are some urgent issues that need to be solved: (i) The locality among multiple views has not been utilized in the existing mechanism; (ii) Existing methods inappropriately force all the views to share consensus representation while ignoring specific structures. In this paper, we propose a novel method termed partial MVC with locality graph regularization to address these issues. First, followed the traditional IMVC approaches, we construct weighted semi‐nonnegative matrix factorization models to handle incomplete multiview data. Then, upon the consensus representation matrix, the locality graph is constructed for regularizing the shared feature matrix. Moreover, we add the coefficient regression term to constraint the various base matrices among views. We incorporate the three aforementioned processes into a unified framework, whereas they can negotiate with each other serving for learning tasks. An effective iterative algorithm is proposed to solve the resultant optimization problem with theoretically guaranteed convergence. The comprehensive experiment results on several benchmarks demonstrate the effectiveness of the proposed method.

[1]  Songcan Chen,et al.  Doubly Aligned Incomplete Multi-view Clustering , 2018, IJCAI.

[2]  Huan Liu,et al.  Subspace clustering for high dimensional data: a review , 2004, SKDD.

[3]  Philip S. Yu,et al.  Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L2, 1 Regularization , 2015, ECML/PKDD.

[4]  Pei Zhang,et al.  Adaptive Weighted Graph Fusion Incomplete Multi-View Subspace Clustering , 2020, Sensors.

[5]  Ning Wang,et al.  Partial Multi-View Clustering Based on Sparse Embedding Framework , 2019, IEEE Access.

[6]  Dongyun Yi,et al.  Multi-View Spectral Clustering With Incomplete Graphs , 2020, IEEE Access.

[7]  En Zhu,et al.  Multi-view Clustering via Late Fusion Alignment Maximization , 2019, IJCAI.

[8]  Xinwang Liu,et al.  Efficient and Effective Incomplete Multi-View Clustering , 2019, AAAI.

[9]  Lei Wang,et al.  Multiple kernel extreme learning machine , 2015, Neurocomputing.

[10]  Lei Wang,et al.  Multiple Kernel k-Means Clustering with Matrix-Induced Regularization , 2016, AAAI.

[11]  Zeshui Xu,et al.  Deriving priority weights from intuitionistic fuzzy multiplicative preference relations , 2019, Int. J. Intell. Syst..

[12]  Shao-Yuan Li,et al.  Partial Multi-View Clustering , 2014, AAAI.

[13]  Xinwang Liu,et al.  Consensus One-Step Multi-View Subspace Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[14]  Zhenwen Ren,et al.  Simultaneous Global and Local Graph Structure Preserving for Multiple Kernel Clustering , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xifeng Guo,et al.  Anchor-Based Multiview Subspace Clustering With Diversity Regularization , 2020, IEEE MultiMedia.

[17]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Johan A. K. Suykens,et al.  Optimized Data Fusion for Kernel k-Means Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Harish Garg,et al.  Some results on information measures for complex intuitionistic fuzzy sets , 2019, Int. J. Intell. Syst..

[20]  Songcan Chen,et al.  One-Pass Incomplete Multi-view Clustering , 2019, AAAI.

[21]  Cai Xu,et al.  Adversarial Incomplete Multi-view Clustering , 2019, IJCAI.

[22]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Lixia Liu,et al.  Auto-Weighted Incomplete Multi-View Clustering , 2020, IEEE Access.

[24]  Xinwang Liu,et al.  Two-stage Unsupervised Video Anomaly Detection using Low-rank based Unsupervised One-class Learning with Ridge Regression , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[25]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[26]  Jian Xiong,et al.  Multi-View Spectral Clustering With High-Order Optimal Neighborhood Laplacian Matrix , 2020, IEEE Transactions on Knowledge and Data Engineering.

[27]  Hong Liu,et al.  Incomplete Multiview Spectral Clustering With Adaptive Graph Learning , 2020, IEEE Transactions on Cybernetics.

[28]  Chang Tang,et al.  Efficient and Effective Regularized Incomplete Multi-View Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xinwang Liu,et al.  Efficient Multiple Kernel k-Means Clustering With Late Fusion , 2019, IEEE Access.

[30]  Yun Fu,et al.  Incomplete Multi-Modal Visual Data Grouping , 2016, IJCAI.

[31]  Derek Greene,et al.  A Matrix Factorization Approach for Integrating Multiple Data Views , 2009, ECML/PKDD.

[32]  Xinwang Liu,et al.  K-Means Clustering With Incomplete Data , 2019, IEEE Access.

[33]  Lei Wang,et al.  An Efficient Approach to Integrating Radius Information into Multiple Kernel Learning , 2013, IEEE Transactions on Cybernetics.

[34]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[35]  José M. Merigó,et al.  Thirty Years of the International Journal of Intelligent Systems: A Bibliometric Review , 2017, Int. J. Intell. Syst..

[36]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[37]  Yu-Chiang Frank Wang,et al.  Multi-view Nonnegative Matrix Factorization for Clothing Image Characterization , 2014, 2014 22nd International Conference on Pattern Recognition.

[38]  Lei Wang,et al.  Multiple Kernel k-Means with Incomplete Kernels , 2017, AAAI.

[39]  Hao Wang,et al.  GMC: Graph-Based Multi-View Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[40]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[41]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[42]  Luning Liu,et al.  Evidence combination using OWA‐based soft likelihood functions , 2019, Int. J. Intell. Syst..

[43]  Charles D. Mallah,et al.  PLANT LEAF CLASSIFICATION USING PROBABILISTIC INTEGRATION OF SHAPE, TEXTURE AND MARGIN FEATURES , 2013 .

[44]  Chenping Hou,et al.  Simultaneous Representation Learning and Clustering for Incomplete Multi-view Data , 2019, IJCAI.

[45]  Chunwei Tian,et al.  Low-rank representation with adaptive graph regularization , 2018, Neural Networks.

[46]  Jieping Ye,et al.  Nonlinear adaptive distance metric learning for clustering , 2007, KDD '07.

[47]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[48]  Vicenç Torra,et al.  Hesitant fuzzy sets , 2010, Int. J. Intell. Syst..

[49]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Derek Greene,et al.  Practical solutions to the problem of diagonal dominance in kernel document clustering , 2006, ICML.

[51]  Wen Gao,et al.  Localized Incomplete Multiple Kernel k-means , 2018, IJCAI.

[52]  Yuxing Peng,et al.  Incomplete Multi-view Clustering , 2016, Intelligent Information Processing.

[53]  Yuhong Guo,et al.  Convex Subspace Representation Learning from Multi-View Data , 2013, AAAI.

[54]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Yun Fu,et al.  Partial Multi-view Clustering via Consistent GAN , 2018, 2018 IEEE International Conference on Data Mining (ICDM).