Semi-supervised multi-view clustering with Graph-regularized Partially Shared Non-negative Matrix Factorization

Abstract Non-negative matrix factorization is widely used in multi-view clustering due to its ability of learning a common dimension-reduced factor. Recently, it is combined with the label information to improve the clustering, but the affection of the dimension-reduction to the classes of the labeled data is seldom considered. Motivated by that the graph constraint can keep the geometric structure of the data, it is employed to restrict the class variation of the data caused by the dimension reduction, and a semi-supervised method called Graph-regularized Partially Shared Non-negative Matrix Factorization (GPSNMF) is proposed for multi-view clustering in this paper. In our method, the affinity graph of each view is constructed to encode the geometric information, and the corresponding multiplication update algorithm based on alternative iteration rule is derived. In the experiments, two clustering approaches are tested based on the results of the proposed GPSNMF, and four real-world databases with different label proportions are performed to demonstrate the advantages of our method over the state-of-the-art methods.

[1]  Shu Wu,et al.  Multi-view clustering via joint feature selection and partially constrained cluster label learning , 2019, Pattern Recognit..

[2]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zenglin Xu,et al.  Robust multi-view data clustering with multi-view capped-norm K-means , 2018, Neurocomputing.

[4]  Zenglin Xu,et al.  Self-weighted multi-view clustering with soft capped norm , 2018, Knowl. Based Syst..

[5]  Xuelong Li,et al.  Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification , 2018, IEEE Transactions on Image Processing.

[6]  Hongchuan Yu,et al.  Diverse Non-Negative Matrix Factorization for Multiview Data Representation , 2018, IEEE Transactions on Cybernetics.

[7]  Junsong Yuan,et al.  Query Adaptive Multiview Object Instance Search and Localization Using Sketches , 2018, IEEE Transactions on Multimedia.

[8]  Diego Hernán Peluffo-Ordóñez,et al.  Theoretical developments for interpreting kernel spectral clustering from alternative viewpoints , 2017 .

[9]  Shu Wu,et al.  Multiview Clustering via Unified and View-Specific Embeddings Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Chang-Dong Wang,et al.  TW-Co-k-means: Two-level weighted collaborative k-means for multi-view clustering , 2018, Knowl. Based Syst..

[11]  Zenglin Xu,et al.  Adaptive local structure learning for document co-clustering , 2018, Knowl. Based Syst..

[12]  Zhang Yi,et al.  A multitask multiview clustering algorithm in heterogeneous situations based on LLE and LE , 2019, Knowl. Based Syst..

[13]  Hamido Fujita,et al.  Multi-view manifold regularized learning-based method for prioritizing candidate disease miRNAs , 2019, Knowl. Based Syst..

[14]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Xiaofeng Zhu,et al.  One-Step Multi-View Spectral Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[16]  Junbin Gao,et al.  Multiview Subspace Clustering via Tensorial t-Product Representation , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Xianchao Zhang,et al.  Multi-view clustering on unmapped data via constrained non-negative matrix factorization , 2018, Neural Networks.

[18]  Yingjie Tian,et al.  A Comprehensive Survey of Clustering Algorithms , 2015, Annals of Data Science.

[19]  Ivica Kopriva,et al.  Multi-view low-rank sparse subspace clustering , 2017, Pattern Recognit..

[20]  Yong Xiang,et al.  Adaptive Method for Nonsmooth Nonnegative Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Wenyin Liu,et al.  Shared Multi-View Data Representation for Multi-Domain Event Detection , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Fan Ye,et al.  Incremental multi-view spectral clustering , 2019, Knowl. Based Syst..

[23]  Zenglin Xu,et al.  Robust graph regularized nonnegative matrix factorization for clustering , 2017, Data Mining and Knowledge Discovery.

[24]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[26]  Zenglin Xu,et al.  Auto-weighted multi-view clustering via kernelized graph learning , 2019, Pattern Recognit..

[27]  Jing Liu,et al.  Partially Shared Latent Factor Learning With Multiview Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Jing Liu,et al.  Semi-supervised Unified Latent Factor learning with multi-view data , 2013, Machine Vision and Applications.

[29]  Xiuying Wang,et al.  A Unified Collaborative Multikernel Fuzzy Clustering for Multiview Data , 2018, IEEE Transactions on Fuzzy Systems.

[30]  Xinbo Gao,et al.  Multiview Clustering Based on Non-Negative Matrix Factorization and Pairwise Measurements , 2019, IEEE Transactions on Cybernetics.

[31]  Hao Cai,et al.  Semi-supervised multi-view clustering based on constrained nonnegative matrix factorization , 2019, Knowl. Based Syst..

[32]  Hamido Fujita,et al.  A study of graph-based system for multi-view clustering , 2019, Knowl. Based Syst..

[33]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.