Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints

Abstract Non-negative matrix factorization (NMF) has attracted sustaining attention in multi-view clustering, because of its ability of processing high-dimensional data. In order to learn the desired dimensional-reduced representation, a natural scheme is to add constraints to traditional NMF. Motivated by that the clustering performance is affected by the orthogonality of inner vectors of both the learned basis matrices and the representation matrices, a novel NMF model with co-orthogonal constraints is designed to deal with the multi-view clustering problem in this paper. For solving the proposed model, an efficient iterative updating algorithm is derived. And the corresponding convergence is proved, together with the analysis to its computational complexity. Experiments on five datasets are performed to present the advantages of the proposed algorithm against the state-of-the-art methods.

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[2]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yan Wang,et al.  Auto-weighted Multi-view learning for Semi-Supervised graph clustering , 2019, Neurocomputing.

[4]  Jinbo Bi,et al.  Multi-view cluster analysis with incomplete data to understand treatment effects , 2019, Inf. Sci..

[5]  Xianchao Zhang,et al.  Multi-view clustering on unmapped data via constrained non-negative matrix factorization , 2018, Neural Networks.

[6]  Qinghua Hu,et al.  Generalized Latent Multi-View Subspace Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[8]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.

[9]  Jing Liu,et al.  Partially Shared Latent Factor Learning With Multiview Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Zenglin Xu,et al.  Auto-weighted multi-view clustering via deep matrix decomposition , 2020, Pattern Recognit..

[11]  Xuelong Li,et al.  Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification , 2018, IEEE Transactions on Image Processing.

[12]  Wenyin Liu,et al.  Shared Multi-View Data Representation for Multi-Domain Event Detection , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Nanning Zheng,et al.  Semi-supervised person re-identification using multi-view clustering , 2019, Pattern Recognit..

[14]  Fan Ye,et al.  Incremental multi-view spectral clustering , 2019, Knowl. Based Syst..

[15]  Chang-Dong Wang,et al.  Ultra-Scalable Spectral Clustering and Ensemble Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[16]  Yong Xiang,et al.  Non-Negative Matrix Factorization With Dual Constraints for Image Clustering , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Jianping Fan,et al.  Dual regularized multi-view non-negative matrix factorization for clustering , 2017, Neurocomputing.

[18]  Yong Xiang,et al.  Adaptive Method for Nonsmooth Nonnegative Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Chang-Dong Wang,et al.  One-step Kernel Multi-view Subspace Clustering , 2020, Knowl. Based Syst..

[20]  Philip S. Yu,et al.  Multi-View Clustering Based on Belief Propagation , 2016, IEEE Transactions on Knowledge and Data Engineering.

[21]  Feiping Nie,et al.  Multiview Consensus Graph Clustering , 2019, IEEE Transactions on Image Processing.

[22]  Mohamed S. Kamel,et al.  Kernelized Supervised Dictionary Learning , 2012, IEEE Transactions on Signal Processing.

[23]  Ivica Kopriva,et al.  Multi-view low-rank sparse subspace clustering , 2017, Pattern Recognit..

[24]  Hamido Fujita,et al.  A study of graph-based system for multi-view clustering , 2019, Knowl. Based Syst..

[25]  Yike Guo,et al.  An Information-Theoretical Framework for Cluster Ensemble , 2019, IEEE Transactions on Knowledge and Data Engineering.

[26]  Chang-Dong Wang,et al.  Multi-view collaborative locally adaptive clustering with Minkowski metric , 2017, Expert Syst. Appl..

[27]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Xinlei Chen,et al.  Large Scale Spectral Clustering Via Landmark-Based Sparse Representation , 2015, IEEE Transactions on Cybernetics.

[29]  Shengli Xie,et al.  Semi-supervised multi-view clustering with Graph-regularized Partially Shared Non-negative Matrix Factorization , 2020, Knowl. Based Syst..

[30]  Fakhri Karray,et al.  Multiview Supervised Dictionary Learning in Speech Emotion Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[31]  Xiuying Wang,et al.  A Unified Collaborative Multikernel Fuzzy Clustering for Multiview Data , 2018, IEEE Transactions on Fuzzy Systems.

[32]  Hongchuan Yu,et al.  Diverse Non-Negative Matrix Factorization for Multiview Data Representation , 2018, IEEE Transactions on Cybernetics.

[33]  Chang-Dong Wang,et al.  TW-Co-k-means: Two-level weighted collaborative k-means for multi-view clustering , 2018, Knowl. Based Syst..

[34]  Xinbo Gao,et al.  Multiview Clustering Based on Non-Negative Matrix Factorization and Pairwise Measurements , 2019, IEEE Transactions on Cybernetics.

[35]  Hao Cai,et al.  Semi-supervised multi-view clustering based on constrained nonnegative matrix factorization , 2019, Knowl. Based Syst..