Multi-View Robust Feature Learning for Data Clustering

Multi-view feature learning can provide basic information for consistent grouping, and is very common in practical applications, such as judicial document clustering. However, it is a challenge to combine multiple heterogeneous features to learn a comprehensive description of data samples. To solve this problem, many methods explore the correlation between various features across views by assuming that all views share the same semantic information. Inspired by this, in this paper we propose a new multi-view robust feature learning (MRFL) method. In addition to projecting features from different views to a shared semantic subspace, our approach also learns the irrelevant information of data space to capture the feature dependencies between views in potential common subspaces. Therefore, the MRFL can obtain flexible feature associations hidden in multi-view data. A new objective function is designed to derive, and solve the effective optimization process of MRFL. Experiments on real-world multi-view datasets show that the proposed MRFL method is superior to the state-of-the-art multi-view learning methods.

[1]  Z. Jane Wang,et al.  Unsupervised Multiview Nonnegative Correlated Feature Learning for Data Clustering , 2018, IEEE Signal Processing Letters.

[2]  Hao Wang,et al.  Multi-view clustering: A survey , 2018, Big Data Min. Anal..

[3]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.

[5]  Zhikui Chen,et al.  Dual Graph-Regularized Multi-view Feature Learning , 2018, 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[6]  Reshma Rastogi,et al.  Tree-based localized fuzzy twin support vector clustering with square loss function , 2017, Applied Intelligence.

[7]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Christian Jutten,et al.  Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects , 2015, Proceedings of the IEEE.

[9]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[10]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[11]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Shuicheng Yan,et al.  Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tao Yang,et al.  Co-Learning Non-Negative Correlated and Uncorrelated Features for Multi-View Data , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Feiping Nie,et al.  Multi-View Clustering and Feature Learning via Structured Sparsity , 2013, ICML.

[15]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[16]  Hong Yu,et al.  Multi-view clustering via multi-manifold regularized non-negative matrix factorization , 2017, Neural Networks.

[17]  Bin Zhao,et al.  Maximum Margin Clustering with Multivariate Loss Function , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[18]  Shiliang Sun,et al.  Multi-view learning overview: Recent progress and new challenges , 2017, Inf. Fusion.

[19]  Feng Tian,et al.  NMF-Based Comprehensive Latent Factor Learning with Multiview Da , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[20]  Liang Zhao,et al.  Unsupervised multi-view non-negative for law data feature learning with dual graph-regularization in smart Internet of Things , 2019, Future Gener. Comput. Syst..