Multi-view clustering via joint feature selection and partially constrained cluster label learning

Abstract Real world data are often represented by multiple distinct feature sets, and some prior knowledge is provided, such as labels of some examples or pairwise constraints between several sample pairs. Accordingly, task of multi-view clustering arises from a complex information aggregation of multiple sources of feature sets and knowledge prior. In this paper, we propose to optimize the cluster indicator, which representing the class labels is an intuitive reflection of the clustering structure. Besides, the prior indicating the same level of semantics can be directly utilized guiding the learned clustering structure. Furthermore, feature selection is embedded into the above process to select views and features in each view, which leads to the most discriminative views and features chosen for every single cluster. To these ends, an objective is accordingly proposed with an efficient optimization strategy and convergence analysis. Extensive experiments demonstrate that our model performs better than the state-of-the-art methods.

[1]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Liang Wang,et al.  Multi-view clustering via pairwise sparse subspace representation , 2015, Neurocomputing.

[3]  Zahid Halim,et al.  Multi-view document clustering via ensemble method , 2014, Journal of Intelligent Information Systems.

[4]  Thomas Seidl,et al.  SMVC: semi-supervised multi-view clustering in subspace projections , 2014, KDD.

[5]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[6]  Pascal Frossard,et al.  Clustering on Multi-Layer Graphs via Subspace Analysis on Grassmann Manifolds , 2013, IEEE Transactions on Signal Processing.

[7]  Shifei Ding,et al.  A semi-supervised approximate spectral clustering algorithm based on HMRF model , 2018, Inf. Sci..

[8]  Xuran Zhao,et al.  A subspace co-training framework for multi-view clustering , 2014, Pattern Recognit. Lett..

[9]  Jing Liu,et al.  Partially Shared Latent Factor Learning With Multiview Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Guoyin Wang,et al.  A Semi-supervised Three-Way Clustering Framework for Multi-view Data , 2017, IJCRS.

[11]  Derek Greene,et al.  A Matrix Factorization Approach for Integrating Multiple Data Views , 2009, ECML/PKDD.

[12]  Liang Wang,et al.  Incomplete Multi-view Clustering via Subspace Learning , 2015, CIKM.

[13]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[14]  Lei Du,et al.  Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition , 2014, AAAI.

[15]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[16]  Wei Tang,et al.  Clustering with Multiple Graphs , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[17]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[18]  Stéphane Marchand-Maillet,et al.  Multiview clustering: a late fusion approach using latent models , 2009, SIGIR.

[19]  Eric Eaton,et al.  Multi-view clustering with constraint propagation for learning with an incomplete mapping between views , 2010, CIKM.

[20]  Xuelong Li,et al.  Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours , 2017, AAAI.

[21]  Xiaochun Cao,et al.  Diversity-induced Multi-view Subspace Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Xuelong Li,et al.  Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification , 2018, IEEE Transactions on Image Processing.

[24]  Vishal M. Patel,et al.  Multimodal sparse and low-rank subspace clustering , 2018, Inf. Fusion.

[25]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[26]  Yun Fu,et al.  Dual Low-Rank Decompositions for Robust Cross-View Learning , 2019, IEEE Transactions on Image Processing.

[27]  Ivor W. Tsang,et al.  Dynamic vehicle routing with stochastic requests , 2003, IJCAI 2003.

[28]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[29]  Victor C. M. Leung,et al.  Incomplete multi-view clustering via deep semantic mapping , 2018, Neurocomputing.

[30]  Ivica Kopriva,et al.  A Nonlinear Orthogonal Non-Negative Matrix Factorization Approach to Subspace Clustering , 2017, Pattern Recognit..

[31]  Shiliang Sun,et al.  Multi-view learning overview: Recent progress and new challenges , 2017, Inf. Fusion.

[32]  Dragomir R. Radev,et al.  Edge Weight Regularization over Multiple Graphs for Similarity Learning , 2010, 2010 IEEE International Conference on Data Mining.

[33]  Samuel Kaski,et al.  Probabilistic approach to detecting dependencies between data sets , 2008, Neurocomputing.

[34]  Feiping Nie,et al.  Multi-View Clustering and Feature Learning via Structured Sparsity , 2013, ICML.

[35]  Shu Wu,et al.  Multiview Clustering via Unified and View-Specific Embeddings Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[37]  Xiaohong Chen,et al.  A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data , 2012, Pattern Recognit..

[38]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Feiping Nie,et al.  Multiple view semi-supervised dimensionality reduction , 2010, Pattern Recognit..

[40]  Liang Wang,et al.  Unified subspace learning for incomplete and unlabeled multi-view data , 2017, Pattern Recognit..

[41]  Steffen Bickel,et al.  Multi-view clustering , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[42]  Huan Liu,et al.  Unsupervised Feature Selection for Multi-View Data in Social Media , 2013, SDM.

[43]  Quan-Sen Sun,et al.  A novel semi-supervised canonical correlation analysis and extensions for multi-view dimensionality reduction , 2014, J. Vis. Commun. Image Represent..

[44]  Jing Liu,et al.  Semi-supervised Unified Latent Factor learning with multi-view data , 2013, Machine Vision and Applications.

[45]  Zhang Dao Semi-Supervised Canonical Correlation Analysis Algorithm , 2008 .

[46]  Songcan Chen,et al.  Doubly Aligned Incomplete Multi-view Clustering , 2018, IJCAI.

[47]  Shuicheng Yan,et al.  Convex Sparse Spectral Clustering: Single-View to Multi-View , 2015, IEEE Transactions on Image Processing.

[48]  Xuelong Li,et al.  Unsupervised Feature Selection with Structured Graph Optimization , 2016, AAAI.

[49]  Ivica Kopriva,et al.  Multi-view low-rank sparse subspace clustering , 2017, Pattern Recognit..

[50]  Hao Wang,et al.  Multi-view clustering: A survey , 2018, Big Data Min. Anal..