Multi-view clustering via spectral embedding fusion

Multi-view learning, such as multi-view feature learning and multi-view clustering, has a wide range of applications in machine learning and pattern recognition. Most previous studies employ the multiple data information from various views to improve the performance of learning. The key problem is to integrate the symbiotic part of the different views or datasets. In practical clustering task, the symbiotic part includes two levels: global structure information and local structure information. However, traditional multi-view clustering methods usually ignore the energy of the local structure information. This paper proposes a novel multi-view clustering model to solve this problem, which simultaneously integrates the global structure information and local structure information of all the views. By integrating the fusion of global spectral embedding and the fusion of spectral manifold embedding from multi-view data, we construct an objective function to find the final fusional embedding and give an iteration method to solve it by using the $$L_{2,1}$$L2,1 norm. Finally, the K-means clustering method is applied to the obtained final fusional embedding. Extensive experimental results on several real multi-view data sets demonstrate the superior performance of our model.

[1]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[2]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Christopher J. C. Burges,et al.  Spectral clustering and transductive learning with multiple views , 2007, ICML '07.

[4]  Yi Yang,et al.  A Convex Formulation for Spectral Shrunk Clustering , 2015, AAAI.

[5]  Liang Wang,et al.  Incomplete Multi-view Clustering via Subspace Learning , 2015, CIKM.

[6]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[7]  Feiping Nie,et al.  Heterogeneous image feature integration via multi-modal spectral clustering , 2011, CVPR 2011.

[8]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Lei Du,et al.  Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition , 2014, AAAI.

[10]  Pietro Perona,et al.  Grouping and dimensionality reduction by locally linear embedding , 2001, NIPS.

[11]  Feiping Nie,et al.  Clustering and projected clustering with adaptive neighbors , 2014, KDD.

[12]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[13]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[15]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[16]  Xin Yu,et al.  Object Tracking With Multi-View Support Vector Machines , 2015, IEEE Transactions on Multimedia.

[17]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[18]  Xiaochun Cao,et al.  Low-Rank Tensor Constrained Multiview Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Roland Memisevic,et al.  On multi-view feature learning , 2012, ICML.