Distributed Multi-View Subspace Clustering via Auto-Weighted Spectral Embedding

This work examines a distributed multi-view clustering problem, where the data associated with different views is stored across multiple edge devices. A sparse subspace clustering method is adopted using auto-weighted spectral embedding to ensure that the clustering solution is consistent among local edge devices. A master-slave architecture is adopted where clustering is first performed separately at the edge devices based on their local single-view datasets but are coordinated by a spectral regularizer computed at the central node. The optimization is performed using an alternating optimization approach, where the local self-representation and the global cluster indicator matrices are optimized in turn until convergence. The weighting of the regularizer is updated in each iteration of the process and adapts automatically to the fit of the spectral embedding at different locations. The proof of convergence is provided, followed by experimental results on two public datasets, namely, Extended Yale-B and IXMAS, which demonstrate the effectiveness of the proposed method.

[1]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[2]  Dacheng Tao,et al.  A Survey on Multi-view Learning , 2013, ArXiv.

[3]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[4]  René Vidal,et al.  Structured Sparse Subspace Clustering: A unified optimization framework , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Feiping Nie,et al.  Multi-View Clustering and Feature Learning via Structured Sparsity , 2013, ICML.

[6]  Stan Z. Li,et al.  Exclusivity-Consistency Regularized Multi-view Subspace Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Philip S. Yu,et al.  A Self-Organizing Tensor Architecture for Multi-view Clustering , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[8]  Lei Du,et al.  Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition , 2014, AAAI.

[9]  Xiaochun Cao,et al.  Diversity-induced Multi-view Subspace Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[11]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[12]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[13]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.