On unsupervised clustering under the union of tensor subspaces

In this paper we consider the problem of unsupervised clustering under a union of tensor (multilinear) subspaces model. In particular we take the popular union of subspaces model and endow the subspaces with an additional algebraic structure, namely that each subspace is a is a tensor product of subspaces. The resulting model is referred to as the union of tensor or multilinear subspaces. We show that several real world data sets such as images and action video data sets can be effectively represented using this model. Under this model we investigate an algorithm referred to as the Multilinear Subspace Clustering (MSC). In this context we first show by simulations on synthetic data that MSC is computationally more efficient compared to several existing methods indicating its utility in dealing with high dimensional data. Further we compare the clustering performance of the algorithm on several real-world data sets and show that MSC is competitive with current state-or-art methods. Based on these results we point out future research directions in using the multilinear/tensor algebraic framework for big-data processing.

[1]  Zhang Yi,et al.  Scalable Sparse Subspace Clustering , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Demetri Terzopoulos,et al.  Multilinear Analysis of Image Ensembles: TensorFaces , 2002, ECCV.

[4]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[5]  Misha Elena Kilmer,et al.  Multilinear subspace clustering , 2015, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[6]  Hans-Peter Kriegel,et al.  Subspace clustering , 2012, WIREs Data Mining Knowl. Discov..

[7]  Haiping Lu,et al.  A survey of multilinear subspace learning for tensor data , 2011, Pattern Recognit..

[8]  W. Hackbusch Tensor Spaces and Numerical Tensor Calculus , 2012, Springer Series in Computational Mathematics.

[9]  Dimitris Samaras,et al.  Two-person interaction detection using body-pose features and multiple instance learning , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Deng Cai,et al.  Tensor Subspace Analysis , 2005, NIPS.

[11]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[12]  Helmut Bölcskei,et al.  Robust Subspace Clustering via Thresholding , 2013, IEEE Transactions on Information Theory.

[13]  Constantine Caramanis,et al.  Greedy Subspace Clustering , 2014, NIPS.