Subspace clustering via independent subspace analysis network

Previous work on image clustering focused on seeking a low-dimensional structure from the high-dimensional image data by a shallow linear model, such as sparse subspace clustering (SSC) or low-rank representation (LRR). The recent advance of deep learning shows its superiority via handling data with nonlinear structure, i.e., sparse auto-encoder and independent subspace analysis(ISA), etc. However, most of this type of methods may ignore lots of useful information embedded in the original data. To this end, we propose a novel unsuper-vised learning algorithm via ISA incorporating the subspace structure within data. Specifically, we adopt the ISA to learn local translation invariant feature from data and integrate a prior subspace information into the output of the network simultaneously. This method performs an impressive powerful ability to learn the nature of data. By evaluating on public databases, CMU-PIE and ORL, the experimental results show that the proposed approach achieves better clustering results compared with the state-of-the-art ones.

[1]  Quoc V. Le,et al.  Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis , 2011, CVPR 2011.

[2]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Pierre Comon,et al.  Invited paper: Supervised classification: a probabilistic approach , 1995, The European Symposium on Artificial Neural Networks.

[4]  LinLin Shen,et al.  Joint representation and pattern learning for robust face recognition , 2015, Neurocomputing.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Enhong Chen,et al.  Learning Deep Representations for Graph Clustering , 2014, AAAI.

[7]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[8]  Dong Xu,et al.  Robust Kernel Low-Rank Representation , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Wei-Yun Yau,et al.  Deep Subspace Clustering with Sparsity Prior , 2016, IJCAI.

[10]  Junbin Gao,et al.  Kernel Sparse Subspace Clustering on Symmetric Positive Definite Manifolds , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Yiwen Sun,et al.  Three-dimensional Gabor feature extraction for hyperspectral imagery classification using a memetic framework , 2015, Inf. Sci..

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[15]  Kun Li,et al.  Nonrigid Structure From Motion via Sparse Representation , 2015, IEEE Transactions on Cybernetics.

[16]  Junbin Gao,et al.  Laplacian Regularized Low-Rank Representation and Its Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  René Vidal,et al.  Kernel sparse subspace clustering , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[18]  Junbin Gao,et al.  Dual Graph Regularized Latent Low-Rank Representation for Subspace Clustering , 2015, IEEE Transactions on Image Processing.

[19]  Hans-Peter Kriegel,et al.  Subspace clustering , 2012, WIREs Data Mining Knowl. Discov..