Fast algorithm for large-scale subspace clustering by LRR

Low-rank representation (LRR) and its variants have been proved to be powerful tools for handling subspace clustering problems. Most of these methods involve a sub-problem of computing the singular value decomposition of an n × n matrix, which leads to a computation complexity of O ( n 3 ) . Obviously, when n is large, it will be time consuming. To address this problem, the authors introduce a fast solution, which reformulates the large-scale problem to an equal form with smaller size. Thus, the proposed method remarkably reduces the computation complexity by solving a small-scale problem. Theoretical analysis proves the efficiency of the proposed model. Furthermore, we extend LRR to a general model by using Schatten p-norm instead of nuclear norm and present a fast algorithm to solve large-scale problem. Experiments on MNIST and Caltech101 databse illustrate the equivalence of the proposed algorithm and the original LRR solver. Experimental results show that the proposed algorithm is remarkably faster than traditional LRR algorithm, especially in the case of large sample number.

[1]  Rong Wang,et al.  Scalable Graph-Based Clustering With Nonnegative Relaxation for Large Hyperspectral Image , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[2]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[3]  M. Brand,et al.  Fast low-rank modifications of the thin singular value decomposition , 2006 .

[4]  Zhang Yi,et al.  fLRR: fast low-rank representation using Frobenius-norm , 2014 .

[5]  René Vidal,et al.  Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jie Zhang,et al.  Structure-Constrained Low-Rank Representation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Xuelong Li,et al.  Low-Rank Preserving Projections , 2016, IEEE Transactions on Cybernetics.

[8]  René Vidal,et al.  Low rank subspace clustering (LRSC) , 2014, Pattern Recognit. Lett..

[9]  Xiaofeng Wang,et al.  Robust Subspace Segmentation by Self-Representation Constrained Low-Rank Representation , 2018, Neural Processing Letters.

[10]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Wu He,et al.  Low-rank representation with graph regularization for subspace clustering , 2017, Soft Comput..

[12]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.