Divide-and-Conquer Subspace Segmentation

Several important computer vision tasks have recently been formulated as lowrank problems, with the Low-Rank Representation method (LRR) being one recent and prominent formulation. Although the method is framed as a convex program, available solutions to this program are inherently sequential and costly, thus limiting its scalability. In this work, we explore the effectiveness of a recently introduced divide-and-conquer framework, entitled DFC, in the context of LRR. We introduce the DFC-LRR algorithm as a scalable solution to the subspace segmentation problem, presenting results that illustrate the scalability and accuracy of DFC relative to LRR. We further present a detailed theoretical analysis that shows that the recovery guarantees of DFC-LRR are comparable to those of LRR.

[1]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[2]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[3]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[4]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[5]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[6]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[7]  Benjamin Recht,et al.  A Simpler Approach to Matrix Completion , 2009, J. Mach. Learn. Res..

[8]  Jian Dong,et al.  Accelerated low-rank visual recovery by random projection , 2011, CVPR 2011.

[9]  Ameet Talwalkar,et al.  Matrix Coherence and the Nystrom Method , 2010, UAI.

[10]  Shuicheng Yan,et al.  Exact Subspace Segmentation and Outlier Detection by Low-Rank Representation , 2012, AISTATS.

[11]  Ameet Talwalkar,et al.  Divide-and-Conquer Matrix Factorization , 2011, NIPS.

[12]  C. W. Gear,et al.  Multibody Grouping from Motion Images , 1998, International Journal of Computer Vision.

[13]  René Vidal,et al.  Robust classification using structured sparse representation , 2011, CVPR 2011.

[14]  Yongtian Wang,et al.  Robust Photometric Stereo via Low-Rank Matrix Completion and Recovery , 2010, ACCV.

[15]  A. Willsky,et al.  Sparse and low-rank matrix decompositions , 2009 .

[16]  Martin J. Wainwright,et al.  Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions , 2011, ICML.

[17]  Xiaodong Li,et al.  Stable Principal Component Pursuit , 2010, 2010 IEEE International Symposium on Information Theory.