A Robust Framework For Eigenspace Image Reconstruction

Principal components analysis (PCA) is proved to be a useful tool for many computer vision and signal processing problems. One drawback of traditional PCA is that they are based on least squares estimation techniques and hence fail to account for "outliers" which commonly occurs in realistic training sets. To make PCA more robust to real-world problems such as image reconstruction addressed in this paper, we develop a two-step algorithm that can eliminate the outliers on both frame level and pixel level through the LASSO and RPCA separately. With LASSO optimization method, we may obtain sparse projected coefficients of the original image into the basis image space. According to the sparsity of these coefficients, sample outliers can be recognized automatically. Then, with the use of robust M-estimation, the influence of intra-sample outliers may be overwhelmed to great extent. Additionally, due to orthogonality of the principal components, the soft-threshold estimation can be applied to the LASSO to alleviate the computational costs, hence make our robust PCA method more applicable to large-scale problems. An experiment on object image reconstruction is used to illustrate the advantage of our proposed technique over standard PCA

[1]  David J. Fleet,et al.  Learning parameterized models of image motion , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[3]  I. Jolliffe Principal Component Analysis , 2002 .

[4]  Michael J. Black,et al.  Robust Parameterized Component Analysis , 2002, ECCV.

[5]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[6]  M. R. Osborne,et al.  On the LASSO and its Dual , 2000 .

[7]  N. Trendafilov,et al.  The Orthogonally Constrained Regression Revisited , 2001 .

[8]  Michael J. Black,et al.  On the unification of line processes, outlier rejection, and robust statistics with applications in early vision , 1996, International Journal of Computer Vision.

[9]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[11]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[12]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[13]  Michael J. Black,et al.  Robust parameterized component analysis: theory and applications to 2D facial appearance models , 2003, Comput. Vis. Image Underst..

[14]  I. Jolliffe,et al.  A Modified Principal Component Technique Based on the LASSO , 2003 .

[15]  S. Vines Simple principal components , 2000 .

[16]  Alan L. Yuille,et al.  Robust principal component analysis by self-organizing rules based on statistical physics approach , 1995, IEEE Trans. Neural Networks.

[17]  Jorge Cadima Departamento de Matematica Loading and correlations in the interpretation of principle compenents , 1995 .

[18]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.