ManiDec: Manifold Constrained Low-Rank and Sparse Decomposition

Low-rank and sparse decomposition based image alignment has recently become an important research topic in the computer vision community. However, the reconstruction process often suffers from the perturbations caused by variations of the input samples. The reason behind is that the consistency of the learned low-rank and sparse structures for similar input samples is not well addressed in the existing literature. In this paper, a novel framework that embeds the manifold constraint into low-rank and sparse decomposition is proposed. Particularly, the proposed approach attempts to solve the original optimization problem directly and force the optimization process to satisfy the structure preservation requirement. Therefore, this novel manifold constrained low-rank and sparse decomposition (ManiDec) can consistently integrate the manifold constraint during the non-convex optimization process, and it can contribute a better solution which is robust to the variance of the input samples. Numerical comparisons between our proposed ManiDec and some state-of-the-art solvers, on several accessible databases, are presented to demonstrate its efficiency and effectiveness. In fact, to the best of our knowledge, this is the first time to integrate the manifold constraint into a non-convex framework, which has demonstrated the superiority of performance.

[1]  Fuchun Sun,et al.  Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Heeyoul Choi,et al.  Robust kernel Isomap , 2007, Pattern Recognit..

[3]  Bin Shen,et al.  Online robust image alignment via iterative convex optimization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Xiaohong Chen,et al.  A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data , 2012, Pattern Recognit..

[5]  Qingming Huang,et al.  Bilevel Multiview Latent Space Learning , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Yongqiang Zhao,et al.  Total Variation and Rank-1 Constraint RPCA for Background Subtraction , 2018, IEEE Access.

[7]  Wen Gao,et al.  Enhancing Human Face Detection by Resampling Examples Through Manifolds , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[8]  John Wright,et al.  RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[10]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[11]  Dacheng Tao,et al.  GoDec: Randomized Lowrank & Sparse Matrix Decomposition in Noisy Case , 2011, ICML.

[12]  Shiwei Ma,et al.  Image-set based face recognition using K-SVD dictionary learning , 2019, Int. J. Mach. Learn. Cybern..

[13]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Tim W. Nattkemper,et al.  ISOLLE: Locally Linear Embedding with Geodesic Distance , 2005, PKDD.

[15]  Ling Shao,et al.  Multiview Alignment Hashing for Efficient Image Search , 2015, IEEE Transactions on Image Processing.

[16]  Ling Li,et al.  Alternating direction method of multipliers for nonconvex fused regression problems , 2019, Comput. Stat. Data Anal..

[17]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[18]  David Gross,et al.  Recovering Low-Rank Matrices From Few Coefficients in Any Basis , 2009, IEEE Transactions on Information Theory.

[19]  Erik G. Learned-Miller,et al.  Data driven image models through continuous joint alignment , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Xiaojun Chen,et al.  Non-Lipschitz $\ell_{p}$-Regularization and Box Constrained Model for Image Restoration , 2012, IEEE Transactions on Image Processing.

[22]  Soon Ki Jung,et al.  Decomposition into Low-rank plus Additive Matrices for Background/Foreground Separation: A Review for a Comparative Evaluation with a Large-Scale Dataset , 2015, Comput. Sci. Rev..

[23]  Shiwei Ma,et al.  Face recognition based on manifold constrained joint sparse sensing with K-SVD , 2018, Multimedia Tools and Applications.

[24]  Adrian S. Lewis,et al.  Alternating Projections on Manifolds , 2008, Math. Oper. Res..

[25]  N. Xiu,et al.  Statistica Sinica Preprint No : SS-2015-0335 R 1 Title Variable Selection in Sparse Regression with Quadratic Measurements , 2017 .

[26]  Junbin Gao,et al.  Laplacian Regularized Low-Rank Representation and Its Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Wen Gao,et al.  Manifold–Manifold Distance and its Application to Face Recognition With Image Sets , 2012, IEEE Transactions on Image Processing.

[28]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[29]  Zheng Wang,et al.  SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression With Local Structure Prior , 2017, IEEE Transactions on Multimedia.

[30]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[31]  Stefano Soatto,et al.  Joint data alignment up to (lossy) transformations , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  B. Thompson Canonical Correlation Analysis , 1984 .

[34]  Ke Lu,et al.  Low-Rank Discriminant Embedding for Multiview Learning , 2017, IEEE Transactions on Cybernetics.

[35]  Naihua Xiu,et al.  Global solutions of non-Lipschitz $$S_{2}$$S2–$$S_{p}$$Sp minimization over the positive semidefinite cone , 2014, Optim. Lett..

[36]  Xiang Ren,et al.  Linearized Alternating Direction Method with Adaptive Penalty and Warm Starts for Fast Solving Transform Invariant Low-Rank Textures , 2012, International Journal of Computer Vision.

[37]  Thierry Bouwmans,et al.  Background Subtraction in Real Applications: Challenges, Current Models and Future Directions , 2019, Comput. Sci. Rev..

[38]  Yi Ma,et al.  TILT: Transform Invariant Low-Rank Textures , 2010, ACCV.

[39]  Arie Yeredor,et al.  Learning Coupled Embedding Using MultiView Diffusion Maps , 2015, LVA/ICA.

[40]  Alessio Del Bue,et al.  Manifold Constrained Low-Rank Decomposition , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[41]  Sridha Sridharan,et al.  Least squares congealing for unsupervised alignment of images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[43]  Sajid Javed,et al.  Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery , 2017, IEEE Signal Processing Magazine.

[44]  Chun Chen,et al.  Image Alignment by Online Robust PCA via Stochastic Gradient Descent , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Gang Liu,et al.  Sparse Low-Rank Preserving Projection for Dimensionality Reduction , 2019, IEEE Access.

[46]  Sajid Javed,et al.  On the Applications of Robust PCA in Image and Video Processing , 2018, Proceedings of the IEEE.

[47]  Yan Li,et al.  Iterative reweighted methods for $$\ell _1-\ell _p$$ℓ1-ℓp minimization , 2018, Comput. Optim. Appl..

[48]  Junfeng Yang,et al.  An Efficient TVL1 Algorithm for Deblurring Multichannel Images Corrupted by Impulsive Noise , 2009, SIAM J. Sci. Comput..

[49]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.