Missing region recovery by promoting blockwise low-rankness

In this paper, we propose a novel missing region recovery method by promoting blockwise low-rankness. It is natural to assume that images often have local repetitive structures. Hence, any small block extracted from an image is expected to be a low-rank matrix. Based on this assumption, we formulate missing region recovery as a convex optimization problem via newly introduced block nuclear norm which promotes blockwise low-rankness of an image with missing regions. An iterative scheme for approximating a global minimizer of the problem is also presented. The scheme is based on the alternating direction method of multipliers (ADMM) and allows us to restore missing regions efficiently. Experimental results reveal that the proposed method can recover missing regions with detailed local structures.

[1]  Patrick L. Combettes,et al.  Proximal Algorithms for Multicomponent Image Recovery Problems , 2011, Journal of Mathematical Imaging and Vision.

[2]  Shunsuke Ono,et al.  Total variation-wavelet-curvelet regularized optimization for image restoration , 2011, 2011 18th IEEE International Conference on Image Processing.

[3]  Silvia Gandy,et al.  Convex optimization techniques for the efficient recovery of a sparsely corrupted low-rank matrix , 2010 .

[4]  Thomas Wiegand,et al.  Image recovery using sparse reconstruction based texture refinement , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[6]  Zongben Xu,et al.  Image Inpainting by Patch Propagation Using Patch Sparsity , 2010, IEEE Transactions on Image Processing.

[7]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[9]  Michael Elad,et al.  MCALab: Reproducible Research in Signal and Image Decomposition and Inpainting , 2010, Computing in Science & Engineering.

[10]  J. Moreau.  Proximité et dualité dans un espace hilbertien , 1965 .

[11]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[12]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .