Video restoration based on PatchMatch and reweighted low-rank matrix recovery

In this paper, a new video restoration approach is proposed. By using a modified version of random PatchMatch algorithm, nearest-neighbor patches among the video frames can be grouped quickly and accurately. Then the video restoration problem can be boiled down to a low-rank matrix recovery problem, which is able to separate sparse errors from matrices that possess potential low-rank structures. Furthermore, the reweighted low-rank matrix model is used to improve the performance of video restoration by enhancing the sparsity of the sparse matrix and the low-rank property of the low-rank matrix. Experimental results show that our system achieves good performance in denosing of joint multi-frames and inpainting in the presence of small damaged areas.

[1]  Bede Liu,et al.  New fast algorithms for the estimation of block motion vectors , 1993, IEEE Trans. Circuits Syst. Video Technol..

[2]  Zuowei Shen,et al.  Robust Video Restoration by Joint Sparse and Low Rank Matrix Approximation , 2011, SIAM J. Imaging Sci..

[3]  Li-Hui Cen,et al.  A new approach of conditions on δ2s(Φ) for s-sparse recovery , 2013, Science China Information Sciences.

[4]  Victor Vianu,et al.  Invited articles section foreword , 2010, JACM.

[5]  Li-Hui Cen,et al.  Tree-Based Backtracking Orthogonal Matching Pursuit for Sparse Signal Reconstruction , 2013, J. Appl. Math..

[6]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[7]  Nadia Magnenat-Thalmann,et al.  Restoring corrupted motion capture data via jointly low-rank matrix completion , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[9]  Yigang Cen,et al.  Rank adaptive atomic decomposition for low-rank matrix completion and its application on image recovery , 2014, Neurocomputing.

[10]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[11]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[13]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Qionghai Dai,et al.  Robust Image Restoration via Reweighted Low-Rank Matrix Recovery , 2014, MMM.

[15]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[16]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[17]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[18]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[19]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[20]  John Wright,et al.  RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.