Nonlocal video denoising, simplification and inpainting using discrete regularization on graphs

We present nonlocal algorithms for video denoising, simplification and inpainting based on a generic framework of discrete regularization on graphs. We express video denoising, simplification and inpainting problems using the same variational formulation. The main advantage of this framework is the unification of local and nonlocal approaches for these processing procedures. We take advantage of temporal and spatial redundancies in order to produce high quality results. In this paper, we consider a video sequence as a volume rather than a sequence of frames, and employ algorithms that do not require any motion estimation. For video inpainting, we unify geometric- and texture-synthesis-based approaches. To reduce the computational effort, we propose an optimized method that is faster than the nonlocal approach, while producing equally appealing results.

[1]  T. Chan,et al.  Variational image inpainting , 2005 .

[2]  Stanley Osher,et al.  Deblurring and Denoising of Images by Nonlocal Functionals , 2005, Multiscale Model. Simul..

[3]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[4]  Abderrahim Elmoataz,et al.  Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing , 2008, IEEE Transactions on Image Processing.

[5]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[6]  Alexander Wong,et al.  A nonlocal-means approach to exemplar-based inpainting , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Jean-Michel Morel,et al.  Denoising image sequences does not require motion estimation , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[10]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[11]  Jian Zhao,et al.  Efficient Object-Based Video Inpainting , 2006, 2006 International Conference on Image Processing.

[12]  Abderrahim Elmoataz,et al.  Video denoising via discrete regularization on graphs , 2008, 2008 19th International Conference on Pattern Recognition.

[13]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[14]  張育晟,et al.  Navier-Stokes 方程组弱解的存在性 , 2011 .

[15]  Abderrahim Elmoataz,et al.  Video Denoising and Simplification Via Discrete Regularization on Graphs , 2008, ACIVS.

[16]  Eli Shechtman,et al.  Space-time video completion , 2004, CVPR 2004.

[17]  Michael Elad,et al.  Sparse and redundant representations and motion-estimation-free algorithm for video denoising , 2007, SPIE Optical Engineering + Applications.

[18]  Tony F. Chan,et al.  6. Image Inpainting , 2005 .

[19]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.