Image inpainting with structural bootstrap priors

Abstract In this article, we consider the following inpainting problem arising in image restoration: part of an image has been removed, and we want to restore the image from the remaining, possibly noisy, portion. We show that if the true image contains no sharp edges, the inpainting can be done rather satisfactorily by means of an isotropic smoothness prior assumption. If, on the other hand, we have information concerning discontinuities in the image, we can input this information into the restoration algorithm using an anisotropic smoothness prior. Based on these observations, we propose an inpainting method based on a bootstrapping procedure that consists of the following steps: first, we smooth out the incomplete image and calculate the gradient field. Since this field is smooth, it can be inpainted satisfactorily. By using the inpainted gradient field, we then construct an anisotropic smoothness prior that pilots the inpainting of the original non-smooth image. The calculations are based on the Bayesian interpretation of the inpainting problem as a statistical inverse problem.

[1]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[2]  Tony F. Chan,et al.  Error Analysis for Image Inpainting , 2006, Journal of Mathematical Imaging and Vision.

[3]  Andy M. Yip,et al.  Simultaneous total variation image inpainting and blind deconvolution , 2005, Int. J. Imaging Syst. Technol..

[4]  Anuj Srivastava,et al.  Analysis of planar shapes using geodesic paths on shape spaces , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[6]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  E. Somersalo,et al.  Inverse problems with structural prior information , 1999 .

[8]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[9]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[11]  Jianhong Shen,et al.  Inpainting and the Fundamental Problem of Image Processing , 2002 .

[12]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[13]  Hanno Scharr,et al.  A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance , 2002, J. Vis. Commun. Image Represent..

[14]  Joachim Weickert,et al.  Relations Between Regularization and Diffusion Filtering , 2000, Journal of Mathematical Imaging and Vision.

[15]  F. Voci,et al.  Estimating the gradient in the Perona-Malik equation , 2004, IEEE Signal Processing Magazine.

[16]  Jari P. Kaipio,et al.  Aristotelian prior boundary conditions , 2006 .

[17]  Anuj Srivastava,et al.  Learning and Bayesian Shape Extraction for Object Recognition , 2004, ECCV.

[18]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[19]  Tony F. Chan,et al.  Non-texture inpainting by curvature-driven diffusions (CDD) , 2001 .

[20]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  Joachim Weickert,et al.  Scale-Space Properties of Nonstationary Iterative Regularization Methods , 2000, J. Vis. Commun. Image Represent..

[22]  E. Weissenstein.  Filling in the blanks. , 1997, Modern healthcare.

[23]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jianhong Shen,et al.  Digital inpainting based on the Mumford–Shah–Euler image model , 2002, European Journal of Applied Mathematics.

[25]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[26]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..