Combined Structure and Texture Image Inpainting Algorithm for Natural Scene Image Completion

Image inpainting or image completion refers to the task of filling in the missing or damaged regions o f an image in a visually plausible way. Many works on this sub ject have been proposed these recent years. We pres ent a hybrid method for completion of images of natural s cenery, where the removal of a foreground object cr eates a hole in the image. The basic idea is to decompose t he original image into a structure and a texture im age. Reconstruction of each image is performed separatel y. The missing information in the structure compone nt is reconstructed using a structure inpainting algorith m, while the texture component is repaired by an im proved exemplar based texture synthesis technique. Taking advantage of both the structure inpainting methods and texture synthesis techniques, we designed an effect ive image reconstruction method. A comparison with some existing methods on different natural images shows the merits of our proposed approach in providing hi gh quality inpainted images.

[1]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[3]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[4]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[5]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[6]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[7]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[8]  Jianhong Shen,et al.  Digital inpainting based on the Mumford–Shah–Euler image model , 2002, European Journal of Applied Mathematics.

[9]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[10]  Marcelo Bertalmío,et al.  Strong-continuation, contrast-invariant inpainting with a third-order optimal PDE , 2006, IEEE Transactions on Image Processing.

[11]  Qiuqi Ruan,et al.  A Novel Exemplar-Based Image Completion Model , 2009, J. Inf. Sci. Eng..

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  Nikos Komodakis,et al.  Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning , 2007, IEEE Transactions on Image Processing.

[14]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[15]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Harald Grossauer,et al.  A Combined PDE and Texture Synthesis Approach to Inpainting , 2004, ECCV.

[17]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Guillermo Sapiro,et al.  Structure and texture filling-in of missing image blocks in wireless transmission and compression applications , 2003, IEEE Trans. Image Process..

[19]  Aurélie Bugeau,et al.  Combining Texture Synthesis and Diffusion for Image Inpainting , 2009, VISAPP.

[20]  Zhongyu Xu,et al.  Image Inpainting Algorithm Based on Partial Differential Equation , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[21]  Alexander Wong,et al.  A nonlocal-means approach to exemplar-based inpainting , 2008, 2008 15th IEEE International Conference on Image Processing.

[22]  Antonin Chambolle,et al.  Image Decomposition into a Bounded Variation Component and an Oscillating Component , 2005, Journal of Mathematical Imaging and Vision.

[23]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .