Exemplar-Based Image Completion Model Employing PDE Corrections

To suitably complete an image without seams, block effects, and artifacts, a novel exemplar-based image completion model employing partial differential equation (PDE) is proposed. Firstly, the novel model determines the processing order of exemplar according to a composite function, which is the product of the colour property and structure property in exemplar. Then the exemplar along a geometric structure is processed prior to other parts of the image. Secondly, the most similar exemplar is found in the CIELAB colour space, and the size of it is adaptively determined by the local textured information. Thirdly, a Poisson equation is adopted to remove the seams, block effects, and artifacts in the image generated by the exemplar-based model. Finally, a bi-directional diffusion PDE is used to assist the completion of lathy linear structure. Experimental results demonstrate that the novel model can properly reconstruct the target region while preserving the geometric structure without inducing block effects, which leads to its better performance than the conventional exemplar-based image completion models.

[1]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[2]  Paul Harrison,et al.  A Non-Hierarchical Procedure for Re-Synthesis of Complex Textures , 2001, WSCG.

[3]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Louis Laborelli,et al.  Missing data correction in still images and image sequences , 2002, MULTIMEDIA '02.

[6]  Andrew Blake,et al.  PatchWorks: Example-Based Region Tiling for Image Editing , 2004 .

[7]  Nikos Komodakis,et al.  Image Completion Using Global Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Qiuqi Ruan,et al.  A Joint-Diffused Inpainting Model for Underexposure Image Preserving the Linear Geometric Structure , 2009, Informatica.

[9]  Tiow Seng Tan,et al.  Generating an /spl omega/-tile set for texture synthesis , 2005, International 2005 Computer Graphics.

[10]  Marcelo Bertalmío,et al.  Strong-continuation, contrast-invariant inpainting with a third-order optimal PDE , 2006, IEEE Transactions on Image Processing.

[11]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[12]  Amitava Datta,et al.  Synthesising Textures Using Variable Neighbourhood Searching , 2003, DICTA.

[13]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[14]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[15]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[16]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.