Structure and texture image inpainting

Inpainting refers to the task of filling in the missing or damaged regions of an image in an undetectable manner. We have an image to be reconstructed in a user-defined region. We use a fast decomposition method to obtain two components of the image, namely structure and texture. Reconstruction of each component is performed separately. The missing information in the structure component is reconstructed using a structure inpainting algorithm, while the texture component is repaired by a texture synthesis technique. To obtain the inpainted image, the two reconstructed components are composed together. Taking advantage of both the structure inpainting methods and texture synthesis techniques, we designed an effective image reconstruction method. Comparative reconstructed test images show the merits of our proposed approach in providing high quality inpainted images.

[1]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[2]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..

[3]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[4]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[6]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[7]  Jean-François Aujol,et al.  Color image decomposition and restoration , 2006, J. Vis. Commun. Image Represent..

[8]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[10]  Antonin Chambolle,et al.  Image Decomposition into a Bounded Variation Component and an Oscillating Component , 2005, Journal of Mathematical Imaging and Vision.

[11]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[14]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[15]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.