Self-Similarity Inpainting

We present a novel means of texture inpainting, dubbed Self-Similarity Inpainting, that uses the Self-Similarity Descriptor to implicitly encode complex structures through a summary of local neighborhood comparisons. Pixel patches are selected from a codebook based on descriptor distance in their original locale and after the proposed insertion. We suggest an efficient means of parallelizing this approach across an arbitrarily large number of processors, as well as describing improvements over existing techniques and extensions that shift the tradeoff between inpainting quality and algorithmic efficiency for object or artifact removal. Results are shown for a number of synthetic and captured digital images, including effects upon human foveal attention.

[1]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[3]  Paul A. Ardis,et al.  Depth-from-trajectories for uncalibrated multiview video , 2009, Electronic Imaging.

[4]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[5]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[7]  Reinhard Lüling,et al.  A dynamic distributed load balancing algorithm with provable good performance , 1993, SPAA '93.

[8]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[9]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[10]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, SIGGRAPH 2004.

[11]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[12]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[13]  Hugues Hoppe,et al.  Parallel controllable texture synthesis , 2005, SIGGRAPH 2005.

[14]  Paul A. Ardis,et al.  Visual salience metrics for image inpainting , 2009, Electronic Imaging.