Contour-guided image completion using a sample image

Abstract. Image completion techniques are required to fill in missing regions in digital images. We propose a method that focuses on the complex structure of the foreground object. We observe that if we match the complete deformable contour of the sample object and obtain the missing contour (i.e., point set positions), the structure of the damaged object can be reconstructed. We further find that the reconstructed contour provides sufficient information to complete the image, which generates contour guidance maps as soft constraints. With the contour guidance maps, we then fill in the incomplete image parts by combining textures of both the damaged image and the sample object using optimization techniques. Experimental results demonstrate that our method is a potentially superior method for filling target regions of incomplete foreground objects with complex structure.

[1]  David Tschumperlé,et al.  Fast Anisotropic Smoothing of Multi-Valued Images using Curvature-Preserving PDE's , 2006, International Journal of Computer Vision.

[2]  Satoshi Kondo,et al.  An Image Completion Algorithm Using Occlusion-Free Images from Internet Photo Sharing Sites , 2008, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[3]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[5]  Narendra Ahuja,et al.  Transformation guided image completion , 2013, IEEE International Conference on Computational Photography (ICCP).

[6]  Nikos Komodakis,et al.  Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning , 2007, IEEE Transactions on Image Processing.

[7]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[8]  Luc Van Gool,et al.  Transforming Image Completion , 2011, BMVC.

[9]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[10]  Steven M. Drucker,et al.  Quality prediction for image completion , 2012, ACM Trans. Graph..

[11]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[12]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[13]  Zongben Xu,et al.  Image Inpainting by Patch Propagation Using Patch Sparsity , 2010, IEEE Transactions on Image Processing.

[14]  Andrew Zisserman,et al.  Get Out of my Picture! Internet-based Inpainting , 2009, BMVC.

[15]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[16]  Yinda Zhang,et al.  FrameBreak: Dramatic Image Extrapolation by Guided Shift-Maps , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Hossein Mobahi,et al.  Data-driven image completion by image patch subspaces , 2009, 2009 Picture Coding Symposium.

[18]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[19]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[20]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2008, Commun. ACM.

[21]  Dani Lischinski,et al.  "Mind the gap" , 2013, ACM Trans. Graph..

[22]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[23]  Li Chen,et al.  Sample-based image completion using structure synthesis , 2013, ICIP.

[24]  Guillermo Sapiro,et al.  A Variational Framework for Exemplar-Based Image Inpainting , 2011, International Journal of Computer Vision.

[25]  Folkmar Bornemann,et al.  Fast Image Inpainting Based on Coherence Transport , 2007, Journal of Mathematical Imaging and Vision.

[26]  Vicent Caselles,et al.  Exemplar-Based Image Inpainting Using Multiscale Graph Cuts , 2013, IEEE Transactions on Image Processing.

[27]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[29]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.