Fast and Robust Edge-Guided Exemplar-Based Image Inpainting

A fast and robust edge-guide exemplar-based method of image inpainting is proposed in this paper. Unlike traditional exemplar-based methods, we introduce an edge-reconstruction procedure before inpainting textures. The edge reconstruction procedure exploits different properties of edges, such as the curvature similarity, color similarity, and other estimate of how well two edges connect to each other. Guided by the reconstructed edge lines, the improved exemplar-based method is used to restore the textures and remaining structures. Moreover, we redesign the random search strategy to make it more suitable for our framework to solve the time-consuming problem caused by exhaustive search in most exemplar-based methods. After the match patch is chosen, color transfer is used to propagate the match patch information to further improve the visual quality and perceptual reasonability. Comprehensive experiments are performed to compare the proposed method with other well-known methods on synthetic images and natural images. The results show the proposed method can not only greatly reduce the computing time of exemplar-based methods, but also behave better on visual plausibility and continuity.

[1]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Nishihara,et al.  Exemplar-based image inpainting with patch shifting scheme , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[3]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[4]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[5]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[6]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[9]  Akinori Nishihara,et al.  Iterative Gradient-Driven Patch-Based Inpainting , 2011, PSIVT.

[10]  Charlie C. L. Wang,et al.  Fast Query for Exemplar-Based Image Completion , 2010, IEEE Transactions on Image Processing.

[11]  Luis Rueda,et al.  Advances in Image and Video Technology, Second Pacific Rim Symposium, PSIVT 2007, Santiago, Chile, December 17-19, 2007, Proceedings , 2007, PSIVT.

[12]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[13]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[15]  Oscar C. Au,et al.  Sketch-Guided Texture-Based Image Inpainting , 2006, 2006 International Conference on Image Processing.