A user-friendly interactive image inpainting framework using Laplacian coordinates

Image inpainting is a challenging topic in computer vision that seeks to recover the natural aspect of an image where data has been partially damaged or occluded by undesired objects. A common drawback not addressed by most inpainting methodologies is that the user must manually provide the inpainting mask as input data to the method. Selecting the inpainting mask is tedious, time consuming and it often requires artistic skills to precisely determine the mask. In this work we design a new tool that allows users to easily select the desirable mask. The proposed framework combines the high-adherence on image contours of the Laplacian Coordinates segmentation approach with the efficiency of a recent inpainting technique that unifies anisotropic diffusion, inner product-based filling order mechanism and exemplar-based completion. The user can interact with the object that he/she intends to edit by stroking small parts of the object so as to proceed with the segmentation and inpainting task. Our comparisons show that the proposed framework has good performance in terms of applicability and effectiveness when compared against other existing techniques in the literature.

[1]  Afonso Paiva,et al.  Spectral Image Segmentation Using Image Decomposition and Inner Product-Based Metric , 2013, Journal of Mathematical Imaging and Vision.

[2]  Bryan S. Morse,et al.  Interactive Image Repair with Assisted Structure and Texture Completion , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[3]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[4]  Leif Kobbelt,et al.  Interactive image completion with perspective correction , 2006, The Visual Computer.

[5]  Vicent Caselles,et al.  Exemplar-Based Image Inpainting Using Multiscale Graph Cuts , 2013, IEEE Transactions on Image Processing.

[6]  David Tschumperlé,et al.  A smarter exemplar-based inpainting algorithm using local and global heuristics for more geometric coherence , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[7]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Manjunath V. Joshi,et al.  SVD Based Automatic Detection of Target Regions for Image Inpainting , 2012, ACCV Workshops.

[9]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[10]  Hiroshi Suzuki,et al.  String-Like Occluding Region Extraction for Background Restoration , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Narendra Ahuja,et al.  Image completion using planar structure guidance , 2014, ACM Trans. Graph..

[12]  S Muthukumar Analysis of Image Inpainting Techniques with Exemplar, Poisson, Successive Elimination and 8 Pixel Neighborhood Methods , 2010 .

[13]  Guillermo Sapiro,et al.  A Comprehensive Framework for Image Inpainting , 2010, IEEE Transactions on Image Processing.

[14]  Zhengxing Sun,et al.  Interactive Image Completion with Direction Empirical Mode , 2011, 2011 International Conference on Technologies and Applications of Artificial Intelligence.

[15]  Gabriel Taubin,et al.  Laplacian Coordinates for Seeded Image Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ming Zhao,et al.  Image inpainting with salient structure completion and texture propagation , 2011, Pattern Recognit. Lett..

[17]  Patrick Pérez,et al.  Geometrically Guided Exemplar-Based Inpainting , 2011, SIAM J. Imaging Sci..

[18]  Adam Finkelstein,et al.  The Generalized PatchMatch Correspondence Algorithm , 2010, ECCV.

[19]  Maurílio Boaventura,et al.  A well-balanced flow equation for noise removal and edge detection , 2003, IEEE Trans. Image Process..

[20]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[21]  Toshiyuki Amano Correlation Based Image Defect Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Marcos Proença de Almeida,et al.  Combining anisotropic diffusion, transport equation and texture synthesis for inpainting textured images , 2014, Pattern Recognit. Lett..