Screen Window Propagating for Image Inpainting

Image repair often has errors in filling. An exemplar-based technique has the advantage of filling texture and structure simultaneously, but there exist some problems with this, such as not considering the overall situation of inpainting, the unreasonable calculation of priority, and random selection when there are multiple candidate patches. In view of these situations, this paper proposes a method of screen window propagating where the upper layer guides the lower layer inpainting from the top layer by means of multiple resolution decomposition. Screen window propagating aims to constrain the inpainting of the lower layer and maintain the overall profile. Improving the priority calculation using the upper repair result can lead to getting a better repair order. When there is more than one candidate patch, the structural similarity index measure (SSIM) is used to obtain the best candidate patch. We consider four cases of rotation and inversion when looking for the best exemplar. The experiments show that our method can obtain more satisfactory results than other methods based on subjective and objective indicators, such as peak signal-to-noise ratio (PSNR), SSIM, and feature similarity index measurement. Screen window propagating for image inpainting aims toward image restoration. Whole contours are preserved and the lower layer can utilize more upper layer information. Our method considers information from the whole and its parts.

[1]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[2]  Bhabatosh Chanda,et al.  An image inpainting method using pLSA-based search space estimation , 2014, Machine Vision and Applications.

[3]  Yi-Qing Wang,et al.  E-PLE: an Algorithm for Image Inpainting , 2013, Image Process. Line.

[4]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[5]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[6]  Patrick Pérez,et al.  Non-Local Patch-Based Image Inpainting , 2017, Image Process. Line.

[7]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Jong Beom Ra,et al.  Block Poisson Method and its application to large scale image editing , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Lei Shi,et al.  An improved exemplar-based image inpainting algorithm , 2014, 2014 9th International Conference on Computer Science & Education.

[10]  Anupam,et al.  Fast and Enhanced Algorithm for Exemplar Based Image Inpainting , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[11]  Nikos Komodakis,et al.  Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning , 2007, IEEE Transactions on Image Processing.

[12]  Mehmet Türkan,et al.  Object removal and loss concealment using neighbor embedding methods , 2013, Signal Process. Image Commun..

[13]  Adam Finkelstein,et al.  The Generalized PatchMatch Correspondence Algorithm , 2010, ECCV.

[14]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[15]  Jayanta Mukhopadhyay,et al.  Modified Exemplar-Based Image Inpainting via Primal-Dual Optimization , 2015, PReMI.

[16]  C. Manjula,et al.  SUPER RESOLUTION BASED INPAINTING , 2015 .

[17]  S Padmavathi Hierarchical digital image inpainting , 2015 .

[18]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[19]  Xinwei Yang,et al.  Effective exemplar-based image inpainting using low-rank matrix completion , 2015, 2015 IEEE 7th International Conference on Awareness Science and Technology (iCAST).

[20]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[21]  Guillermo Sapiro,et al.  A Variational Framework for Exemplar-Based Image Inpainting , 2011, International Journal of Computer Vision.

[22]  Humberto Bustince,et al.  Two-step Algorithm for Image Inpainting , 2017, EUSFLAT/IWIFSGN.

[23]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[24]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[25]  David Tschumperlé,et al.  A smarter exemplar-based inpainting algorithm using local and global heuristics for more geometric coherence , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  Gabriele Facciolo,et al.  Variational Framework for Non-Local Inpainting , 2015, Image Process. Line.