Poisson Blended Exemplar-based Texture Completion

Image inpainting is the process of correcting undesirable changes to an image in an unobtrusive way. The existing literature in this research field describes predominantly techniques designed to correct narrow missing regions, which thus often produce undesirable results when the damaged region is large. This paper presents a novel exemplar-based image inpainting technique for automatic filling-in missing region of an image. Our solution offers two major improvements compared to existing techniques. Patches for filling in missing regions are identified using an appearance space vector, which not only encodes pixel colours, but also colour gradients, feature distances and other measures for computing image similarity. In order to speed up the search for a matching patch we use a Principal Component Analysis to reduce the size of a feature vector used for patch comparison. The second major improvement is the technique used combine patches filling in a missing region. In order to avoid visible seams we use a Poisson-guided interpolation to blend patches. Our evaluation and comparison with existing techniques demonstrates significantly improved performance for inpainting missing image regions.

[1]  B.C. Wunsche,et al.  Analysis of appearance space attributes for texture synthesis and morphing , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[2]  Image and Vision Computing New Zealand, IVCNZ '12, Dunedin, New Zealand - November 26 - 28, 2012 , 2012, IVCNZ.

[3]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[4]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[5]  Bruce H. Thomas,et al.  Proceedings of the Thirty-Seventh Australasian Computer Science Conference - Volume 147 , 2011 .

[6]  Ja-Ling Wu,et al.  Robust Algorithm for Exemplar-based Image Inpainting , 2005 .

[7]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[8]  Christof Lutteroth,et al.  Parameter optimisation for texture completion , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[9]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[10]  Hugues Hoppe,et al.  Appearance-space texture synthesis , 2006, SIGGRAPH 2006.

[11]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[12]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[13]  Cláudio Rosito Jung,et al.  Block-based image inpainting in the wavelet domain , 2007, The Visual Computer.

[14]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..