Interactive Image Inpainting Using DCT Based Exemplar Matching

We present a novel algorithm of exemplar-based image inpainting which can achieve an interactive response and generate results with good quality. In this paper, we modify exemplar-based method with the use of Discrete Cosine Transformation (DCT) for the strategy of exemplar matching. We decompose exemplars by DCT and evaluate the matching score with fewer coefficients, which is unprecedented in image inpainting. The reason why using fewer coefficients is so important is that the efficiency of Approximate Nearest Neighbor (ANN) search drops significantly when using high dimensions. We have also developed a local gradient-based filling algorithm to complete the image blocks with unknown pixels so that the ANN search can be adopted to speed up the matching while preserving the continuity of image. Experimental results prove the advantage of this proposed method.

[1]  Hugues Hoppe,et al.  Parallel controllable texture synthesis , 2005, SIGGRAPH 2005.

[2]  Assaf Zomet,et al.  Learning how to inpaint from global image statistics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Jiaya Jia,et al.  Image completion with structure propagation , 2005, SIGGRAPH 2005.

[4]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Stephen Lin,et al.  Intrinsic colorization , 2008, SIGGRAPH 2008.

[6]  Nikos Komodakis,et al.  Image Completion Using Global Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[8]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2007, SIGGRAPH 2007.

[9]  Chunxiao Liu,et al.  Image completion based on views of large displacement , 2007, The Visual Computer.

[10]  Hajime Nobuhara,et al.  Multichannel Image Decomposition by using Pseudo-Linear Haar Wavelets , 2007, 2007 IEEE International Conference on Image Processing.

[11]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[12]  Truong Q. Nguyen,et al.  Spatio-temporal texture synthesis and image inpainting for video applications , 2005, IEEE International Conference on Image Processing 2005.