Turbo inpainting: Iterative K-SVD with a new dictionary

This paper introduces a new inpainting technique denominated Turbo inpainting. The algorithm modifies the K-clustering with singular value decomposition (K-SVD) inpainting method [7] to allow for iterative, progressive improvement. Turbo inpainting is composed of two separate blocks: inner inpainting and outer inpainting. The outer inpainting block maintains the original K-SVD algorithm, and is used to find a good dictionary fit for existing pixels. This step is optimum in the l2 norm error sense, i.e. it minimizes the estimation error of the existing pixels to find a dictionary expressing those existing image pixels. This dictionary, however, is not optimized for missing pixels. In fact, the missing pixels are not even considered in the optimization of the outer inpainting phase. Hence, another inpainting stage, called inner inpainting, is cascaded to the outer inpainting block to iteratively reduce the estimation error caused by the missing pixels. Since the dictionary generated by the outer inpainting block is optimal for existing pixels, it is also used as an initial dictionary for the inner inpainting block. The process continues unless the estimated maximum error is increased. The iterative modifications, though, are only applied to those missing pixels rather than to the whole image. The new algorithm shows significant improvements with respect to K-SVD both in terms of PSNR and visually.

[1]  Assaf Zomet,et al.  Learning how to inpaint from global image statistics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..

[3]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[4]  M. Sznaier,et al.  A Hankel Operator Approach to Texture Modelling and Inpainting , 2005 .

[5]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[6]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[7]  Marcelo Bertalmío,et al.  Strong-continuation, contrast-invariant inpainting with a third-order optimal PDE , 2006, IEEE Transactions on Image Processing.

[8]  Pavel Pudil,et al.  TEXTURE ORIENTED IMAGE INPAINTING BASED ON LOCAL STATISTICAL MODEL , 2008 .

[9]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[11]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.