Image decomposing for inpainting using compressed sensing in DCT domain

Inpainting images with occlusion or corruption is a challenging task. Most existing algorithms are pixel based, which construct a statistical model from image features. However, in these algorithms, the frequency component is not sufficiently addressed. In this paper, we propose a novel algorithm that utilizes compressed sensing (CS) in frequency domain to reconstruct corrupted images. In order to reconstruct image, we first decompose the image into two functions with different basic characteristics — structure component and textual component. We seek a sparse representation for the functions and use the DCT coefficients of this representation to generate an over-complete dictionary. Experimental results on real world datasets demonstrate the efficacy of our method in image inpainting. We compare our method with three state-of-the-art inpainting algorithms and demonstrate its advantages in terms of both quantitative and qualitative aspects.

[1]  P. Franti,et al.  Recovering real-world scene: high-quality image inpainting using multi-exposed references , 2009 .

[2]  Xin Li,et al.  Image Recovery Via Hybrid Sparse Representations: A Deterministic Annealing Approach , 2011, IEEE Journal of Selected Topics in Signal Processing.

[3]  Timothy K. Shih,et al.  Adaptive digital image inpainting , 2004, 18th International Conference on Advanced Information Networking and Applications, 2004. AINA 2004..

[4]  Onur G. Guleryuz,et al.  Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part I: theory , 2006, IEEE Transactions on Image Processing.

[5]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[6]  Richard G Baraniuk,et al.  More Is Less: Signal Processing and the Data Deluge , 2011, Science.

[7]  Ming Zhao,et al.  Image inpainting with salient structure completion and texture propagation , 2011, Pattern Recognit. Lett..

[8]  Xinpeng Zhang,et al.  Simultaneous inpainting for image structure and texture using anisotropic heat transfer model , 2010, Multimedia Tools and Applications.

[9]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[10]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[11]  Guillermo Sapiro,et al.  Structure and texture filling-in of missing image blocks in wireless transmission and compression applications , 2003, IEEE Trans. Image Process..

[12]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[13]  Yi Ma,et al.  Repairing Sparse Low-Rank Texture , 2012, ECCV.

[14]  Onur G. Guleryuz,et al.  Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part II: adaptive algorithms , 2006, IEEE Transactions on Image Processing.

[15]  Guangming Shi,et al.  Structure guided fusion for depth map inpainting , 2013, Pattern Recognit. Lett..

[16]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[17]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[18]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[20]  Massimo Fornasier,et al.  Compressive Sensing , 2015, Handbook of Mathematical Methods in Imaging.

[21]  Zongben Xu,et al.  Image Inpainting by Patch Propagation Using Patch Sparsity , 2010, IEEE Transactions on Image Processing.

[22]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[23]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.