Image Inpainting Using Directional Tensor Product Complex Tight Framelets

In this paper we are particularly interested in the image inpainting problem using directional complex tight wavelet frames. Under the assumption that frame coefficients of images are sparse, several iterative thresholding algorithms for the image inpainting problem have been proposed in the literature. The outputs of such iterative algorithms are closely linked to solutions of several convex minimization models using the balanced approach which simultaneously combines the $l_1$-regularization for sparsity of frame coefficients and the $l_2$-regularization for smoothness of the solution. Due to the redundancy of a tight frame, elements of a tight frame could be highly correlated and therefore, their corresponding frame coefficients of an image are expected to close to each other. This is called the grouping effect in statistics. In this paper, we establish the grouping effect property for frame-based convex minimization models using the balanced approach. This result on grouping effect partially explains the effectiveness of models using the balanced approach for several image restoration problems. Inspired by recent development on directional tensor product complex tight framelets (TP-CTFs) and their impressive performance for the image denoising problem, in this paper we propose an iterative thresholding algorithm using a single tight frame derived from TP-CTFs for the image inpainting problem. Experimental results show that our proposed algorithm can handle well both cartoons and textures simultaneously and performs comparably and often better than several well-known frame-based iterative thresholding algorithms for the image inpainting problem without noise. For the image inpainting problem with additive zero-mean i.i.d. Gaussian noise, our proposed algorithm using TP-CTFs performs superior than other known state-of-the-art frame-based image inpainting algorithms.

[1]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[2]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[3]  Wang-Q Lim,et al.  Nonseparable Shearlet Transform , 2013, IEEE Transactions on Image Processing.

[4]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Zhenpeng Zhao,et al.  Tensor Product Complex Tight Framelets with Increasing Directionality , 2013, SIAM J. Imaging Sci..

[6]  Zuowei Shen Wavelet Frames and Image Restorations , 2011 .

[7]  Zuowei Shen Affine systems in L 2 ( IR d ) : the analysis of the analysis operator , 1995 .

[8]  B. Han Properties of Discrete Framelet Transforms , 2013 .

[9]  I. Selesnick,et al.  Bivariate shrinkage with local variance estimation , 2002, IEEE Signal Processing Letters.

[10]  Steven A. Orszag,et al.  CBMS-NSF REGIONAL CONFERENCE SERIES IN APPLIED MATHEMATICS , 1978 .

[11]  R. Chan,et al.  A Framelet-Based Approach for Image Inpainting , 2005 .

[12]  B. Han On Dual Wavelet Tight Frames , 1997 .

[13]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[14]  R. Chan,et al.  Tight frame: an efficient way for high-resolution image reconstruction , 2004 .

[15]  B. Han Nonhomogeneous Wavelet Systems in High Dimensions , 2010, 1002.2421.

[16]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[17]  Ding-Xuan Zhou,et al.  On grouping effect of elastic net , 2013 .

[18]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[19]  Michael Elad,et al.  Analysis versus synthesis in signal priors , 2006, 2006 14th European Signal Processing Conference.

[20]  Jian-Feng Cai,et al.  A framelet-based image inpainting algorithm , 2008 .

[21]  Kim-Chuan Toh,et al.  An Accelerated Proximal Gradient Algorithm for Frame-Based Image Restoration via the Balanced Approach , 2011, SIAM J. Imaging Sci..

[22]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[23]  Gitta Kutyniok,et al.  Shearlets: Multiscale Analysis for Multivariate Data , 2012 .

[24]  Jian-Feng Cai,et al.  Simultaneous cartoon and texture inpainting , 2010 .

[25]  A. Ron,et al.  Affine Systems inL2(Rd): The Analysis of the Analysis Operator , 1997 .

[26]  Lixin Shen,et al.  Adaptive Inpainting Algorithm Based on DCT Induced Wavelet Regularization , 2013, IEEE Transactions on Image Processing.

[27]  Bin Dong,et al.  MRA-based wavelet frames and applications , 2013 .

[28]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[29]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[30]  Raymond H. Chan,et al.  Wavelet Algorithms for High-Resolution Image Reconstruction , 2002, SIAM J. Sci. Comput..

[31]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[32]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..