Content Adaptive Constraint Based Image Upsampling

In this paper, we present a novel image upsampling method within a two-stage framework to reconstruct different image content (large-scale edges and small-scale structures). First, we utilize a total variation (TV) filter for image decomposition which decomposes an image content into structure component and texture component. In the first stage, the structure component is enhanced by a shock filter and an improved non-local means filter, then combines with the texture component to generate initial high-resolution (HR) image. In the second stage, the gradient of initial HR image is regarded as an edge preserving constraint to reconstruct the texture component. Experimental results demonstrate that the new approach can reconstruct faithfully the HR images with sharp edges and texture structures, and annoying artifacts (blurring, jaggies, ringing, etc.) are greatly suppressed. It outperforms the state-of-the-art approaches, based on subjective and objective evaluations.

[1]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[2]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[3]  Wotao Yin,et al.  A comparison of three total variation based texture extraction models , 2007, J. Vis. Commun. Image Represent..

[4]  S. Osher,et al.  Total Variation Based Image Cartoon-Texture Decomposition , 2005 .

[5]  Takahiro Saito,et al.  Image-Processing Approach Based on Nonlinear Image-Decomposition , 2009, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[6]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[7]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  L. Álvarez,et al.  Signal and image restoration using shock filters and anisotropic diffusion , 1994 .

[9]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[10]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[11]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Wan-Chi Siu,et al.  Robust Soft-Decision Interpolation Using Weighted Least Squares , 2012, IEEE Transactions on Image Processing.

[13]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[14]  Chunhong Pan,et al.  Fast Image Upsampling via the Displacement Field , 2014, IEEE Transactions on Image Processing.

[15]  Masashi Watanabe,et al.  Super-resolution through non-linear enhancement filters , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Neil J. Hurley,et al.  A framework for soft hashing and its application to robust image hashing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[17]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tomio Goto,et al.  Super resolution image reconstruction using total variation regularization and learning-based method , 2010, 2010 IEEE International Conference on Image Processing.

[19]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[20]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[21]  Xuelong Li,et al.  Geometry constrained sparse coding for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.