Guided iterative back-projection scheme for single-image super-resolution

The iterative back-projection (IBP) technique is an effective approach to single-image super-resolution (SR) reconstruction. However, the conventional IBP-based SR method suffers from a jaggy and ringing effect around the edges, as the up-sampling process and the back-projection of the reconstructed image are isotropic. In this paper, we present an improved IBP approach, namely guided iterative back-projection (GIBP), which employs an effective edge-guided interpolation method for up-sampling, and either a joint bilateral filter or a guided filter is used to constrain the projection of the error coefficients so as to suppress the noise and the ringing artifacts (i.e. the halo effect). To up-scale an image with an arbitrary ratio, we also propose an edge-persevering bilinear up-scaling interpolation method in cooperation with GIBP. Experimental results validate that the proposed algorithm can significantly improve SR reconstruction accuracy, while suppressing the main artifacts, such as the ringing and jaggy effects, and the noise created in the traditional IBP methods.

[1]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[2]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[3]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[4]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[5]  Oscar C. Au,et al.  Arbitrary factor image interpolation using geodesic distance weighted 2D autoregressive modeling , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Lu Fang,et al.  Arbitrary factor image interpolation by convolution kernel constrained 2-D autoregressive modeling , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Nicola Asuni,et al.  Fast Artifacts-Free Image Interpolation , 2008, BMVC.

[8]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Lei Zhang,et al.  Nonlocal back-projection for adaptive image enlargement , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[10]  Wan-Chi Siu,et al.  Single image super-resolution using Gaussian process regression , 2011, CVPR 2011.

[11]  Mei Han,et al.  Bilateral Back-Projection for Single Image Super Resolution , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[12]  N. Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[15]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[16]  Norman R. Draper,et al.  Applied regression analysis (2. ed.) , 1981, Wiley series in probability and mathematical statistics.

[17]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[18]  Weiming Dong,et al.  Image zooming using directional cubic convolution interpolation , 2012 .

[19]  Huixin Zhou,et al.  Total variation regularized iterative back-projection method for single frame image super resolution , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.