Multi-example feature-constrained back-projection method for image super-resolution

Example-based super-resolution algorithms, which predict unknown high-resolution image information using a relationship model learnt from known high- and low-resolution image pairs, have attracted considerable interest in the field of image processing. In this paper, we propose a multi-example feature-constrained back-projection method for image super-resolution. Firstly, we take advantage of a feature-constrained polynomial interpolation method to enlarge the low-resolution image. Next, we consider low-frequency images of different resolutions to provide an example pair. Then, we use adaptive kNN search to find similar patches in the low-resolution image for every image patch in the high-resolution low-frequency image, leading to a regression model between similar patches to be learnt. The learnt model is applied to the low-resolution high-frequency image to produce high-resolution high-frequency information. An iterative back-projection algorithm is used as the final step to determine the final high-resolution image. Experimental results demonstrate that our method improves the visual quality of the high-resolution image.

[1]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[3]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[5]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[6]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[7]  Kenneth Ward Church,et al.  Dotplot : a program for exploring self-similarity in millions of lines of text and code , 1993 .

[8]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[9]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[10]  S. Biswas,et al.  Image Super-resolution , 2011 .

[11]  Xinbo Gao,et al.  Image super-resolution using non-local Gaussian process regression , 2016, Neurocomputing.

[12]  Thomas S. Huang,et al.  Efficient sparse representation based image super resolution via dual dictionary learning , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[13]  Hua Huang,et al.  Neighbor embedding based super-resolution algorithm through edge detection and feature selection , 2009, Pattern Recognit. Lett..

[14]  Gao Shang,et al.  Cubic spline interpolation on new condition , 2011 .

[15]  Lei Zhang,et al.  Nonlocal back-projection for adaptive image enlargement , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[16]  Aline Roumy,et al.  Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding , 2012, BMVC.

[17]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[18]  B. Kvasov.  Cubic Spline Interpolation , 2000 .

[19]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[20]  Larry S. Davis,et al.  EigenGait: Motion-Based Recognition of People Using Image Self-Similarity , 2001, AVBPA.

[21]  Chih-Yuan Yang,et al.  Exploiting Self-similarities for Single Frame Super-Resolution , 2010, ACCV.

[22]  Xinbo Gao,et al.  Single-Image Super-Resolution Using Active-Sampling Gaussian Process Regression , 2016, IEEE Transactions on Image Processing.

[23]  Xin Zhang,et al.  Cubic surface fitting to image with edges as constraints , 2013, ICIP.

[24]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[25]  Lei Zhang,et al.  Super-resolution with nonlocal regularized sparse representation , 2010, Visual Communications and Image Processing.

[26]  Quan Pan,et al.  Hyperspectral imagery super-resolution by sparse representation and spectral regularization , 2011, EURASIP J. Adv. Signal Process..

[27]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[28]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[29]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[30]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.