Iterated neighbor-embeddings for image super-resolution

We propose an exemplar-based super-resolution algorithm based on sparsity constrained neighbor-embeddings of local image patches. We extract exemplar patch pairs from as little as the given low-resolution image, and we rely on local geometric similarities of low-and high-resolution patch spaces. While sparsely coding the local geometry with a greedy patch selection method, we refine our solution by iteratively updating the obtained high-resolution image. We finally apply an adaptive back-projection to ensure the global consistency. Our experimental results indicate promising performance on synthesizing natural looking textures and sharp edges when compared to other super-resolution methods from the literature.

[1]  Zhiwei Xiong,et al.  Robust Web Image/Video Super-Resolution , 2010, IEEE Transactions on Image Processing.

[2]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[4]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[5]  Aggelos K. Katsaggelos,et al.  Region-based super-resolution for compression , 2007, Multidimens. Syst. Signal Process..

[6]  Mehmet Türkan,et al.  Optimized neighbor embeddings for single-image super-resolution , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Mehmet Türkan,et al.  Self-content super-resolution for ultra-HD up-sampling , 2012, CVMP.

[8]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[9]  Jordi Salvador,et al.  Robust super-resolution for interactive video navigation , 2012, 2012 IEEE Second International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[10]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[11]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[12]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Aggelos K. Katsaggelos,et al.  Toward a new video compression scheme using super-resolution , 2006, Electronic Imaging.

[15]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[16]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[17]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[18]  Michal Irani,et al.  Nonparametric Blind Super-resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Heung-Yeung Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004 .

[20]  Pingkun Yan,et al.  Image Super-Resolution Via Double Sparsity Regularized Manifold Learning , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .