Single image super-resolution using self-examples and texture synthesis

An algorithm for single image super-resolution based on example-based super-resolution and example-based texture synthesis is proposed. While many other techniques for single image super-resolution are mainly effective on edges, the proposed algorithm enhances both edges and texture detail. The algorithm does not use an additional example database as it uses self-examples to synthesize new detail and texture, assuming that images contain a sufficient amount of self-similarity. The texture synthesis component of the algorithm enables the re-synthesis of texture at the output resolution to achieve super-resolution. The algorithm aims to create plausible, visually pleasing detail rather than reconstructing the true high-resolution image. Experimental results for natural images confirm the algorithms ability to create visually pleasing results, but also indicate that its performance is highly content dependent. Future efforts will be aimed at improving the robustness of the method.

[1]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[2]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[3]  Karol Myszkowski,et al.  Rendering Techniques 2001: Proceedings of the Eurographics Workshop in London, United Kingdom, June 25–27, 2001 , 2001, Eurographics.

[4]  Kin-Man Lam,et al.  Example-based image super-resolution with class-specific predictors , 2009, J. Vis. Commun. Image Represent..

[5]  Maneesh Agrawala,et al.  Using Photographs to Enhance Videos of a Static Scene , 2007, Rendering Techniques.

[6]  Michael Ashikhmin,et al.  Fast Texture Transfer , 2003, IEEE Computer Graphics and Applications.

[7]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Jeroen A. P. Tegenbosch,et al.  Improving nonlinear up-scaling by adapting to the local edge orientation , 2004, IS&T/SPIE Electronic Imaging.

[10]  M. Levoy,et al.  Texture synthesis by fixed neighborhood searching , 2001 .

[11]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[13]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[14]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Klamer Schutte,et al.  Resolution enhancement of low-quality videos using a high-resolution frame , 2006, Electronic Imaging.

[16]  J. D. van Ouwerkerk,et al.  Image super-resolution survey , 2006, Image Vis. Comput..

[17]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[18]  Mehran Ebrahimi,et al.  Solving the Inverse Problem of Image Zooming Using "Self-Examples" , 2007, ICIAR.

[19]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[20]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..