Self-example based super-resolution with fractal-based gradient enhancement

Recently, the example-based super-resolution method has been extensively studied due to its vivid perception. However, this kind of method directly transfers the high-frequency details of the examples to the low-resolution image, incurring false structures and over-sharpness around the texture regions. In this paper, the problem in the example-based method is investigated from an analytic discussion. Then we propose a super-resolution method that reconstructs sharp edges using the redundancy properties. The super-resolution problem is formulated as a unified regularization scheme which adaptively emphasizes the importance of high-frequency residuals in structural examples and scale invariant fractal property in textural regions. The experimental results show that the high-lights of our method exist in the enhanced visual quality with sharp edges, natural textures and few artifacts.

[1]  Raanan Fattal,et al.  Image upsampling via texture hallucination , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[2]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[4]  Guangtao Zhai,et al.  Single Image Super-resolution With Detail Enhancement Based on Local Fractal Analysis of Gradient , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Nicola Asuni,et al.  Submitted to Ieee Transactions on Image Processing 1 Real Time Artifact-free Image Upscaling , 2022 .

[6]  Licheng Yu,et al.  Robust single image super-resolution based on gradient enhancement , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[7]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[8]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[9]  Raanan Fattal,et al.  Image upsampling via imposed edge statistics , 2007, ACM Trans. Graph..

[10]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[12]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[13]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[14]  Chi-Keung Tang,et al.  Fast image/video upsampling , 2008, SIGGRAPH Asia '08.