Antialiased super-resolution with parallel high-frequency synthesis

Image super-resolution (SR) increases the resolution of the target image, and has become a fundamental image-editing operation for real-world applications. Traditional methods often cause jaggies and blurring artifacts because natural images generally contain a lot of discrete continuities and edges. This paper proposes a new synthesis-based method for image super-resolution at a pixel level that takes advantages of convolution-based edge anti-aliasing. The target images are divided into two components representing, respectively, the high- and low-frequency contents of the images. We perform bicubic interpolation to reconstruct the missing information in the low-frequency component. A patch-based texture synthesis is subsequently adopted to synthesize the high-frequency patches with the final upscaled images. In particular, we also use the efficient edge-based anti-aliasing for correcting the quantization error, restore the high-frequency details damaged by nonlinear example-based synthesis. Our proposed approach generates super-resolution images dynamically and can be fully implemented in GPU parallelization. Experiments confirm the visual superiority of our proposed approach in comparison with competing state-of-the-art techniques.

[1]  Manjunath V. Joshi,et al.  Single‐frame image super‐resolution using learned wavelet coefficients , 2004, Int. J. Imaging Syst. Technol..

[2]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[3]  Lei Yang,et al.  Antialiasing recovery , 2011, TOGS.

[4]  Michael S. Brown,et al.  Colorization for Single Image Super Resolution , 2010, ECCV.

[5]  Chris Damkat,et al.  Single image super-resolution using self-examples and texture synthesis , 2011, Signal Image Video Process..

[6]  Xiaoguang Li,et al.  An efficient example-based approach for image super-resolution , 2008, 2008 International Conference on Neural Networks and Signal Processing.

[7]  Sylvain Lefebvre,et al.  Appearance-space texture synthesis , 2006, ACM Trans. Graph..

[8]  Kin-Man Lam,et al.  Efficient Edge Detection Using Simplified Gabor Wavelets , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  A. Murat Tekalp,et al.  High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[11]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[12]  Xuelong Li,et al.  Single-image super-resolution via local learning , 2011, Int. J. Mach. Learn. Cybern..

[13]  Hongyuan Zha,et al.  Multiscale Semilocal Interpolation With Antialiasing , 2012, IEEE Transactions on Image Processing.

[14]  Michael K. Ng,et al.  Constrained total least‐squares computations for high‐resolution image reconstruction with multisensors , 2002, Int. J. Imaging Syst. Technol..

[15]  Ralph R. Martin,et al.  Mixed-Domain Edge-Aware Image Manipulation , 2013, IEEE Transactions on Image Processing.

[16]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Michael Elad,et al.  Example-Based Regularization Deployed to Super-Resolution Reconstruction of a Single Image , 2009, Comput. J..

[19]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[20]  Chunhong Pan,et al.  Fast Image Upsampling via the Displacement Field , 2014, IEEE Transactions on Image Processing.

[21]  Jayanthi Pragatheeswaran,et al.  Image resolution enhancement based on edge directed interpolation using dual tree — Complex wavelet transform , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[22]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, ACM Trans. Graph..

[23]  Chi-Keung Tang,et al.  Fast image/video upsampling , 2008, SIGGRAPH Asia '08.

[24]  Michael Elad,et al.  Example-based single document image super-resolution: a global MAP approach with outlier rejection , 2007, Multidimens. Syst. Signal Process..

[25]  Kwang In Kim,et al.  Example-Based Learning for Single-Image Super-Resolution , 2008, DAGM-Symposium.

[26]  Il-hong Shin,et al.  Image Resolution Enhancement using Inter-Subband Correlation in Wavelet Domain , 2007, 2007 IEEE International Conference on Image Processing.

[27]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[28]  Kin-Man Lam,et al.  Example-based image super-resolution with class-specific predictors , 2009, J. Vis. Commun. Image Represent..

[29]  Andrew Zisserman,et al.  Super-resolution enhancement of text image sequences , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[30]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Raanan Fattal Image upsampling via imposed edge statistics , 2007, SIGGRAPH 2007.

[32]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[33]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[34]  Noriaki Suetake,et al.  Image super-resolution based on local self-similarity , 2008 .

[35]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Manjunath V. Joshi,et al.  A learning-based method for image super-resolution from zoomed observations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Daniel Thalmann,et al.  Parallel iso/aniso-scale surface texturing guided in Gabor space , 2013, SA '13.

[38]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[39]  Deepu Rajan,et al.  Simultaneous Estimation of Super-Resolved Scene and Depth Map from Low Resolution Defocused Observations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[41]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[42]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[43]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.