Region Adaptive Mode Selection Algorithms for Image Super-Resolution

Image super-resolution is to generate high-resolution images from low-resolution ones. There are a variety of super-resolution methods. Some are suitable in smooth regions. Some perform well in edge regions. Some achieve good performance in regular texture regions (e.g. the methods that apply the patch with similar structure). In this paper, first, we improve the patch based methods and use the similarities of smoothness and direction to choose proper reference patches. We call it the smoothness similarity and edge-direction based interpolation (SSEDI) method. Then, since different methods are suitable for different regions, we propose an adaptive method to fuse different methods according to multi-scaled first and second order differences. Three methods are chosen for fusion: KMDCC, the cubic B-spline, and the proposed SSEDI, which have good performance in smooth, edge, and regular structure regions, respectively. The derived super-resolution method will perform well in all of the three parts of images.

[1]  Jian-Jiun Ding,et al.  Structural similarity-based nonlocal edge-directed image interpolation , 2013, 2013 Picture Coding Symposium (PCS).

[2]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[3]  Irwin Sobel,et al.  An Isotropic 3×3 image gradient operator , 1990 .

[4]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Wen Gao,et al.  Nonlocal Edge-Directed Interpolation , 2009, PCM.

[7]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[8]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Weiming Dong,et al.  Image zooming using directional cubic convolution interpolation , 2012 .

[11]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[12]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Seungyong Lee,et al.  Injectivity Conditions of 2D and 3D Uniform Cubic B-Spline Functions , 2000, Graph. Model..

[14]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.