Wavelet integrated residual dictionary training for single image super-resolution

Single image super-resolution (SISR) is an encouraging process for image processing applications, where the super-resolution (SR) problem is resolved by the sparse representation of a signal. This paper presents a novel single image SR algorithm based on sparse representation in the wavelet domain. Dictionary learning and sparse coding process for acquiring the high-frequency details into the wavelet domain, wavelet gives better results because wavelets promote the sparsity of the image and also provide structural information about the image. Our method combines the concept of residual image learning with the coupled K-SVD dictionary learning algorithm. Residual image is obtained by subtracting the level-one DWT approximation sub-band from level-two DWT approximation sub-band. The proposed method combined properties of wavelet decomposition such as preserving the high-frequency details, directionality-and compactness by learning the multiple dictionaries for each wavelet subband. Six wavelets integrated residual dictionaries are learned from level-one and level-two wavelet sub-band images, three for the low resolution and three for high-resolution wavelet subband images. By designing compact wavelet multiple dictionaries, we reduce the computational complexity as the number of dictionary atoms is small. The proposed algorithm is tested over four different datasets and compared with eight other super-resolution algorithms in terms of average Peak signal-to-noise ratio (PSNR) and Structural similarity index measure (SSIM). We also examine how super-resolved image can be affected by the dictionary size and patch size as these parameters play a very important role in reconstructing the HR images.

[1]  Feng Zhao,et al.  Image super-resolution via two stage coupled dictionary learning , 2019, Multimedia Tools and Applications.

[2]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Huseyin Ozkaramanli,et al.  Coupled K-SVD dictionary learning algorithm in wavelet domain for single image super-resolution , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[4]  Michael Elad,et al.  Multi-Scale Dictionary Learning Using Wavelets , 2011, IEEE Journal of Selected Topics in Signal Processing.

[5]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[6]  Yilong Yin,et al.  Content-based image retrieval via a hierarchical-local-feature extraction scheme , 2018, Multimedia Tools and Applications.

[7]  Kin-Man Lam,et al.  Facial-feature detection and localization based on a hierarchical scheme , 2014, Inf. Sci..

[8]  Kin-Man Lam,et al.  A novel face-hallucination scheme based on singular value decomposition , 2013, Pattern Recognit..

[9]  Jun-Ho Huh PLC-Integrated Sensing Technology in Mountain Regions for Drone Landing Sites: Focusing on Software Technology , 2018, Sensors.

[10]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[11]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[12]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[13]  Murat Ekinci,et al.  Single image super resolution based on sparse representation using discrete wavelet transform , 2017, Multimedia Tools and Applications.

[14]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[17]  Michael Elad,et al.  A Plurality of Sparse Representations Is Better Than the Sparsest One Alone , 2009, IEEE Transactions on Information Theory.

[18]  Yilong Yin,et al.  Saliency detection based on directional patches extraction and principal local color contrast , 2018, J. Vis. Commun. Image Represent..

[19]  Michael Elad,et al.  Example-Based Regularization Deployed to Super-Resolution Reconstruction of a Single Image , 2009, Comput. J..

[20]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Jun-Ho Huh,et al.  A Typeface Searching Technique Using Evaluation Functions for Shapes and Positions of Alphabets Used in Ancient Books for Image Searching , 2016 .

[22]  Mei Han,et al.  Soft Edge Smoothness Prior for Alpha Channel Super Resolution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Kin-Man Lam,et al.  Simultaneous Hallucination and Recognition of Low-Resolution Faces Based on Singular Value Decomposition , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Jie Ren,et al.  Context-Aware Sparse Decomposition for Image Denoising and Super-Resolution , 2013, IEEE Transactions on Image Processing.

[25]  Jian Xu,et al.  Coupled K-SVD dictionary training for super-resolution , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  LinLin Shen,et al.  Visual-Patch-Attention-Aware Saliency Detection , 2015, IEEE Transactions on Cybernetics.

[27]  Aggelos K. Katsaggelos,et al.  Bayesian combination of sparse and non-sparse priors in image super resolution , 2013, Digit. Signal Process..

[28]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[30]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[31]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[32]  Jie Li,et al.  Image super-resolution: The techniques, applications, and future , 2016, Signal Process..

[33]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[34]  R. Molina,et al.  Bayesian Super-Resolution image reconstruction using an ℓ1 prior , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[35]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Min Hu,et al.  Super-resolution via supervised classification and independent dictionary training , 2018, Multimedia Tools and Applications.

[37]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[38]  Xiaomin Wu,et al.  Wavelet Domain Multidictionary Learning for Single Image Super-Resolution , 2015, J. Electr. Comput. Eng..

[39]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[40]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Super Resolution , 2011, IEEE Transactions on Image Processing.

[41]  Jinming Li Sparse representation based single image super-resolution with low-rank constraint and nonlocal self-similarity , 2017, Multimedia Tools and Applications.

[42]  Mahmoud Nazzal,et al.  Wavelet domain dictionary learning-based single image superresolution , 2015, Signal Image Video Process..

[43]  Sri Addepalli,et al.  Global motion based video super-resolution reconstruction using discrete wavelet transform , 2018, Multimedia Tools and Applications.