Structural similarity based single image super-resolution with nonlocal regularization

Abstract Recently, sparse coding based image super-resolution has attracted increasing interests. This paper proposes an improved image super-resolution method, by incorporating structural similarity (SSIM) index and nonlocal regularization into the framework of image super-resolution via sparse coding. Firstly, an algorithm of combining SSIM based sparse coding and K-SVD is proposed to train the high resolution (HR) and low resolution (LR) dictionary pairs. And then, the sparse representations of observed LR image are sought to reconstruct the HR image with the trained LR and HR dictionary pairs by exploiting nonlocal self-similarities. Experimental results demonstrate the effectiveness of the proposed method, both in its visual effects and in quantitative terms.

[1]  Edward R. Vrscay,et al.  SSIM-inspired image restoration using sparse representation , 2012, EURASIP Journal on Advances in Signal Processing.

[2]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[3]  Yiguang Chen,et al.  Structural similarity regularized and sparse coding based super-resolution for medical images , 2012, Biomed. Signal Process. Control..

[4]  Fei Zhou,et al.  Interpolation-Based Image Super-Resolution Using Multisurface Fitting , 2012, IEEE Transactions on Image Processing.

[5]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for hyperspectral images , 2012, Signal Process..

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Masato Inoue,et al.  Posterior mean super-resolution with a compound Gaussian Markov random field prior , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[9]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[10]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[11]  Xuelong Li,et al.  Geometry constrained sparse coding for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[13]  Xinbo Gao,et al.  Video super-resolution with 3D adaptive normalized convolution , 2012, Neurocomputing.

[14]  Masato Inoue,et al.  Posterior-Mean Super-Resolution With a Causal Gaussian Markov Random Field Prior , 2011, IEEE Transactions on Image Processing.

[15]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[16]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[17]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[18]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.