Image super-resolution based on locality-constrained linear coding

This paper presents a learning-based method called image super-resolution (SR) for generating a high-resolution (HR) image from a single low-resolution (LR) image. Recent research investigated the image SR problem using sparse coding, which is based on good reconstruction of any image local patch by a sparse linear combination of atoms from an overcomplete dictionary. However, sparse-coding-based SR (ScSR) generally takes a significant amount of computational time to compute an HR image. Further, it can yield only a global dictionary D = [Dh;Dl] by jointly training the concatenated HR and LR image local patches, which results in no accurate correspondence between the HR and LR dictionaries. Therefore, we propose the generation of an HR image using a linear combination of several anchor points (codes) for a local patch based on locality-constrained linear coding (LLC), which is a fast implementation of local coordinate coding (LCC). In the proposed LLC-based strategy, each local patch is represented by a weighted linear combination of its nearer codes in a predefined codebook, and the linear weights become its local coordinate coding. Experimental results show that the recovered HR images with our proposed approach can achieve comparable performance at a processing time much shorter than those of conventional methods.

[1]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[2]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[3]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[5]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[7]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[9]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).