Single image super resolution using neighbor embedding and statistical prediction model

Abstract This paper proposes learning based approaches for single image super-resolution using sparse representation and neighbor embedding. Two learning based methods are proposed to recover the high-resolution (HR) image patches from the low resolution (LR) patches. The first method, named as LeNm-SRI, is a computationally efficient approach using neighbor embedding in a partitioned feature space. In this method, the training set is updated by including details extracted from different scales of LR input image. LeNm-SRI, which uses sparse representation invariance, gives acceptable results at low computational load. In the second approach, named as LeNm-RBM, a statistical prediction model is used to predict HR feature coefficients to obtain increased performance. Separate prediction models are trained for each cluster, and the model parameters are updated with each input image, to adapt to input test image. Experimental results validate the computational efficiency and performance of the proposed methods.

[1]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[2]  Ruimin Hu,et al.  Position-Patch Based Face Hallucination via Locality-Constrained Representation , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[4]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[5]  Sudhish N. George,et al.  A robust face hallucination technique based on adaptive learning method , 2016, Multimedia Tools and Applications.

[6]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[7]  Yu-Chiang Frank Wang,et al.  A Self-Learning Approach to Single Image Super-Resolution , 2013, IEEE Transactions on Multimedia.

[8]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[9]  Yudong Zhang,et al.  Exponential Wavelet Iterative Shrinkage Thresholding Algorithm for compressed sensing magnetic resonance imaging , 2015, Inf. Sci..

[10]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[13]  Yudong Zhang,et al.  A Two-Level Iterative Reconstruction Method for Compressed Sensing MRI , 2011 .

[14]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[15]  Sudhish N. George,et al.  Modified dictionary learning method for sparsity based single image super-resolution , 2016, 2016 3rd International Conference on Recent Advances in Information Technology (RAIT).

[16]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[18]  Michael Elad,et al.  A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution , 2014, IEEE Transactions on Image Processing.

[19]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[21]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[22]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..