Compressive Sampling based Single-Image Super-resolution Reconstruction by dual-sparsity and Non-local Similarity Regularizer

Recent development on Compressive Sampling (or compressive sensing, CS) theory suggests that High-Resolution (HR) images can be correctly recovered from their Low-Resolution (LR) version under mild conditions. Inspired by it, we proposed a CS based Single-Image Super-resolution Reconstruction (SISR) framework that exploits the dual-sparsity and non-local similarity constraints of images. This new framework relies on the idea that LR image patch can be regarded as the compressive measurement of its corresponding HR patch, and a sufficiently sparse coding of HR patch under some dictionary will make an accurate recovery of HR patch from its measurement possible. In order to adaptively tune the dictionary that can well represents the underlying HR patches, we reduce the SISR to a dual-sparsity constrained optimization problem with dual variables. Moreover, the pixel based recovery is incorporated as another regularization term to exploit the image non-local similarities, which is very helpful in preserving edge sharpness. The optimization is implemented in a patch-pixel-collaboration and iterative manner, via the Singular Value Decomposition (SVD) and Orthogonal Matching Pursuit (OMP) algorithm. Experiments are taken on some natural images, remote sensing images and medical images, and the results show that our proposed method can not only provide one possible way of recovering HR image under the CS framework, but also generate HR images that are competitive or even superior in quality to images produced by other similar SISR methods.

[1]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Hayit Greenspan,et al.  Super-resolution in MRI , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[3]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[5]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[6]  Haim Azhari,et al.  Super-resolution in PET imaging , 2006, IEEE Transactions on Medical Imaging.

[7]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[8]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[9]  Michael Elad,et al.  Image Denoising Via Learned Dictionaries and Sparse representation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[11]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[12]  M. Ng,et al.  Superresolution image reconstruction using fast inpainting algorithms , 2007 .

[13]  Na Fan,et al.  Super-Resolution Using Regularized Orthogonal Matching Pursuit Based on Compressed Sensing Theory in the Wavelet Domain , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[14]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[15]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[16]  Thomas S. Huang,et al.  Image processing , 1971 .

[17]  Hong Chang,et al.  Super-resolution through neighbor embedding , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[20]  Mei Han,et al.  Soft Edge Smoothness Prior for Alpha Channel Super Resolution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Robert W. Heath,et al.  Rate Bounds on SSIM Index of Quantized Images , 2008, IEEE Transactions on Image Processing.

[22]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[23]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[24]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  Christopher M. Bishop,et al.  Bayesian Image Super-Resolution , 2002, NIPS.

[26]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[27]  Thrasyvoulos N. Pappas,et al.  Structural Similarity Quality Metrics in a Coding Context: Exploring the Space of Realistic Distortions , 2008, IEEE Transactions on Image Processing.

[28]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[29]  Aggelos K. Katsaggelos,et al.  Super Resolution of Images and Video , 2006, Super Resolution of Images and Video.

[30]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[31]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[32]  Deepu Rajan,et al.  Generalized interpolation and its application in super-resolution imaging , 2001, Image Vis. Comput..

[33]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Shuyuan Yang,et al.  Novel Super Resolution Restoration of Remote Sensing Images Based on Compressive Sensing and Example Patches-Aided Dictionary Learning , 2011, 2011 International Workshop on Multi-Platform/Multi-Sensor Remote Sensing and Mapping.

[35]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .