Robust single image super resolution using neighbor embedding and fusion in wavelet domain

Abstract This paper proposes methods for super resolving single noisy low resolution images. Even if single image super resolution has been a topic of research for last few decades, super resolution of noisy low resolution images is still a challenging problem. Most of the state of the art super resolution algorithms will fail to perform if significant amount of noise is present in the observed image. In this paper, we propose a denoised patch dictionary based single image super resolution algorithm. To enhance the robustness to noise performance, this method is further modified by using a wavelet based fusion algorithm which combines the result of proposed method with direct super resolved image, and super resolved image after denoising to preserve the finer details of the super resolved image. The proposed methods are applied on the commonly used test images. The results validate that the proposed methods show improvement over the existing techniques.

[1]  Sudhish N. George,et al.  Modified dictionary learning method for sparsity based single image super-resolution , 2016, 2016 3rd International Conference on Recent Advances in Information Technology (RAIT).

[2]  Subhasis Chaudhuri,et al.  Single frame image super-resolution: should we process locally or globally? , 2007, Multidimens. Syst. Signal Process..

[3]  Jie Li,et al.  Image super-resolution: The techniques, applications, and future , 2016, Signal Process..

[4]  Mingjing Li,et al.  Review of image fusion algorithm based on multiscale decomposition , 2013, Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC).

[5]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Xinhao Liu,et al.  Single-Image Noise Level Estimation for Blind Denoising , 2013, IEEE Transactions on Image Processing.

[7]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[8]  Sudhish N. George,et al.  Single image super resolution using neighbor embedding and statistical prediction model , 2017, Comput. Electr. Eng..

[9]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Lin Feng,et al.  Locality Structured Sparsity Preserving Embedding , 2015, Int. J. Pattern Recognit. Artif. Intell..

[11]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[12]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Srimanta Mandal,et al.  Noise adaptive super-resolution from single image via non-local mean and sparse representation , 2017, Signal Process..

[15]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[16]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[17]  L. Shao,et al.  From Heuristic Optimization to Dictionary Learning: A Review and Comprehensive Comparison of Image Denoising Algorithms , 2014, IEEE Transactions on Cybernetics.

[18]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[19]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Gwendoline Blanchet,et al.  An explicit sharpness index related to global phase coherence , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Sudhish N. George,et al.  A robust face hallucination technique based on adaptive learning method , 2016, Multimedia Tools and Applications.

[22]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Narendra Ahuja,et al.  Super-resolving Noisy Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[25]  Evgin Goceri,et al.  Quantitative validation of anti‐PTBP1 antibody for diagnostic neuropathology use: Image analysis approach , 2017, International journal for numerical methods in biomedical engineering.

[26]  Harry Shum,et al.  Face Hallucination: Theory and Practice , 2007, International Journal of Computer Vision.

[27]  Michael Elad,et al.  A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution , 2014, IEEE Transactions on Image Processing.

[28]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[29]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[30]  Jing Zhang,et al.  Multi-view Sparsity Preserving Projection for dimension reduction , 2016, Neurocomputing.