Super-resolution for noisy images via deep convolutional neural network

Super-resolution (SR) is an effective approach to enhance image spatial resolution. Although many SR algorithms have been proposed by far, little progress has been made to improve resolution for a noisy image. Conventional approaches always adopt the denoising step before applying the SR method to noisy low-resolution images. However, some high-frequency details lose during the denoising step and cannot be restored by the following SR step. Therefore, motivated by the success of deep learning in different computer vision missions, we propose a novel method named Denoising Super-Resolution Deep Convolutional Network (DSR-DCN), to combine both denoising and SR step in a single deep model. The proposed deep model straightly learns an end-to-end mapping from noisy LR space to the corresponding HR space. To equip the proposed network with the capability of blind denoising, Gaussian noise, with a range of standard deviation instead of constant value, is added to each patch of the LR space during training. Experiment results demonstrate that DSR-DCN achieves superior performance and better visual effects than the conventional approaches.

[1]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[2]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[3]  Kannan Ramchandran,et al.  Low-complexity image denoising based on statistical modeling of wavelet coefficients , 1999, IEEE Signal Processing Letters.

[4]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[5]  Thomas S. Huang,et al.  Deeply Improved Sparse Coding for Image Super-Resolution , 2015, ArXiv.

[6]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[7]  V. Ralph Algazi,et al.  Objective picture quality scale (PQS) for image coding , 1998, IEEE Trans. Commun..

[8]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[10]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[11]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[12]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Marshall F. Tappen,et al.  Utilizing Variational Optimization to Learn Markov Random Fields , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[15]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[16]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[17]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[18]  Hossein Nezamabadi-pour,et al.  Image denoising in the wavelet domain using a new adaptive thresholding function , 2009, Neurocomputing.

[19]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[20]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Daniel P. Huttenlocher,et al.  Sparse Long-Range Random Field and Its Application to Image Denoising , 2008, ECCV.

[22]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.