Fast Single Image Super-Resolution

This paper addresses the problem of single image super-resolution (SR), which consists of recovering a high resolution image from its blurred, decimated and noisy version. The existing algorithms for single image SR use different strategies to handle the decimation and blurring operators. In addition to the traditional first-order gradient methods, recent techniques investigate splitting-based methods dividing the SR problem into up-sampling and deconvolution steps that can be easily solved. Instead of following this splitting strategy, we propose to deal with the decimation and blurring operators simultaneously by taking advantage of their particular properties in the frequency domain, leading to a new fast SR approach. Specifically, an analytical solution can be obtained and implemented efficiently for the Gaussian prior or any other regularization that can be formulated into an $\ell_2$-regularized quadratic model, i.e., an $\ell_2$-$\ell_2$ optimization problem. Furthermore, the flexibility of the proposed SR scheme is shown through the use of various priors/regularizations, ranging from generic image priors to learning-based approaches. In the case of non-Gaussian priors, we show how the analytical solution derived from the Gaussian case can be embedded intotraditional splitting frameworks, allowing the computation cost of existing algorithms to be decreased significantly. Simulation results conducted on several images with different priors illustrate the effectiveness of our fast SR approach compared with the existing techniques.

[1]  Narendra Ahuja,et al.  Single image super-resolution from transformed self-exemplars , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Adrian Basarab,et al.  Alternating direction method of multipliers framework for super-resolution in ultrasound imaging , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[3]  Anthony G. Christodoulou,et al.  Super-resolution hyperspectral imaging with unknown blurring by low-rank and group-sparse modeling , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[5]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[7]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[8]  Jean-Yves Tourneret,et al.  Joint Segmentation and Deconvolution of Ultrasound Images Using a Hierarchical Bayesian Model Based on Generalized Gaussian Priors , 2016, IEEE Transactions on Image Processing.

[9]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[10]  J. Ng,et al.  Wavelet restoration of medical pulse-echo ultrasound images in an EM framework , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[11]  Luminita A. Vese,et al.  Efficient Deconvolution and Super-Resolution Methods in Microwave Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Jelena Kovacevic,et al.  Alternating direction optimization for image segmentation using hidden Markov measure field models , 2014, Electronic Imaging.

[13]  Jean-François Giovannelli,et al.  Gradient Scan Gibbs Sampler: An Efficient Algorithm for High-Dimensional Gaussian Distributions , 2015, IEEE Journal of Selected Topics in Signal Processing.

[14]  Isaac N. Bankman,et al.  Handbook of medical imaging , 2000 .

[15]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[16]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[17]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[18]  Lea Fleischer,et al.  Regularization of Inverse Problems , 1996 .

[19]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.

[20]  Bruce H. Pillman Super-Resolution Imaging , 2013, J. Electronic Imaging.

[21]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[22]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Thomas S. Huang,et al.  Image Super-Resolution: Historical Overview and Future Challenges , 2017 .

[24]  Heung-Yeung Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004 .

[25]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[26]  Saïd Moussaoui,et al.  Efficient Gaussian Sampling for Solving Large-Scale Inverse Problems Using MCMC , 2014, IEEE Transactions on Signal Processing.

[27]  Peyman Milanfar,et al.  Superfast superresolution , 2011, 2011 18th IEEE International Conference on Image Processing.

[28]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[29]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[30]  Mehran Ebrahimi,et al.  Regularization schemes involving self-similarity in imaging inverse problems , 2008 .

[31]  Manjunath V. Joshi,et al.  Single‐frame image super‐resolution using learned wavelet coefficients , 2004, Int. J. Imaging Syst. Technol..

[32]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[33]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[34]  Yücel Altunbasak,et al.  Super-resolution reconstruction of hyperspectral images , 2004, IEEE Transactions on Image Processing.

[35]  Michael K. Ng,et al.  Solving Constrained Total-variation Image Restoration and Reconstruction Problems via Alternating Direction Methods , 2010, SIAM J. Sci. Comput..

[36]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[37]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[38]  Joseph Y. Lo,et al.  Efficient Fourier-Wavelet Super-Resolution , 2010, IEEE Transactions on Image Processing.

[39]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[40]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[41]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[42]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[43]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[44]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[45]  José M. Bioucas-Dias,et al.  Bayesian wavelet-based image deconvolution: a GEM algorithm exploiting a class of heavy-tailed priors , 2006, IEEE Transactions on Image Processing.

[46]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[47]  Christian P. Robert,et al.  The Bayesian choice : from decision-theoretic foundations to computational implementation , 2007 .

[48]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[49]  Jean-François Giovannelli,et al.  Sampling High-Dimensional Gaussian Distributions for General Linear Inverse Problems , 2012, IEEE Signal Processing Letters.

[50]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[51]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[52]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[53]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[54]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[55]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[56]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[57]  Richard L. Van Metter,et al.  Handbook of Medical Imaging , 2009 .

[58]  José M. Bioucas-Dias,et al.  Hyperspectral compressive acquisition in the spatial domain via blind factorization , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[59]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.