Single image super-resolution using combined total variation regularization by split Bregman Iteration

This paper addresses the problem of generating a high-resolution (HR) image from a single degraded low-resolution (LR) input image without any external training set. Due to the ill-posed nature of this problem, it is necessary to find an effective prior knowledge to make it well-posed. For this purpose, we propose a novel super-resolution (SR) method based on combined total variation regularization. In the first place, we propose a new regularization term called steering kernel regression total variation (SKRTV), which exploits the local structural regularity properties in natural images. In the second place, another regularization term called non-local total variation (NLTV) is employed as a complementary term in our method, which makes the most of the redundancy of similar patches in natural images. By combining the two complementary regularization terms, we propose a maximum a posteriori probability framework of SR reconstruction. Furthermore, split Bregman iteration is applied to implement the proposed model. Extensive experiments demonstrate the effectiveness of the proposed method.

[1]  Thomas S. Huang,et al.  Non-Local Kernel Regression for Image and Video Restoration , 2010, ECCV.

[2]  Bhabatosh Chanda,et al.  Super Resolution Image Reconstruction Through Bregman Iteration Using Morphologic Regularization , 2012, IEEE Transactions on Image Processing.

[3]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[4]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[5]  Xuelong Li,et al.  Geometry constrained sparse coding for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Alexandre Boucher,et al.  Geostatistical Solutions for Super-Resolution Land Cover Mapping , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Robert L. Stevenson,et al.  Spatial Resolution Enhancement of Low-Resolution Image Sequences A Comprehensive Review with Directions for Future Research , 1998 .

[9]  Mei Han,et al.  Soft Edge Smoothness Prior for Alpha Channel Super Resolution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[11]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[12]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[13]  Xuelong Li,et al.  Greedy regression in sparse coding space for single-image super-resolution , 2013, J. Vis. Commun. Image Represent..

[14]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[15]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[16]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[17]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[18]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[19]  Lawrence Carin,et al.  A Bayesian Nonparametric Approach to Image Super-Resolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[21]  Rudolf Fleischer,et al.  Low-Resolution Gait Recognition , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[23]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[24]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[25]  Truong Q. Nguyen,et al.  Markov Random Field Model-Based Edge-Directed Image Interpolation , 2007, IEEE Transactions on Image Processing.

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  James Theiler,et al.  Resolution enhancement of multilook imagery for the multispectral thermal imager , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Hayit Greenspan,et al.  Super-Resolution in Medical Imaging , 2009, Comput. J..

[29]  Xuelong Li,et al.  Zernike-Moment-Based Image Super Resolution , 2011, IEEE Transactions on Image Processing.

[30]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[31]  Ting-Zhu Huang,et al.  Split Bregman Iteration Algorithm for Image Deblurring Using Fourth-Order Total Bounded Variation Regularization Model , 2013, J. Appl. Math..

[32]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[33]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[34]  Peyman Milanfar,et al.  Robust Kernel Regression for Restoration and Reconstruction of Images from Sparse Noisy Data , 2006, 2006 International Conference on Image Processing.

[35]  Yücel Altunbasak,et al.  Eigenface-domain super-resolution for face recognition , 2003, IEEE Trans. Image Process..

[36]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Haim Azhari,et al.  Super-resolution in PET imaging , 2006, IEEE Transactions on Medical Imaging.

[38]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[39]  Tingting Wu,et al.  Image-zooming technique based on Bregmanized nonlocal total variation regularization , 2011 .

[40]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[41]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.