Single-image super-resolution using directional total variation regularization and alternating direction method of multiplier solver

Abstract. Single-image super-resolution (SR) is one of the most important and challenging issues in image processing. To produce a high-resolution image from a low-resolution image, one of the conventional approaches is to leverage regularization to overcome the limitations caused by the modeling. However, conventional regularizers such as total variation always neglect the high-level structures in the data. To overcome the drawback, we propose to explore the underlying information for the images with structured edges by using directional total variation. An alternating direction method of a multiplier-based algorithm is presented to effectively solve the resulting optimization problem. Computer simulations on several texture images such as a leaf image have been used to demonstrate the effectiveness and improvement of the proposed method on SR reconstruction, both qualitatively and quantitatively. Furthermore, the effect of parameter selection is also discussed for the proposed method.

[1]  Emmanuel J. Candès,et al.  Super-resolution via Transform-Invariant Group-Sparse Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Arthur W. Toga,et al.  MRI resolution enhancement using total variation regularization , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[4]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[5]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[6]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Bingsheng He,et al.  A new inexact alternating directions method for monotone variational inequalities , 2002, Math. Program..

[9]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[10]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[12]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[13]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[14]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Jing Hu,et al.  Single-image superresolution based on local regression and nonlocal self-similarity , 2014, J. Electronic Imaging.

[16]  Chi-Keung Tang,et al.  Fast image/video upsampling , 2008, SIGGRAPH 2008.

[17]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Truong Q. Nguyen,et al.  Markov Random Field Model-Based Edge-Directed Image Interpolation , 2007, IEEE Transactions on Image Processing.

[19]  Dahua Lin,et al.  Hallucinating faces: TensorPatch super-resolution and coupled residue compensation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[22]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[23]  Eric Van Reeth,et al.  Super-resolution in magnetic resonance imaging: A review , 2012 .

[24]  Truong Q. Nguyen,et al.  An Augmented Lagrangian Method for Total Variation Video Restoration , 2011, IEEE Transactions on Image Processing.

[25]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[26]  H. C. Andrews,et al.  Cubic Splines for image Interpolation and Filtering , 1978 .

[27]  Ilker Bayram,et al.  Directional Total Variation , 2012, IEEE Signal Processing Letters.