Fractional order total variation regularization for image super-resolution

In this paper, we present a fractional order total variation (TV) regularization functional for image super-resolution, the role of which is to better handle the texture details of image. This regularization functional is then incorporated into a variational formulation with an image fidelity term and the usual TV regularization that can efficiently preserve the discontinuities and image structures. The resulting evolution equation is the gradient descent flow that minimizes the overall functional. The proposed model has been applied to eight real images with promising results; unlike the existing TV-based image super-resolution models, the proposed model does not suffer from block artifacts, staircase edges and false edge near the edges.

[1]  Peyman Milanfar,et al.  A wavelet-based interpolation-restoration method for superresolution (wavelet superresolution) , 2000 .

[2]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[3]  François Malgouyres,et al.  Total variation based interpolation , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[4]  E. Maeland.  On the comparison of interpolation methods. , 1988, IEEE transactions on medical imaging.

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[7]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[8]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[9]  François Malgouyres,et al.  Edge Direction Preserving Image Zooming: A Mathematical and Numerical Analysis , 2001, SIAM J. Numer. Anal..

[10]  Otmar Scherzer,et al.  Partial Differential Equations for Zooming, Deinterlacing and Dejittering , 2011, International Journal of Computer Vision.

[11]  W. Clem Karl,et al.  3.6 – Regularization in Image Restoration and Reconstruction , 2005 .

[12]  Chi-Keung Tang,et al.  Fast image/video upsampling , 2008, SIGGRAPH 2008.

[13]  Zhihui Wei,et al.  Edge-and-corner preserving regularization for image interpolation and reconstruction , 2008, Image Vis. Comput..

[14]  Xue-Cheng Tai,et al.  Image Zooming Algorithm Based on Partial Differential Equations Technique , 2009 .

[15]  Zhu Lixin,et al.  Staircase effect alleviation by coupling gradient fidelity term , 2008, Image Vis. Comput..

[16]  Deepu Rajan,et al.  Generation of super-resolution images from blurred observations using Markov random fields , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[17]  Xavier Bresson,et al.  Nonlocal Mumford-Shah Regularizers for Color Image Restoration , 2011, IEEE Transactions on Image Processing.

[18]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[19]  G. Koch,et al.  Global Optimal Image Reconstruction from Blurred Noisy Data by a Bayesian Approach , 2002 .

[20]  Frédéric Guichard,et al.  A partial differential equation approach to image zoom , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[21]  Alain Oustaloup,et al.  Fractional differentiation for edge detection , 2003, Signal Process..

[22]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[23]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[24]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[25]  Zhang Jun,et al.  A class of fractional-order multi-scale variational models and alternating projection algorithm for image denoising , 2011 .

[26]  Yi-Fei Pu,et al.  Fractional Differential Mask: A Fractional Differential-Based Approach for Multiscale Texture Enhancement , 2010, IEEE Transactions on Image Processing.

[27]  Raymond H. Chan,et al.  Wavelet Algorithms for High-Resolution Image Reconstruction , 2002, SIAM J. Sci. Comput..

[28]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[29]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Eduardo Cuesta,et al.  Image structure preserving denoising using generalized fractional time integrals , 2012, Signal Process..

[31]  Lei Yang,et al.  Image-based bidirectional scene reprojection , 2011, ACM Trans. Graph..

[32]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..

[33]  Meng Li,et al.  Fractional-order bidirectional diffusion for image up-sampling , 2012, J. Electronic Imaging.

[34]  Jian Bai,et al.  Fractional-Order Anisotropic Diffusion for Image Denoising , 2007, IEEE Transactions on Image Processing.

[35]  Yang Wang,et al.  Joint Random Field Model for All-Weather Moving Vehicle Detection , 2010, IEEE Transactions on Image Processing.