A multi-frame super-resolution method based on the variable-exponent nonlinear diffusion regularizer

In this work, the authors have proposed a multi-frame super-resolution method that is based on the diffusion-driven regularization functional. The new regularizer contains a variable exponent that adaptively regulates its diffusion mechanism depending upon the local image features. In smooth regions, the method favors linear isotropic diffusion, which removes noise more effectively and avoids unwanted artifacts (blocking and staircasing). Near edges and contours, diffusion adaptively and significantly diminishes, and since noise is hardly visible in these regions, an image becomes sharper and resolute—with noise being largely reduced in flat regions. Empirical results from both simulated and real experiments demonstrate that our method outperforms some of the state-of-the-art classical methods based on the total variation framework.

[1]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[2]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[3]  Qiang Liu,et al.  A robust super-resolution method with improved high-frequency components estimation and aliasing correction capabilities , 2014, J. Frankl. Inst..

[4]  A. N. Rajagopalan,et al.  Superresolution of License Plates in Real Traffic Videos , 2007, IEEE Transactions on Intelligent Transportation Systems.

[5]  Daniel Cremers,et al.  A Super-Resolution Framework for High-Accuracy Multiview Reconstruction , 2013, International Journal of Computer Vision.

[6]  Chih-Yuan Yang,et al.  Exploiting Self-similarities for Single Frame Super-Resolution , 2010, ACCV.

[7]  Jong Beom Ra,et al.  Example-Based Super-Resolution via Structure Analysis of Patches , 2013, IEEE Signal Processing Letters.

[8]  Yu-Chiang Frank Wang,et al.  A Self-Learning Approach to Single Image Super-Resolution , 2013, IEEE Transactions on Multimedia.

[9]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[10]  Chuanjiang He,et al.  Fractional order total variation regularization for image super-resolution , 2013, Signal Process..

[11]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[12]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[13]  Zheng Liu,et al.  Single-image super-resolution based on Markov random field and contourlet transform , 2011, J. Electronic Imaging.

[14]  Zuofeng Zhou,et al.  Multi-Frame Super-Resolution Reconstruction Algorithm Based on Diffusion Tensor Regularization Term , 2014 .

[15]  Steven X. Ding,et al.  A Review on Basic Data-Driven Approaches for Industrial Process Monitoring , 2014, IEEE Transactions on Industrial Electronics.

[16]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[17]  A. A. Bini,et al.  A nonlinear level set model for image deblurring and denoising , 2013, The Visual Computer.

[18]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[19]  Boying Wu,et al.  An Alternative Variational Framework for Image Denoising , 2014 .

[20]  R. Courant,et al.  On the Partial Difference Equations, of Mathematical Physics , 2015 .

[21]  Stacey Levine,et al.  Image Restoration via Nonstandard Diffusion , 2004 .

[22]  Pascal Getreuer,et al.  Total Variation Inpainting using Split Bregman , 2012, Image Process. Line.

[23]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[24]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[25]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[26]  Gabriel J. Brostow,et al.  Patch Based Synthesis for Single Depth Image Super-Resolution , 2012, ECCV.

[27]  Lei Zhang,et al.  Color demosaicking by local directional interpolation and nonlocal adaptive thresholding , 2011, J. Electronic Imaging.

[28]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[29]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[30]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[32]  Colin D. Simpson,et al.  Industrial Electronics , 1936, Nature.

[33]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[35]  Dong Xu,et al.  Example-Based Super-Resolution With Soft Information and Decision , 2013, IEEE Transactions on Multimedia.

[36]  Deepu Rajan,et al.  An MRF-Based Approach to Generation of Super-Resolution Images from Blurred Observations , 2004, Journal of Mathematical Imaging and Vision.

[37]  Boying Wu,et al.  Adaptive Perona–Malik Model Based on the Variable Exponent for Image Denoising , 2012, IEEE Transactions on Image Processing.

[38]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[39]  Alexander Tanchenko,et al.  Visual-PSNR measure of image quality , 2014, J. Vis. Commun. Image Represent..

[40]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[41]  K. E. Sreenivasa Murthy,et al.  A Survey on the methods of Super-resolution Image Reconstruction , 2011 .

[42]  Weili Zeng,et al.  Image super-resolution employing a spatial adaptive prior model , 2015, Neurocomputing.

[43]  Xuelong Li,et al.  Single-image super-resolution via local learning , 2011, Int. J. Mach. Learn. Cybern..

[44]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[45]  Jianhong Li,et al.  Single-frame image super-resolution through gradient learning , 2012, 2012 IEEE International Conference on Information Science and Technology.

[46]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[48]  Zhenmin Tang,et al.  Fast Single Image Super Resolution Reconstruction via Image Separation , 2014, J. Networks.

[49]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Huijun Gao,et al.  Edge preservation image enlargement and enhancement method based on the adaptive Perona-Malik non-linear diffusion model , 2014, IET Image Process..

[51]  Qiang Liu,et al.  Adaptive Charbonnier superresolution method with robust edge preservation capabilities , 2013, J. Electronic Imaging.

[52]  Mohamed-Jalal Fadili,et al.  Multiplicative Noise Removal Using L1 Fidelity on Frame Coefficients , 2008, Journal of Mathematical Imaging and Vision.

[53]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[54]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[55]  Shin Ishii,et al.  Superresolution with compound Markov random fields via the variational EM algorithm , 2009, Neural Networks.