An improved regularization method for artifact rejection in image super-resolution

The main aim of this paper is to employ an improved regularization method to super-resolution problems. Super-resolution refers to a process that increases spatial resolution by fusing information from a sequence of images acquired in one or more of several possible ways. This process is an inverse problem, one that is known to be highly ill-conditioned. Total Variation regularization is one of the well-known techniques used to deal with such problems, which has some disadvantages like staircase effect artifacts and nonphysical dissipation. To enhance the robustness of processing against these artifacts, this paper proposes a new regularization method based on the coupling of fourth order PDE and a type of newly designed shock filtering based on complex diffusion in addition to previous Total Variation. In order to have sharp corner structures like edges, this work also considers a corner shock filter. The proposed scheme is not only able to remove the jittering effect artifacts along the edge directions but also able to restrain the rounding artifacts around the corner structures and most importantly, the stabilization of the overall process is assured.

[1]  Andrew Zisserman,et al.  Computer vision applied to super resolution , 2003, IEEE Signal Process. Mag..

[2]  Peyman Milanfar,et al.  Optimal Registration Of Aliased Images Using Variable Projection With Applications To Super-Resolution , 2008, Comput. J..

[3]  Raymond H. Chan,et al.  Continuation method for total variation denoising problems , 1995, Optics & Photonics.

[4]  P. Green.  Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[5]  Aggelos K. Katsaggelos,et al.  Bayesian and regularization methods for hyperparameter estimation in image restoration , 1999, IEEE Trans. Image Process..

[6]  Nikolas P. Galatsanos,et al.  Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images , 2006, IEEE Transactions on Image Processing.

[7]  Jean-Michel Morel,et al.  A review of P.D.E. models in image processing and image analysis , 2002 .

[8]  Aggelos K. Katsaggelos,et al.  General choice of the regularization functional in regularized image restoration , 1995, IEEE Trans. Image Process..

[9]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[10]  Arridge,et al.  Dual echo MR image processing using multi-spectral probabilistic diffusion coupled with shock filters , 2000 .

[11]  L. Álvarez,et al.  Signal and image restoration using shock filters and anisotropic diffusion , 1994 .

[12]  Zhihui Wei,et al.  Edge-and-corner preserving regularization for image interpolation and reconstruction , 2008, Image Vis. Comput..

[13]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[14]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[15]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[16]  Saeid Fazli,et al.  New representation of TV regularization for super-resolution , 2009, 2009 5th IEEE GCC Conference & Exhibition.

[17]  Francoise J. Preteux,et al.  Controlled anisotropic diffusion , 1995, Electronic Imaging.

[18]  M. D. Kostin.  Schrödinger–Fuerth quantum diffusion theory: Generalized complex diffusion equation , 1992 .

[19]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[20]  T. Hebert,et al.  A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors. , 1989, IEEE transactions on medical imaging.

[21]  M. Ng,et al.  Superresolution image reconstruction using fast inpainting algorithms , 2007 .

[22]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[24]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[25]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[26]  Yehoshua Y. Zeevi,et al.  Image enhancement and denoising by complex diffusion processes , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Joos Vandewalle,et al.  How to take advantage of aliasing in bandlimited signals , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[29]  Andrew Blake,et al.  Motion Deblurring and Super-resolution from an Image Sequence , 1996, ECCV.

[30]  Rachid Deriche,et al.  Image coupling, restoration and enhancement via PDE's , 1997, Proceedings of International Conference on Image Processing.

[31]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[32]  Jaakko Astola,et al.  Directional varying scale approximations for anisotropic signal processing , 2004, 2004 12th European Signal Processing Conference.

[33]  Yücel Altunbasak,et al.  Super-resolution reconstruction of hyperspectral images , 2005 .

[34]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[35]  Mostafa Kaveh,et al.  Fourth-order partial differential equations for noise removal , 2000, IEEE Trans. Image Process..

[36]  Seongjai Kim,et al.  A NON-CONVEX DIFFUSION MODEL FOR SIMULTANEOUS IMAGE DENOISING AND EDGE ENHANCEMENT , 2007 .

[37]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[38]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[39]  Joachim Weickert,et al.  Coherence-enhancing diffusion of colour images , 1999, Image Vis. Comput..

[40]  Alireza Shayesteh Fard,et al.  A novel PSO-based parameter estimation for total variation regularization , 2009, 2009 6th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[41]  Bülent Sankur,et al.  Statistical evaluation of image quality measures , 2002, J. Electronic Imaging.

[42]  J. D. van Ouwerkerk,et al.  Image super-resolution survey , 2006, Image Vis. Comput..

[43]  Saeid Fazli,et al.  A novel object based Super-Resolution using Phase Template Matching , 2009, 2009 5th IEEE GCC Conference & Exhibition.

[44]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[45]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[46]  C. Vogel,et al.  Analysis of bounded variation penalty methods for ill-posed problems , 1994 .

[47]  Andy M. Yip,et al.  Simultaneous total variation image inpainting and blind deconvolution , 2005, Int. J. Imaging Syst. Technol..

[48]  Nirmal K. Bose,et al.  High‐resolution image reconstruction with multisensors , 1998, Int. J. Imaging Syst. Technol..

[49]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Michel Barlaud,et al.  Two deterministic half-quadratic regularization algorithms for computed imaging , 1994, Proceedings of 1st International Conference on Image Processing.

[51]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.