Super-Resolution and Blind Deconvolution For Rational Factors With an Application to Color Images

In many real applications, traditional super-resolution (SR) methods fail to provide high-resolution images due to objectionable blur and inaccurate registration of input low-resolution images. Only integer resolution enhancement factors, such as 2 or 3, are often considered, but non-integer factors between 1 and 2 are also important in real cases. We introduce a method to SR and deconvolution, which assumes no prior information about the shape of degradation blurs, incorporates registration parameters, and is properly defined for any rational (fractional) resolution factor. The method minimizes a regularized energy function with respect to the high-resolution image and blurs, where regularization is carried out in both the image and blur domains. The blur regularization is based on a generalized multi-channel blind deconvolution constraint derived in the paper. An extension to color images is briefly discussed. Experiments on real data illustrate robustness to noise and other advantages of the method.

[1]  Peyman Milanfar,et al.  Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement , 2001, IEEE Trans. Image Process..

[2]  Jan Flusser,et al.  A Unified Approach to Superresolution and Multichannel Blind Deconvolution , 2007, IEEE Transactions on Image Processing.

[3]  Hung-Ta Pai,et al.  On eigenstructure-based direct multichannel blind image restoration , 2001, IEEE Trans. Image Process..

[4]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[5]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[6]  Jan Flusser,et al.  Resolution enhancement via probabilistic deconvolution of multiple degraded images , 2006, Pattern Recognit. Lett..

[7]  Yoram Bresler,et al.  Perfect blind restoration of images blurred by multiple filters: theory and efficient algorithms , 1999, IEEE Trans. Image Process..

[8]  Subhasis Chaudhuri,et al.  An MRF Model-Based Approach to Simultaneous Recovery of Depth and Restoration from Defocused Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[10]  Mostafa Kaveh,et al.  Blind image restoration by anisotropic regularization , 1999, IEEE Trans. Image Process..

[11]  Nikolas P. Galatsanos,et al.  EM-based simultaneous registration, restoration, and interpolation of super-resolved images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  Ali Mohammad-Djafari,et al.  Super-Resolution Using Hidden Markov Model and Bayesian Detection Estimation Framework , 2006, EURASIP J. Adv. Signal Process..

[13]  Deepu Rajan,et al.  Simultaneous Estimation of Super-Resolved Scene and Depth Map from Low Resolution Defocused Observations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[15]  Aggelos K. Katsaggelos,et al.  Bayesian resolution enhancement of compressed video , 2004, IEEE Transactions on Image Processing.

[16]  Patrizio Campisi,et al.  Multichannel blind image deconvolution using the Bussgang algorithm: spatial and multiresolution approaches , 2003, IEEE Trans. Image Process..

[17]  D. Tschumperlé PDE's based regularization of multivalued images and applications , 2002 .

[18]  Aggelos K. Katsaggelos,et al.  Parameter estimation in Bayesian high-resolution image reconstruction with multisensors , 2003, IEEE Trans. Image Process..

[19]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[20]  Jan Flusser,et al.  Multichannel blind deconvolution of spatially misaligned images , 2005, IEEE Transactions on Image Processing.

[21]  Yuanxu Chen,et al.  A general approach to blind image super-resolution using a PDE framework , 2005, Visual Communications and Image Processing.

[22]  J. Nagy,et al.  Numerical methods for coupled super-resolution , 2006 .

[23]  Timothy J. Holmes,et al.  Subpixel deconvolution of 3D optical microscope imagery , 2004, SPIE Optics + Photonics.

[24]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[25]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[26]  C. Q. Lee,et al.  The Computer Journal , 1958, Nature.

[27]  Harry Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Nikolas P. Galatsanos,et al.  Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images , 2006, IEEE Transactions on Image Processing.

[29]  Henri Maitre,et al.  Multi-channel high resolution blind image restoration , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[30]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[31]  Jeremy R. Cooperstock,et al.  Fast Super-Resolution for Rational Magnification Factors , 2007, 2007 IEEE International Conference on Image Processing.

[32]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jan Flusser,et al.  Multiframe blind deconvolution coupled with frame registration and resolution enhancement , 2007 .

[34]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..