A Unified Approach to Superresolution and Multichannel Blind Deconvolution

This paper presents a new approach to the blind deconvolution and superresolution problem of multiple degraded low-resolution frames of the original scene. We do not assume any prior information about the shape of degradation blurs. The proposed approach consists of building a regularized energy function and minimizing it with respect to the original image and blurs, where regularization is carried out in both the image and blur domains. The image regularization based on variational principles maintains stable performance under severe noise corruption. The blur regularization guarantees consistency of the solution by exploiting differences among the acquired low-resolution images. Several experiments on synthetic and real data illustrate the robustness and utilization of the proposed technique in real applications.

[1]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[2]  Harry Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michal Haindl,et al.  Recursive model-based image restoration , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[5]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[6]  Nikolas P. Galatsanos,et al.  Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images , 2006, IEEE Transactions on Image Processing.

[7]  Jan Flusser,et al.  Resolution enhancement via probabilistic deconvolution of multiple degraded images , 2006, Pattern Recognit. Lett..

[8]  Nikolas P. Galatsanos,et al.  EM-based simultaneous registration, restoration, and interpolation of super-resolved images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Henri Maitre,et al.  Multi-channel high resolution blind image restoration , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[10]  Hung-Ta Pai,et al.  On eigenstructure-based direct multichannel blind image restoration , 2001, IEEE Trans. Image Process..

[11]  Andrew E. Yagle Blind superresolution from undersampled blurred measurements , 2003, SPIE Optics + Photonics.

[12]  Peyman Milanfar,et al.  Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement , 2001, IEEE Trans. Image Process..

[13]  Mostafa Kaveh,et al.  Blind image restoration by anisotropic regularization , 1999, IEEE Trans. Image Process..

[14]  Rachid Deriche,et al.  Diffusion PDEs on vector-valued images , 2002, IEEE Signal Process. Mag..

[15]  Aggelos K. Katsaggelos,et al.  Parameter estimation in Bayesian high-resolution image reconstruction with multisensors , 2003, IEEE Trans. Image Process..

[16]  Yoram Bresler,et al.  Perfect blind restoration of images blurred by multiple filters: theory and efficient algorithms , 1999, IEEE Trans. Image Process..

[17]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[18]  Subhasis Chaudhuri,et al.  An MRF Model-Based Approach to Simultaneous Recovery of Depth and Restoration from Defocused Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[20]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[21]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[22]  Reginald L. Lagendijk,et al.  Identification and restoration of noisy blurred images using the expectation-maximization algorithm , 1990, IEEE Trans. Acoust. Speech Signal Process..

[23]  Deepu Rajan,et al.  Simultaneous Estimation of Super-Resolved Scene and Depth Map from Low Resolution Defocused Observations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jan Flusser,et al.  Multichannel blind deconvolution of spatially misaligned images , 2005, IEEE Transactions on Image Processing.

[25]  Yuanxu Chen,et al.  A general approach to blind image super-resolution using a PDE framework , 2005, Visual Communications and Image Processing.

[26]  Deepa Kundur,et al.  Blind image deconvolution revisited , 1996 .

[27]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[28]  Russell M. Mersereau,et al.  Blur identification by the method of generalized cross-validation , 1992, IEEE Trans. Image Process..

[29]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[30]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[31]  Timothy J. Holmes,et al.  Subpixel deconvolution of 3D optical microscope imagery , 2004, SPIE Optics + Photonics.

[32]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[33]  Aggelos K. Katsaggelos,et al.  Bayesian resolution enhancement of compressed video , 2004, IEEE Transactions on Image Processing.

[34]  Patrizio Campisi,et al.  Multichannel blind image deconvolution using the Bussgang algorithm: spatial and multiresolution approaches , 2003, IEEE Trans. Image Process..

[35]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.