An Incremental GEM Framework for Multiframe Blind Deconvolution, Super-Resolution, and Saturation Correction

We develop an incremental generalized expectation maximization (GEM) framework to model the multiframe blind deconvolution problem. A simplistic version of this problem was recently studied by Harmeling et al. [4]. We solve a more realistic version of this problem which includes the following major features: (i) super-resolution ability despite noise and unknown blurring; (ii) saturationcorrection, i.e., handling of overexposed pixels that can otherwise confound the image processing; and (iii) simultaneous handling of color channels. These features are seamlessly integrated into our incremental GEM framework to yield simple but efficient multiframe blind deconvolution algorithms. We present technical details concerning critical steps of our algorithms, especially to highlight how all operations can be written using matrix-vector multiplications. We apply our algorithm to real-world images from astronomy and super resolution tasks. Our experimental results show that our methods yield improved resolution and deconvolution at the same time.

[1]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[2]  Jian-Feng Cai,et al.  Blind motion deblurring using multiple images , 2009, J. Comput. Phys..

[3]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[4]  Shmuel Peleg,et al.  Two motion-blurred images are better than one , 2005, Pattern Recognit. Lett..

[5]  W. Wamsteker,et al.  Use of the single-image approach in multiple-image deblurring problems with Poissonian noise , 2005 .

[6]  Suvrit Sra,et al.  Online blind deconvolution for astronomical imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[7]  W. Wamsteker,et al.  A simple but efficient algorithm for multiple-image deblurring , 2004 .

[8]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[9]  Timothy J. Schulz,et al.  Multiframe blind deconvolution of astronomical images , 1993 .

[10]  Marcel Carbillet,et al.  Restoration of interferometric images. III. Efficient Richardson-Lucy methods for LINC-NIRVANA data reduction , 2005 .

[11]  Jan Flusser,et al.  A Unified Approach to Superresolution and Multichannel Blind Deconvolution , 2007, IEEE Transactions on Image Processing.

[12]  G. Cristóbal,et al.  Simultaneous super-resolution and blind deconvolution , 2008 .

[13]  Ngai-Fong Law,et al.  Multiple frame projection based blind deconvolution , 1995 .