Design and Estimation of Coded Exposure Point Spread Functions

We address the problem of motion deblurring using coded exposure. This approach allows for accurate estimation of a sharp latent image via well-posed deconvolution and avoids lost image content that cannot be recovered from images acquired with a traditional shutter. Previous work in this area has used either manual user input or alpha matting approaches to estimate the coded exposure Point Spread Function (PSF) from the captured image. In order to automate deblurring and to avoid the limitations of matting approaches, we propose a Fourier-domain statistical approach to coded exposure PSF estimation that allows us to estimate the latent image in cases of constant velocity, constant acceleration, and harmonic motion. We further demonstrate that previously used criteria to choose a coded exposure PSF do not produce one with optimal reconstruction error, and that an additional 30 percent reduction in Root Mean Squared Error (RMSE) of the latent image estimate can be achieved by incorporating natural image statistics.

[1]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[2]  Wei Xu,et al.  2D Barcode localization and motion deblurring using a flutter shutter camera , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[3]  Aggelos K. Katsaggelos,et al.  Tracking Motion-Blurred Targets in Video , 2006, 2006 International Conference on Image Processing.

[4]  M. Kasper graphics , 1991, Illustrating Mathematics.

[5]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Hui Ji,et al.  Motion blur identification from image gradients , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH '06.

[8]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[9]  Wing Au,et al.  Iris capture from moving subjects using a fluttering shutter , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[10]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[11]  Ankit Gupta,et al.  Single Image Deblurring Using Motion Density Functions , 2010, ECCV.

[12]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[13]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[14]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[16]  Richard Szeliski,et al.  Image deblurring and denoising using color priors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[18]  Shree K. Nayar,et al.  Ieee Transactions on Image Processing Computational Cameras: Convergence of Optics and Processing , 2022 .

[19]  Amit K. Agrawal,et al.  Coded exposure deblurring: Optimized codes for PSF estimation and invertibility , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[21]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[22]  Stefano Soatto,et al.  A geometric approach to shape from defocus , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  José M. Bioucas-Dias,et al.  Blind Estimation of Motion Blur Parameters for Image Deconvolution , 2007, IbPRIA.

[24]  Wei Xiong,et al.  Rotational Motion Deblurring of a Rigid Object from a Single Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Mansour Jamzad,et al.  Motion blur identification in noisy images using mathematical models and statistical measures , 2007, Pattern Recognit..

[26]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[27]  Ying Wu,et al.  Motion from blur , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .