Light Field Blind Motion Deblurring

We study the problem of deblurring light fields of general 3D scenes captured under 3D camera motion and present both theoretical and practical contributions. By analyzing the motion-blurred light field in the primal and Fourier domains, we develop intuition into the effects of camera motion on the light field, show the advantages of capturing a 4D light field instead of a conventional 2D image for motion deblurring, and derive simple analytical methods of motion deblurring in certain cases. We then present an algorithm to blindly deblur light fields of general scenes without any estimation of scene geometry, and demonstrate that we can recover both the sharp light field and the 3D camera motion path of real and synthetically-blurred light fields.

[1]  Stefan B. Williams,et al.  Linear Volumetric Focus for Light Field Cameras , 2015, TOGS.

[2]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, ACM Trans. Graph..

[3]  Xiang Zhu,et al.  Deconvolving PSFs for a Better Motion Deblurring Using Multiple Images , 2012, ECCV.

[4]  Ramesh Raskar,et al.  Near-invariant blur for depth and 2D motion via time-varying light field analysis , 2013, TOGS.

[5]  Ravi Ramamoorthi,et al.  Oriented Light-Field Windows for Scene Flow , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[8]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[9]  Donald G. Dansereau,et al.  Richardson-Lucy Deblurring for Moving Light Field Cameras , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[11]  Abhishek Kumar Jha,et al.  Affine theorem for two-dimensional Fourier transform , 1993 .

[12]  Ravi Ramamoorthi,et al.  A Light Transport Framework for Lenslet Light Field Cameras , 2015, TOGS.

[13]  Tomoyuki Nishita,et al.  Motion Deblurring from a Single Image using Circular Sensor Motion , 2011, Comput. Graph. Forum.

[14]  Pat Hanrahan,et al.  Digital correction of lens aberrations in light field photography , 2006, International Optical Design Conference.

[15]  Ren Ng.  Fourier slice photography , 2005, ACM Trans. Graph..

[16]  Narendra Ahuja,et al.  A Comparative Study for Single Image Blind Deblurring , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Frédo Durand,et al.  Motion-invariant photography , 2008, ACM Trans. Graph..

[18]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[19]  Donald G. Dansereau,et al.  Motion Deblurring for Light Fields , 2016, ArXiv.

[20]  Ravi Ramamoorthi,et al.  A first-order analysis of lighting, shading, and shadows , 2007, TOGS.

[21]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH '06.

[23]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[24]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[25]  Ramesh Raskar,et al.  Glare aware photography: 4D ray sampling for reducing glare effects of camera lenses , 2008, ACM Trans. Graph..

[26]  T. S. Cho,et al.  Motion blur removal with orthogonal parabolic exposures , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[27]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[28]  Yanning Zhang,et al.  Multi-image Blind Deblurring Using a Coupled Adaptive Sparse Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[30]  Ming-Hsuan Yang,et al.  Deblurring Text Images via L0-Regularized Intensity and Gradient Prior , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Guillermo Sapiro,et al.  Burst deblurring: Removing camera shake through fourier burst accumulation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Paramanand Chandramouli,et al.  Bilayer Blind Deconvolution with the Light Field Camera , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[33]  Fumihiko Sakaue,et al.  Depth and Arbitrary Motion Deblurring Using Integrated PSF , 2014, ECCV Workshops.

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  Jitendra Malik,et al.  Depth from shading, defocus, and correspondence using light-field angular coherence , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).