Which side of the focal plane are you on?

Defocus blur is an indicator for the depth structure of a scene. However, given a single input image from a conventional camera one cannot distinguish between blurred objects lying in front or behind the focal plane, as they may be subject to exactly the same amount of blur. In this paper we address this limitation by exploiting coded apertures. Previous work in this area focuses on setups where the scene is placed either entirely in front or entirely behind the focal plane. We demonstrate that asymmetric apertures result in unique blurs for all distances from the camera. To exploit asymmetric apertures we propose an algorithm that can unambiguously estimate scene depth and texture from a single input image. One of the main advantages of our method is that, within the same depth range, we can work with less blurred data than in other methods. The technique is tested on both synthetic and real images.

[1]  S. Nayar,et al.  What are good apertures for defocus deblurring? , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[2]  Subhasis Chaudhuri,et al.  Recovery of relative depth from a single observation using an uncalibrated (real-aperture) camera , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Frédo Durand,et al.  Understanding Blind Deconvolution Algorithms , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tom E. Bishop,et al.  A Bayesian approach to shape from coded aperture , 2010, 2010 IEEE International Conference on Image Processing.

[5]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[6]  W. Cathey,et al.  Extended depth of field through wave-front coding. , 1995, Applied optics.

[7]  Sebastian Nowozin,et al.  Structured Learning and Prediction in Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[8]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[9]  A. Sellent,et al.  A Toolbox to Visualize Dense Image Correspondences ( Stereo Disparities & Optical Flow ) , 2012 .

[10]  Gwendoline Blanchet,et al.  An explicit sharpness index related to global phase coherence , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[13]  Yoav Y Schechner,et al.  Depth from diffracted rotation. , 2006, Optics letters.

[14]  Anita Sellent,et al.  Optimized aperture shapes for depth estimation , 2014, Pattern Recognit. Lett..

[15]  P. Favaro,et al.  Depth estimation from a video sequence with moving and deformable objects , 2012 .

[16]  Nahum Kiryati,et al.  Restoration of Images with Piecewise Space-Variant Blur , 2007, SSVM.

[17]  Qionghai Dai,et al.  Absolute Depth Estimation From a Single Defocused Image , 2013, IEEE Transactions on Image Processing.

[18]  H C Howland,et al.  Accommodation in the cuttlefish (Sepia officinalis). , 1999, The Journal of experimental biology.

[19]  W T Cathey,et al.  Single-lens single-image incoherent passive-ranging systems. , 1994, Applied optics.

[20]  Stephen Lin,et al.  Coded aperture pairs for depth from defocus , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[22]  Diego Gutierrez,et al.  Perceptually Optimized Coded Apertures for Defocus Deblurring , 2012, Comput. Graph. Forum.

[23]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[25]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[26]  Stefano Soatto,et al.  Scene and Motion Reconstruction from Defocused and Motion-Blurred Images via Anisotropic Diffusion , 2004, ECCV.

[27]  Masashi Nishiyama,et al.  Facial Deblur Inference Using Subspace Analysis for Recognition of Blurred Faces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Sebastian Nowozin,et al.  Structured Prediction and Learning in Computer Vision , 2011 .

[29]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Felipe Calderero,et al.  Evaluation of Sharpness Measures and Proposal of a Stop Criterion for Reverse Diffusion in the Context of Image Deblurring , 2013, VISAPP.

[31]  Paolo Favaro,et al.  Single Image Blind Deconvolution with Higher-Order Texture Statistics , 2010, Video Processing and Computational Video.

[32]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.