Fast depth from defocus from focal stacks

We present a new depth from defocus method based on the assumption that a per pixel blur estimate (related with the circle of confusion), while ambiguous for a single image, behaves in a consistent way when applied over a focal stack of two or more images. This allows us to fit a simple analytical description of the circle of confusion to the different per pixel measures to obtain approximate depth values up to a scale. Our results are comparable to previous work while offering a faster and flexible pipeline.

[1]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[2]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[3]  Frédo Durand,et al.  Defocus Magnification , 2007, Comput. Graph. Forum.

[4]  William H. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[5]  Stefano Soatto,et al.  3-D Shape Estimation and Image Restoration , 2008 .

[6]  Qionghai Dai,et al.  Coded focal stack photography , 2013, IEEE International Conference on Computational Photography (ICCP).

[7]  Zengfu Wang,et al.  Digital Multi-Focusing From a Single Photograph Taken With an Uncalibrated Conventional Camera , 2013, IEEE Transactions on Image Processing.

[8]  C. Westin,et al.  Normalized and differential convolution , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yang Cao,et al.  Single Image Multi-focusing Based on Local Blur Estimation , 2011, 2011 Sixth International Conference on Image and Graphics.

[10]  Stefano Soatto,et al.  3-D Shape Estimation and Image Restoration - Exploiting Defocus and Motion Blur , 2006 .

[11]  Stefano Soatto,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE IEEE TRANSACTION OF PATTERN RECO , 2022 .

[12]  Aamir Saeed Malik.  Selection of window size for focus measure processing , 2010, 2010 IEEE International Conference on Imaging Systems and Techniques.

[13]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[14]  Tae-Sun Choi,et al.  Nonlinear Approach for Enhancement of Image Focus Volume in Shape From Focus , 2012, IEEE Transactions on Image Processing.

[15]  Shree K. Nayar,et al.  Rational Filters for Passive Depth from Defocus , 1998, International Journal of Computer Vision.

[16]  Stephen Lin,et al.  A Closed-Form Solution to Retinex with Nonlocal Texture Constraints , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[18]  Gerard de Haan,et al.  Adaptive Image Restoration Based on Local Robust Blur Estimation , 2007, ACIVS.

[19]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[20]  Shree K. Nayar,et al.  Depth from Diffusion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[22]  Paolo Favaro,et al.  Recovering thin structures via nonlocal-means regularization with application to depth from defocus , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Kiriakos N. Kutulakos,et al.  Confocal Stereo , 2006, International Journal of Computer Vision.

[24]  Terence Sim,et al.  On the Recovery of Depth from a Single Defocused Image , 2009, CAIP.

[25]  Vicent Caselles,et al.  Recovering Relative Depth from Low-Level Features Without Explicit T-junction Detection and Interpretation , 2013, International Journal of Computer Vision.

[26]  Muralidhara Subbarao,et al.  Accurate Recovery of Three-Dimensional Shape from Image Focus , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Marcus A. Magnor,et al.  Eurographics Symposium on Rendering 2011 Guided Image Filtering for Interactive High-quality Global Illumination , 2022 .

[29]  Kun Zhou,et al.  Bayesian Depth-from-Defocus with Shading Constraints , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Tae-Sun Choi,et al.  Improving focus measurement via variable window shape on surface radiance distribution for 3D shape reconstruction , 2013 .

[31]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[32]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[33]  Tae-Sun Choi,et al.  A fast and robust depth estimation method for 3D cameras , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[34]  Francesc Moreno-Noguer,et al.  Active refocusing of images and videos , 2007, ACM Trans. Graph..

[35]  Subhasis Chaudhuri,et al.  Recovery of relative depth from a single observation using an uncalibrated (real-aperture) camera , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Kun Zhou,et al.  Bayesian Depth-from-Defocus with Shading Constraints , 2013, CVPR.

[37]  Natasha Gelfand,et al.  Generalized autofocus , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[38]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.