Depth from Defocus and Coded Apertures for 3D Scene Sensing

Depth from defocus (DfD) is one of the popular passive depth sensing approaches in computer vision. Usually, it utilizes the defocus blur depth cue encoded in images, captured by a single photographic camera. Since the defocus blur is characterized by the aperture shape of the camera, it can actually be structured by inserting a coded mask in the camera aperture position. Therefore, by employing optimized masks in such coded aperture cameras, it is possible to improve the performance of DfD approaches. DfD and coded aperture approaches constitute the main theme of this chapter. Noting, however, that the stereopsis cue is actually the most widely utilized depth cue in computer vision, joint utilization of the defocus blur cue, and the stereopsis cue is another interesting topic, which is therefore also included in the discussion.

[1]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[2]  Jürgen Beyerer,et al.  A New Approach for Estimating Depth by Fusing Stereo and Defocus Information , 2007, GI Jahrestagung.

[3]  Diego Gutierrez,et al.  Perceptually Optimized Coded Apertures for Defocus Deblurring , 2012, Comput. Graph. Forum.

[4]  Yoav Y. Schechner,et al.  Depth from Defocus vs. Stereo: How Different Really Are They? , 2004, International Journal of Computer Vision.

[5]  Peter Thompson,et al.  Comprar Basic Vision. An Introduction To Visual Perception | Robert Snowden | 9780199572021 | Oxford University Press , 2012 .

[6]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  S. Nayar,et al.  What are good apertures for defocus deblurring? , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[8]  Stephen Lin,et al.  Coded aperture pairs for depth from defocus , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  W. Cathey,et al.  Extended depth of field through wave-front coding. , 1995, Applied optics.

[10]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[11]  Ashutosh Saxena,et al.  Depth Estimation Using Monocular and Stereo Cues , 2007, IJCAI.

[12]  Narendra Ahuja,et al.  A Pupil-Centric Model of Image Formation , 2002, International Journal of Computer Vision.

[13]  W T Cathey,et al.  Single-lens single-image incoherent passive-ranging systems. , 1994, Applied optics.

[14]  Johannes Burge,et al.  Optimal defocus estimation in individual natural images , 2011, Proceedings of the National Academy of Sciences.

[15]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[16]  Shree K. Nayar,et al.  Programmable Aperture Camera Using LCoS , 2010, IPSJ Trans. Comput. Vis. Appl..

[17]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Kosuke Sato,et al.  Coded Aperture Stereo - For Extension of Depth of Field and Refocusing , 2012, VISAPP.

[19]  Qionghai Dai,et al.  Absolute Depth Estimation From a Single Defocused Image , 2013, IEEE Transactions on Image Processing.

[20]  Chun Wang.  Design and analysis of coded aperture for 3D scene sensing , 2015 .

[21]  Anita Sellent,et al.  Which side of the focal plane are you on? , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[22]  Kosuke Sato,et al.  Fusing Depth from Defocus and Stereo with Coded Apertures , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Stefano Soatto,et al.  A geometric approach to shape from defocus , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Anita Sellent,et al.  Optimized aperture shapes for depth estimation , 2014, Pattern Recognit. Lett..

[25]  Chun Wang,et al.  Depth estimation by combining stereo matching and coded aperture , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[26]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Paolo Favaro,et al.  Single Image Blind Deconvolution with Higher-Order Texture Statistics , 2010, Video Processing and Computational Video.

[28]  Takashi Matsuyama,et al.  Depth measurement by the multi-focus camera , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[29]  Subhasis Chaudhuri,et al.  Depth estimation and image restoration using defocused stereo pairs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Stephen Lin,et al.  Coded Aperture Pairs for Depth from Defocus and Defocus Deblurring , 2011, International Journal of Computer Vision.

[31]  Xiang Zhu,et al.  Estimating Spatially Varying Defocus Blur From A Single Image , 2013, IEEE Transactions on Image Processing.