Coded Aperture Stereo - For Extension of Depth of Field and Refocusing

Image acquisition techniques using coded apertures have been intensively investigated to improve the performance of image deblurring and depth estimation. Generally, estimation of the scene depth is a key issue in the recovery of optical blur because the size of the blur kernel varies according to the depth. However, since it is hard to estimate the depth of a scene with a single image, most successful methods use several images with different optical parameters captured by a specially developed camera with expensive internal optics. On the other hand, a stereo camera configuration is widely used to obtain the depth map of a scene. Therefore, in this paper, we propose a method for deblurring and depth estimation using a stereo camera with coded apertures. Our system configuration offers several advantages. First, coded apertures make not only deconvolution but also stereo matching very robust, because the loss of high spatial frequency domain information in the blurred image is well suppressed. Second, the size of the blur kernel is linear with the disparity of the stereo images, making calibration of the system very easy. The proof of this linearity is given in this paper together with several experimental results showing the advantages of our method.

[1]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[2]  Frédo Durand,et al.  Multi-aperture photography , 2007, ACM Trans. Graph..

[3]  S. Nayar,et al.  What are good apertures for defocus deblurring? , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[4]  Anat Levin,et al.  Analyzing Depth from Coded Aperture Sets , 2010, ECCV.

[5]  Shree K. Nayar,et al.  Real-time focus range sensor , 1995, Proceedings of IEEE International Conference on Computer Vision.

[6]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[7]  Yoav Y. Schechner,et al.  Depth from Defocus vs. Stereo: How Different Really Are They? , 2004, International Journal of Computer Vision.

[8]  Stephen Lin,et al.  Coded aperture pairs for depth from defocus , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Lam,et al.  Iterative statistical approach to blind image deconvolution , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[11]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[12]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[13]  Takashi Matsuyama,et al.  Depth measurement by the multi-focus camera , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).