Focal-sweep for large aperture time-of-flight cameras

Time-of-flight (ToF) imaging is an active method that utilizes a temporally modulated light source and a correlation-based (or lock-in) imager that computes the round-trip travel time from source to scene and back. Much like conventional imaging ToF cameras suffer from the trade-off between depth of field (DOF) and light throughput-larger apertures allow for more light collection but results in lower DoF. This trade-off is especially crucial in ToF systems since they require active illumination and have limited power, which limits performance in long-range imaging or imaging in strong ambient illumination (such as outdoors). Motivated by recent work in extended depth of field imaging for photography, we propose a focal sweep-based image acquisition methodology to increase depth-of-field and eliminate defocus blur. Our approach allows for a simple inversion algorithm to recover all-in-focus images. We validate our technique through simulation and experimental results. We demonstrate a proof-of-concept focal sweep time-of-flight acquisition system and show results for a real scene.

[1]  Ramesh Raskar,et al.  Coded time of flight cameras , 2013, ACM Trans. Graph..

[2]  Matthew O'Toole,et al.  Defocus deblurring and superresolution for time-of-flight depth cameras , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Oliver Cossairt,et al.  Spectral Focal Sweep: Extended depth of field from chromatic aberrations , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[4]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[5]  Shree K. Nayar,et al.  Focal Sweep Camera for Space-Time Refocusing , 2012 .

[6]  G. Häusler,et al.  A method to increase the depth of focus by two step image processing , 1972 .

[7]  Heinz Hügli,et al.  Real-time scattering compensation for time-of-flight camera , 2007, ICVS 2007.

[8]  Christian Riess,et al.  A Comparative Error Analysis of Current Time-of-Flight Sensors , 2016, IEEE Transactions on Computational Imaging.

[9]  Michael J. Cree,et al.  Extending AMCW Lidar Depth-of-Field Using a Coded Aperture , 2010, ACCV.

[10]  Filiberto Chiabrando,et al.  SR-4000 TOF camera: further experimental tests and first applications to metric survey , 2010 .

[11]  Shree K. Nayar,et al.  Transactions on Pattern Analysis and Machine Intelligence Flexible Depth of Field Photography 1 Depth of Field , 2022 .

[12]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.