Photon-Flooded Single-Photon 3D Cameras

Single-photon avalanche diodes (SPADs) are starting to play a pivotal role in the development of photon-efficient, long-range LiDAR systems. However, due to non-linearities in their image formation model, a high photon flux (e.g., due to strong sunlight) leads to distortion of the incident temporal waveform, and potentially, large depth errors. Operating SPADs in low flux regimes can mitigate these distortions, but, often requires attenuating the signal and thus, results in low signal-to-noise ratio. In this paper, we address the following basic question: what is the optimal photon flux that a SPAD-based LiDAR should be operated in? We derive a closed form expression for the optimal flux, which is quasi-depth-invariant, and depends on the ambient light strength. The optimal flux is lower than what a SPAD typically measures in real world scenarios, but surprisingly, considerably higher than what is conventionally suggested for avoiding distortions. We propose a simple, adaptive approach for achieving the optimal flux by attenuating incident flux based on an estimate of ambient light strength. Using extensive simulations and a hardware prototype, we show that the optimal flux criterion holds for several depth estimators, under a wide range of illumination conditions.

[1]  P. B. Coates,et al.  The correction for photon `pile-up' in the measurement of radiative lifetimes , 1968 .

[2]  E. Charbon,et al.  A Single-Photon Avalanche Diode Array for Fluorescence Lifetime Imaging Microscopy , 2008, IEEE Journal of Solid-State Circuits.

[3]  Gordon Wetzstein,et al.  Single-photon 3D imaging with deep sensor fusion , 2018, ACM Trans. Graph..

[4]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[5]  B. Selinger,et al.  Single photon decay spectroscopy. , 1973 .

[6]  E. Charbon,et al.  SPAD-based Sensors , 2013 .

[7]  Wenze Xia,et al.  Adaptive aperture for Geiger mode avalanche photodiode flash ladar systems. , 2018, The Review of scientific instruments.

[8]  Shree K. Nayar,et al.  Structured Light in Sunlight , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Vivek K. Goyal,et al.  Photon-Efficient Computational 3-D and Reflectivity Imaging With Single-Photon Detectors , 2014, IEEE Transactions on Computational Imaging.

[10]  R. Mcintyre,et al.  Photon counting techniques with silicon avalanche photodiodes. , 1993, Applied optics.

[11]  C. Harris,et al.  Single-Photon Decay Spectroscopy. II. The Pile-up Problem , 1979 .

[12]  D. G. Fouche,et al.  Detection and false-alarm probabilities for laser radars that use Geiger-mode detectors. , 2003, Applied optics.

[13]  Vivek K Goyal,et al.  First-Photon Imaging , 2014, Science.

[14]  Andrew D. MacGregor,et al.  Photon-counting techniques with silicon avalanche photodiodes , 1993, Photonics West - Lasers and Applications in Science and Engineering.

[15]  Vivek K. Goyal,et al.  Dead Time Compensation for High-Flux Ranging , 2018, IEEE Transactions on Signal Processing.

[16]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[17]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Alberto Tosi,et al.  Time-gated single-photon detection module with 110 ps transition time and up to 80 MHz repetition rate. , 2014, The Review of scientific instruments.

[19]  Gordon Wetzstein,et al.  Sub-picosecond photon-efficient 3D imaging using single-photon sensors , 2018, Scientific Reports.

[20]  Gordon Wetzstein,et al.  Reconstructing Transient Images from Single-Photon Sensors , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Alberto Diaspro,et al.  Advanced Photon Counting: Applications, Methods, Instrumentation , 2015 .

[22]  D. Renker Geiger-mode avalanche photodiodes, history, properties and problems , 2006 .

[23]  Matthew O'Toole,et al.  Homogeneous codes for energy-efficient illumination and imaging , 2015, ACM Trans. Graph..

[24]  Marcus Sackrow,et al.  Fluorescence decay data analysis correcting for detector pulse pile-up at very high count rates , 2017, 1711.01137.

[25]  Matteo Perenzoni,et al.  A 64 $\times$ 64-Pixels Digital Silicon Photomultiplier Direct TOF Sensor With 100-MPhotons/s/pixel Background Rejection and Imaging/Altimeter Mode With 0.14% Precision Up To 6 km for Spacecraft Navigation and Landing , 2017, IEEE Journal of Solid-State Circuits.

[26]  Gordon Wetzstein,et al.  Confocal non-line-of-sight imaging based on the light-cone transform , 2018, Nature.

[27]  John G. Walker,et al.  Iterative correction for 'pile-up' in single-photon lifetime measurement , 2002 .

[28]  K. Eliceiri,et al.  Non-line-of-sight imaging using a time-gated single photon avalanche diode. , 2015, Optics express.

[29]  Simon Christoph Stein,et al.  Dead-time correction of fluorescence lifetime measurements and fluorescence lifetime imaging. , 2016, Optics express.

[30]  Bedrich J. Hosticka,et al.  SPAD-based flash LiDAR sensor with high ambient light rejection for automotive applications , 2018, OPTO.

[31]  Srinivasa G. Narasimhan,et al.  A low-power structured light sensor for outdoor scene reconstruction and dominant material identification , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[32]  D. O'connor,et al.  Time-Correlated Single Photon Counting , 1984 .

[33]  LiDAR drives forwards , 2018, Nature Photonics.

[34]  W. Becker Advanced Time-Correlated Single Photon Counting Applications , 2015 .

[35]  William Whittaker,et al.  Epipolar time-of-flight imaging , 2017, ACM Trans. Graph..

[36]  John J. Degnan Impact of Receiver Deadtime on Photon-Counting SLR and Altimetry during Daylight Operations , 2008 .

[37]  Aswin C. Sankaranarayanan,et al.  Signal Processing Based Pile-up Compensation for Gated Single-Photon Avalanche Diodes , 2018, 1806.07437.

[38]  Vivek K. Goyal,et al.  A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging , 2016, IEEE Transactions on Computational Imaging.