Modeling and Analysis of a Direct Time-of-Flight Sensor Architecture for LiDAR Applications †

Direct time-of-flight (DTOF) is a prominent depth sensing method in light detection and ranging (LiDAR) applications. Single-photon avalanche diode (SPAD) arrays integrated in DTOF sensors have demonstrated excellent ranging and 3D imaging capabilities, making them promising candidates for LiDARs. However, high background noise due to solar exposure limits their performance and degrades the signal-to-background noise ratio (SBR). Noise-filtering techniques based on coincidence detection and time-gating have been implemented to mitigate this challenge but 3D imaging of a wide dynamic range scene is an ongoing issue. In this paper, we propose a coincidence-based DTOF sensor architecture to address the aforementioned challenges. The architecture is analyzed using a probabilistic model and simulation. A flash LiDAR setup is simulated with typical operating conditions of a wide angle field-of-view (FOV = 40°) in a 50 klux ambient light assumption. Single-point ranging simulations are obtained for distances up to 150 m using the DTOF model. An activity-dependent coincidence is proposed as a way to improve imaging of wide dynamic range targets. An example scene with targets ranging between 8–60% reflectivity is used to simulate the proposed method. The model predicts that a single threshold cannot yield an accurate reconstruction and a higher (lower) reflective target requires a higher (lower) coincidence threshold. Further, a pixel-clustering scheme is introduced, capable of providing multiple simultaneous timing information as a means to enhance throughput and reduce timing uncertainty. Example scenes are reconstructed to distinguish up to 4 distinct target peaks simulated with a resolution of 500 ps. Alternatively, a time-gating mode is simulated where in the DTOF sensor performs target-selective ranging. Simulation results show reconstruction of a 10% reflective target at 20 m in the presence of a retro-reflective equivalent with a 60% reflectivity at 5 m within the same FOV.

[1]  Matteo Perenzoni,et al.  A 32×32-pixel time-resolved single-photon image sensor with 44.64μm pitch and 19.48% fill-factor with on-chip row/frame skipping features reaching 800kHz observation rate for quantum physics applications , 2018, 2018 IEEE International Solid - State Circuits Conference - (ISSCC).

[2]  Maik Beer,et al.  Background Light Rejection in SPAD-Based LiDAR Sensors by Adaptive Photon Coincidence Detection , 2018, Sensors.

[3]  B. Vojnovic Advanced Time‐Correlated Single Photon Counting Techniques , 2006 .

[4]  Shoji Kawahito,et al.  A Sub-100 $\mu$ m-Range-Resolution Time-of-Flight Range Image Sensor With Three-Tap Lock-In Pixels, Non-Overlapping Gate Clock, and Reference Plane Sampling , 2019, IEEE Journal of Solid-State Circuits.

[5]  K. Tan,et al.  Surface reflectance retrieval from the intensity data of a terrestrial laser scanner. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Matthew O'Toole,et al.  Primal-dual coding to probe light transport , 2012, ACM Trans. Graph..

[7]  Shoji Kawahito,et al.  A Distance Measurement Method Using A Time-of-Flight CMOS Range Image Sensor with 4-Tap Output Pixels and Multiple Time-Windows , 2018, IMSE.

[8]  Fabio Remondino,et al.  TOF Range-Imaging Cameras , 2013 .

[9]  E. Charbon,et al.  Single-photon synchronous detection , 2008, ESSCIRC 2008 - 34th European Solid-State Circuits Conference.

[10]  Edoardo Charbon,et al.  A 160×128 single-photon image sensor with on-pixel 55ps 10b time-to-digital converter , 2011, 2011 IEEE International Solid-State Circuits Conference.

[11]  Edoardo Charbon,et al.  A 256×256 45/65nm 3D-stacked SPAD-based direct TOF image sensor for LiDAR applications with optical polar modulation for up to 18.6dB interference suppression , 2018, 2018 IEEE International Solid - State Circuits Conference - (ISSCC).

[12]  Edoardo Charbon,et al.  Mutually Coupled Time-to-Digital Converters (TDCs) for Direct Time-of-Flight (dTOF) Image Sensors ‡ , 2018, Sensors.

[13]  Martin Wolf,et al.  A 30-frames/s, $252\times144$ SPAD Flash LiDAR With 1728 Dual-Clock 48.8-ps TDCs, and Pixel-Wise Integrated Histogramming , 2019, IEEE Journal of Solid-State Circuits.

[14]  Vivek K. Goyal,et al.  A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging , 2016, IEEE Transactions on Computational Imaging.

[15]  W. Brockherde,et al.  100 000 Frames/s 64 × 32 Single-Photon Detector Array for 2-D Imaging and 3-D Ranging , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[16]  Ramesh Raskar,et al.  Towards photography through realistic fog , 2018, 2018 IEEE International Conference on Computational Photography (ICCP).

[17]  Lee,et al.  A new G-M counter dead time model , 2000, Applied radiation and isotopes : including data, instrumentation and methods for use in agriculture, industry and medicine.

[18]  Robert K. Henderson,et al.  5.7 A 256×256 40nm/90nm CMOS 3D-Stacked 120dB Dynamic-Range Reconfigurable Time-Resolved SPAD Imager , 2019, 2019 IEEE International Solid- State Circuits Conference - (ISSCC).

[19]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Davide Portaluppi,et al.  32 × 32 CMOS SPAD Imager for Gated Imaging, Photon Timing, and Photon Coincidence , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[21]  C. E. Harris,et al.  Laser Radar Systems , 1991 .

[22]  Iskender Agi,et al.  IMpixel 65nm BSI 320MHz demodulated TOF Image sensor with 3μm global shutter pixels and analog binning , 2018, 2018 IEEE International Solid - State Circuits Conference - (ISSCC).

[23]  Andrew J. Holmes,et al.  11.5 A time-correlated single-photon-counting sensor with 14GS/S histogramming time-to-digital converter , 2015, 2015 IEEE International Solid-State Circuits Conference - (ISSCC) Digest of Technical Papers.

[24]  Matteo Perenzoni,et al.  A 64 $\times$ 64-Pixels Digital Silicon Photomultiplier Direct TOF Sensor With 100-MPhotons/s/pixel Background Rejection and Imaging/Altimeter Mode With 0.14% Precision Up To 6 km for Spacecraft Navigation and Landing , 2017, IEEE Journal of Solid-State Circuits.

[25]  Karin Schwab,et al.  Introduction To Radiometry And Photometry , 2016 .

[26]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[27]  Nicky Guenther,et al.  When the Dust Settles: The Four Behaviors of LiDAR in the Presence of Fine Airborne Particulates , 2017, J. Field Robotics.