Models of Direct Time-of-Flight Sensor Precision That Enable Optimal Design and Dynamic Configuration

Direct time-of-flight (dToF) sensors that measure depth by pulsing a laser and timing the photon return are used in many applications, including consumer electronics for proximity sensing and depth map generation. A histogram of photon return times is measured and then processed to estimate object depth. By collecting many photons that span multiple bins of the histogram the final depth estimate interpolates between time-to-digital converter (TDC) bins to produce a result that is more precise than the converter resolution. The precision of this interpolation depends on the temporal spread of the measurement, the resolution of the TDC, and the number of signal and background photons measured. There is a need for dToF depth precision models to guide design and predict and tune performance during use. In this article, we present models that estimate sensor depth precision versus dToF design parameters and photons measured. We use Monte Carlo simulations and experimental measurements to prove the accuracy of the models. With proven models in hand, we investigate a dToF sensor design by first presenting the dependence of precision upon the TDC resolution and the signal-to-noise ratio. Second, we experimentally measure the depth precision versus the intensity of background illumination. The models closely match the measurements of background susceptibility and locate a transition point of background intensity below which precision is constant and above which the precision continuously degrades. Finally, experimental measurements demonstrate how the modeling enables dynamic tuning: from a single histogram we estimate precision, thus enabling sensor exposure time tuning for a target precision or prediction of the precision given a change in object distance or background illumination. This work presents straightforward models verified by simulation and measurement. These models guide dToF design and enable dynamic adjustments that benefit power-constrained usage scenarios.

[1]  A. Small,et al.  Fluorophore localization algorithms for super-resolution microscopy , 2014, Nature Methods.

[2]  J. Valentine,et al.  Centroid and full-width at half maximum uncertainties of histogrammed data with an underlying Gaussian distribution-the moments method , 1996 .

[3]  W. Webb,et al.  Precise nanometer localization analysis for individual fluorescent probes. , 2002, Biophysical journal.

[4]  Martin Wolf,et al.  A 30-frames/s, $252\times144$ SPAD Flash LiDAR With 1728 Dual-Clock 48.8-ps TDCs, and Pixel-Wise Integrated Histogramming , 2019, IEEE Journal of Solid-State Circuits.

[5]  Dong Li,et al.  An 8-ch LIDAR Receiver Based on TDC With Multi-Interval Detection and Real-Time $In~Situ$ Calibration , 2020, IEEE Transactions on Instrumentation and Measurement.

[6]  Alberto Tosi,et al.  Low-noise and large-area CMOS SPADs with timing response free from slow tails , 2012, 2012 Proceedings of the European Solid-State Device Research Conference (ESSDERC).

[7]  Rainer Kokozinski,et al.  Data Processing Approaches on SPAD-Based d-TOF LiDAR Systems: A Review , 2021, IEEE Sensors Journal.

[8]  Edoardo Charbon,et al.  Modeling and Analysis of a Direct Time-of-Flight Sensor Architecture for LiDAR Applications † , 2019, Sensors.

[9]  Juha Kostamovaara,et al.  A 32 × 128 SPAD-257 TDC Receiver IC for Pulsed TOF Solid-State 3-D Imaging , 2020, IEEE Journal of Solid-State Circuits.

[10]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[11]  N. Bobroff Position measurement with a resolution and noise‐limited instrument , 1986 .

[12]  Pengcheng Li,et al.  A Depth-Adaptive Waveform Decomposition Method for Airborne LiDAR Bathymetry , 2019, Sensors.

[13]  Matteo Perenzoni,et al.  A 64 $\times$ 64-Pixels Digital Silicon Photomultiplier Direct TOF Sensor With 100-MPhotons/s/pixel Background Rejection and Imaging/Altimeter Mode With 0.14% Precision Up To 6 km for Spacecraft Navigation and Landing , 2017, IEEE Journal of Solid-State Circuits.

[14]  Andrew M. Wallace,et al.  Bayesian Analysis of Lidar Signals with Multiple Returns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  E. Charbon,et al.  High fill-factor miniaturized SPAD arrays with a guard-ring-sharing technique. , 2020, Optics express.

[16]  Edoardo Charbon,et al.  High-Performance Back-Illuminated Three-Dimensional Stacked Single-Photon Avalanche Diode Implemented in 45-nm CMOS Technology , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[17]  Robert Henderson,et al.  Time of Flight Imaging and Sensing for Mobile Applications , 2019 .

[18]  Yaron M Sigal,et al.  A high-density 3D localization algorithm for stochastic optical reconstruction microscopy , 2012, Optical Nanoscopy.

[19]  Mohit Gupta,et al.  Asynchronous Single-Photon 3D Imaging , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[20]  Adam S. Green,et al.  Characterization of a Miniaturized IR Depth Sensor With a Programmable Region-of-Interest That Enables Hazard Mapping Applications , 2020, IEEE Sensors Journal.

[21]  Edoardo Charbon,et al.  Megapixel time-gated SPAD image sensor for 2D and 3D imaging applications , 2019, Optica.

[22]  Lucas J. Koerner,et al.  Instrbuilder: A Python package for electrical instrument control , 2019, J. Open Source Softw..

[23]  J Alexander Liddle,et al.  Fast, bias-free algorithm for tracking single particles with variable size and shape. , 2008, Optics express.

[24]  Zabih Ghassemlooy,et al.  The effect of fog on the probability density distribution of the ranging data of imaging laser radar , 2018, AIP Advances.

[25]  A. Cramer-Rao lower bounds on the performance of charge-coupled-device optical position estimators , 1985 .

[26]  Adam S. Backer,et al.  Optimal point spread function design for 3D imaging. , 2014, Physical review letters.

[27]  Juha Kostamovaara,et al.  Characterization of the Timing Homogeneity in a CMOS SPAD Array Designed for Time-Gated Raman Spectroscopy , 2017, IEEE Transactions on Instrumentation and Measurement.

[28]  Maik Beer,et al.  Background Light Rejection in SPAD-Based LiDAR Sensors by Adaptive Photon Coincidence Detection , 2018, Sensors.

[29]  Andrew M. Wallace,et al.  Full Waveform Analysis for Long-Range 3D Imaging Laser Radar , 2010, EURASIP J. Adv. Signal Process..

[30]  E. W. Dennison,et al.  Ultra-Precise Star Tracking Using Charge Coupled Devices (CCDs) , 1980, Optics & Photonics.

[31]  Andrew M. Wallace,et al.  Detecting and characterising returns in a pulsed ladar system , 2006 .

[32]  Edoardo Charbon,et al.  A Modular, Direct Time-of-Flight Depth Sensor in 45/65-nm 3-D-Stacked CMOS Technology , 2019, IEEE Journal of Solid-State Circuits.

[33]  Rudi Lussana,et al.  Single-Photon Detectors Modeling and Selection Criteria for High-Background LiDAR , 2020, IEEE Sensors Journal.

[34]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[35]  Robert K. Henderson,et al.  5.7 A 256×256 40nm/90nm CMOS 3D-Stacked 120dB Dynamic-Range Reconfigurable Time-Resolved SPAD Imager , 2019, 2019 IEEE International Solid- State Circuits Conference - (ISSCC).