Computational single photon counting for non-line-of-sight, light in flight, and photon flux imaging

Photon counting signals are often complex and can have multiple signature of different of types. The origin of these signatures may be, for example, objects that are not in the line-of-sight, light pulses that are traveling through the scene, and uncorrelated ambient light. Using computational imaging approaches, we are able to distinguish different signatures and we can reconstruct their origin. Non-line-of-sight imaging use back projection approaches to estimate the shape of hidden reflecting surfaces. Further, light-in-flight sensing is capable to track the path of light pulse moving in air and to trace back the laser pulse to its origin. Finally, photon flux imaging with ambient light illumination uses the temporal information of uncorrelated light to estimate the photon flux.

[1]  Martin Laurenzis,et al.  Single photon range, intensity and photon flux imaging with kilohertz frame rate and high dynamic range. , 2019, Optics express.

[2]  Martin Laurenzis Non-line-of-sight sensing with time correlated single photon counting and ordinary cameras , 2019, Laser Congress 2019 (ASSL, LAC, LS&C).

[3]  Edoardo Charbon,et al.  Single-photon avalanche diode imagers in biophotonics: review and outlook , 2019, Light: Science & Applications.

[4]  Diego Gutierrez,et al.  Non-line-of-sight imaging using phasor-field virtual wave optics , 2018, Nature.

[5]  Gordon Wetzstein,et al.  Wave-based non-line-of-sight imaging using fast f-k migration , 2019, ACM Trans. Graph..

[6]  Martin Wolf,et al.  A 30-frames/s, $252\times144$ SPAD Flash LiDAR With 1728 Dual-Clock 48.8-ps TDCs, and Pixel-Wise Integrated Histogramming , 2019, IEEE Journal of Solid-State Circuits.

[7]  Andreas Velten,et al.  High Flux Passive Imaging With Single-Photon Sensors , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  W. Brockherde,et al.  SPAD-Based LiDAR Sensor in 0.35 µm Automotive CMOS with Variable Background Light Rejection , 2018, Proceedings.

[9]  Patrick Pittet,et al.  Integration of SPAD in 28nm FDSOI CMOS technology , 2018, 2018 48th European Solid-State Device Research Conference (ESSDERC).

[10]  Rory R. Duncan,et al.  A $256\times256$ , 100-kfps, 61% Fill-Factor SPAD Image Sensor for Time-Resolved Microscopy Applications , 2018, IEEE Transactions on Electron Devices.

[11]  S. Pellegrini,et al.  Industrialised SPAD in 40 nm technology , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[12]  Masaru Ogawa,et al.  SPAD DCNN: Localization with small imaging LIDAR and DCNN , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Martin Laurenzis,et al.  Transient light imaging laser radar with advanced sensing capabilities: reconstruction of arbitrary light in flight path and sensing around a corner , 2017, Defense + Security.

[14]  Martin Laurenzis,et al.  Sensing and reconstruction of arbitrary light-in-flight paths by a relativistic imaging approach , 2016, Security + Defence.

[15]  Martin Laurenzis,et al.  Relativistic effects in imaging of light in flight with arbitrary paths. , 2016, Optics letters.

[16]  S. Pellegrini,et al.  A SPAD-Based QVGA Image Sensor for Single-Photon Counting and Quanta Imaging , 2016, IEEE Transactions on Electron Devices.

[17]  Martin Laurenzis,et al.  Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave infrared wavelengths. , 2015, Optics letters.

[18]  Martin Laurenzis,et al.  Study of single photon counting for non-line-of-sight vision , 2015, Sensing Technologies + Applications.

[19]  R. Raskar,et al.  Single-photon sensitive light-in-fight imaging , 2015, Nature Communications.

[20]  Andreas Velten,et al.  Feature selection and back-projection algorithms for nonline-of-sight laser–gated viewing , 2014, J. Electronic Imaging.

[21]  Alberto Tosi,et al.  Low-Noise, Low-Jitter, High Detection Efficiency InGaAs/InP Single-Photon Avalanche Diode , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[22]  Martin Laurenzis,et al.  Nonline-of-sight laser gated viewing of scattered photons , 2014 .

[23]  Martin Laurenzis,et al.  Non-line-of-sight active imaging of scattered photons , 2013, Optics/Photonics in Security and Defence.

[24]  G. Buller,et al.  Kilometer-range, high resolution depth imaging via 1560 nm wavelength single-photon detection. , 2013, Optics express.

[25]  Xudong Jiang,et al.  Power law temporal dependence of InGaAs/InP SPAD afterpulsing , 2012 .

[26]  Lars Sjöqvist,et al.  Photon counting ladar work at FOI, Sweden , 2012, Defense, Security, and Sensing.

[27]  R. Raskar,et al.  Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging , 2012, Nature Communications.

[28]  Ramesh Raskar,et al.  Reconstruction of hidden 3D shapes using diffuse reflections , 2012, Optics express.

[29]  A. Tosi,et al.  Two-Dimensional SPAD Imaging Camera for Photon Counting , 2010, IEEE Photonics Journal.

[30]  Ramesh Raskar,et al.  Looking around the corner using transient imaging , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Alberto Tosi,et al.  InGaAs SPAD and electronics for low time jitter and low noise , 2007, SPIE Optics + Optoelectronics.

[32]  Angelo Gulinatti,et al.  Planar silicon SPADs with 200-μm diameter and 35-ps photon timing resolution , 2006, SPIE Optics East.

[33]  Andrew S. Huntington,et al.  Probabilistic analysis of linear mode vs. Geiger mode APD FPAs for advanced LADAR enabled interceptors , 2006, SPIE Defense + Commercial Sensing.

[34]  M. Ghioni,et al.  High-rate photon counting and picosecond timing with silicon-SPAD based compact detector modules , 2007 .

[35]  Roberto Biasi,et al.  Overview of photon counting detectors based on CMOS processed single photon avalanche diodes (SPAD), InGaAs APDs, and novel hybrid (tube + APD) detectors , 2005, SPIE OPTO.

[36]  F. Koberling,et al.  Performance of the Micro Photon Devices PDM 50CT SPAD detector with PicoQuant TCSPC systems , 2005 .

[37]  S. Cova,et al.  Towards picosecond resolution with single-photon avalanche diodes , 1981 .