Edinburgh Research Explorer Three-dimensional imaging of stationary and moving targets in turbid underwater environments using a single-photon detector array

: Three-dimensional imaging in underwater environments was investigated using a picosecond resolution silicon single-photon avalanche diode (SPAD) detector array fabricated in complementary metal-oxide semiconductor (CMOS) technology. Each detector in the 192 × 128 SPAD array had an individual time-to-digital converter allowing rapid, simultaneous acquisition of data for the entire array using the time-correlated single-photon counting approach. A picosecond pulsed laser diode source operating at a wavelength of 670 nm was used to illuminate the underwater scenes, emitting an average optical power up to 8 mW. Both stationary and moving targets were imaged under a variety of underwater scattering conditions. The acquisition of depth and intensity videos of moving targets was demonstrated in dark laboratory conditions through scattering water, equivalent to having up to 6.7 attenuation lengths between the transceiver and target. Data were analyzed using a pixel-wise approach, as well as an image processing algorithm based on a median filter and polynomial approximation.

[1]  G. Buller,et al.  Hot pixel classification of single‐photon avalanche diode detector arrays using a log‐normal statistical distribution , 2019, Electronics Letters.

[2]  Jean-Yves Tourneret,et al.  Real-time 3D reconstruction of complex scenes using single-photon lidar: when image processing meets computer graphics , 2019 .

[3]  Martin Wolf,et al.  A 30-frames/s, $252\times144$ SPAD Flash LiDAR With 1728 Dual-Clock 48.8-ps TDCs, and Pixel-Wise Integrated Histogramming , 2019, IEEE Journal of Solid-State Circuits.

[4]  Aongus McCarthy,et al.  Three-dimensional single-photon imaging through obscurants. , 2019, Optics express.

[5]  Richard Walker,et al.  A CMOS SPAD Line Sensor With Per-Pixel Histogramming TDC for Time-Resolved Multispectral Imaging , 2019, IEEE Journal of Solid-State Circuits.

[6]  Robert K. Henderson,et al.  5.7 A 256×256 40nm/90nm CMOS 3D-Stacked 120dB Dynamic-Range Reconfigurable Time-Resolved SPAD Imager , 2019, 2019 IEEE International Solid- State Circuits Conference - (ISSCC).

[7]  Thuy-Yung Tran,et al.  Underwater Optical Imaging for Automotive Wading , 2018, Sensors.

[8]  Jean-Yves Tourneret,et al.  Bayesian 3D Reconstruction of Complex Scenes from Single-Photon Lidar Data , 2018, SIAM J. Imaging Sci..

[9]  Angelo Gulinatti,et al.  83-ps Timing Jitter With a Red-Enhanced SPAD and a Fully Integrated Front End Circuit , 2018, IEEE Photonics Technology Letters.

[10]  David J. S. Birch,et al.  A 192×128 Time Correlated Single Photon Counting Imager in 40nm CMOS Technology , 2018, ESSCIRC 2018 - IEEE 44th European Solid State Circuits Conference (ESSCIRC).

[11]  Jostein Thorstensen,et al.  Real-time super-resolved 3D in turbid water using a fast range-gated CMOS camera. , 2018, Applied optics.

[12]  Ximing Ren,et al.  High-resolution depth profiling using a range-gated CMOS SPAD quanta image sensor. , 2018, Optics express.

[13]  Benjamin Gallinet,et al.  Cylindrical microlensing for enhanced collection efficiency of small pixel SPAD arrays in single-molecule localisation microscopy. , 2018, Optics express.

[14]  Aongus McCarthy,et al.  Long-range depth profiling of camouflaged targets using single-photon detection , 2017 .

[15]  Juha Kostamovaara,et al.  An 80 × 25 pixel CMOS single-photon range image sensor with a flexible on-chip time gating topology for solid state 3D scanning , 2017, ESSCIRC 2017 - 43rd IEEE European Solid State Circuits Conference.

[16]  Abderrahim Halimi,et al.  Single-photon three-dimensional imaging at up to 10 kilometers range. , 2017, Optics express.

[17]  S. Pellegrini,et al.  Backside illuminated SPAD image sensor with 7.83μm pitch in 3D-stacked CMOS technology , 2016, 2016 IEEE International Electron Devices Meeting (IEDM).

[18]  Aongus McCarthy,et al.  Depth imaging in highly scattering underwater environments using time-correlated single-photon counting , 2016, Security + Defence.

[19]  Aongus McCarthy,et al.  Object Depth Profile and Reflectivity Restoration From Sparse Single-Photon Data Acquired in Underwater Environments , 2016, IEEE Transactions on Computational Imaging.

[20]  Aongus McCarthy,et al.  Restoration of intensity and depth images constructed using sparse single-photon data , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[21]  Matteo Perenzoni,et al.  Compact SPAD-Based Pixel Architectures for Time-Resolved Image Sensors , 2016, Sensors.

[22]  Rudi Lussana,et al.  Fill-factor improvement of Si CMOS single-photon avalanche diode detector arrays by integration of diffractive microlens arrays. , 2015, Optics express.

[23]  Gabriel Oliver,et al.  Optical Sensors and Methods for Underwater 3D Reconstruction , 2015, Sensors.

[24]  Nikola Krstajić,et al.  0.5 billion events per second time correlated single photon counting using CMOS SPAD arrays. , 2015, Optics letters.

[25]  Aongus McCarthy,et al.  Lidar Waveform-Based Analysis of Depth Images Constructed Using Sparse Single-Photon Data , 2015, IEEE Transactions on Image Processing.

[26]  J. Jaffe.  Underwater Optical Imaging: The Past, the Present, and the Prospects , 2015, IEEE Journal of Oceanic Engineering.

[27]  Aongus McCarthy,et al.  Underwater depth imaging using time-correlated single photon counting , 2015, Sensing Technologies + Applications.

[28]  R. Raskar,et al.  Single-photon sensitive light-in-fight imaging , 2015, Nature Communications.

[29]  W. Brockherde,et al.  100 000 Frames/s 64 × 32 Single-Photon Detector Array for 2-D Imaging and 3-D Ranging , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[30]  W. Brockherde,et al.  CMOS Imager With 1024 SPADs and TDCs for Single-Photon Timing and 3-D Time-of-Flight , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[31]  Edoardo Charbon,et al.  Measurement and modeling of microlenses fabricated on single-photon avalanche diode arrays for fill factor recovery. , 2014, Optics express.

[32]  Kenneth L. Shepard,et al.  A 100 fps, Time-Correlated Single-Photon-Counting-Based Fluorescence-Lifetime Imager in 130 nm CMOS , 2014, IEEE Journal of Solid-State Circuits.

[33]  G. Buller,et al.  Kilometer-range depth imaging at 1,550 nm wavelength using an InGaAs/InP single-photon avalanche diode detector. , 2013, Optics express.

[34]  G. Buller,et al.  Kilometer-range, high resolution depth imaging via 1560 nm wavelength single-photon detection. , 2013, Optics express.

[35]  A. Tosi,et al.  Single-photon pulsed-light indirect time-of-flight 3D ranging. , 2013, Optics express.

[36]  Fraser Dalgleish,et al.  Performance considerations for continuous-wave and pulsed laser line scan (LLS) imaging systems , 2010 .

[37]  G. Buller,et al.  Resolving range ambiguity in a photon counting depth imager operating at kilometer distances. , 2010, Optics express.

[38]  Fraser Dalgleish,et al.  Improved LLS imaging performance in scattering-dominant waters , 2009, Defense + Commercial Sensing.

[39]  Alan Laux,et al.  The a, b, c s of oceanographic lidar predictions: a significant step toward closing the loop between theory and experiment , 2002 .

[40]  G. Buller,et al.  Laser-based distance measurement using picosecond resolution time-correlated single-photon counting , 2000 .

[41]  Norman S. Kopeika,et al.  A System Engineering Approach to Imaging , 1998 .

[42]  G. M. Hale,et al.  Optical Constants of Water in the 200-nm to 200-microm Wavelength Region. , 1973, Applied optics.

[43]  O. Kopelevich,et al.  Light in the Sea , 1972 .

[44]  Seibert Q. Duntley,et al.  Underwater Lighting by Submerged Lasers and Incandescent Sources , 1971 .

[45]  Wenhai Xu,et al.  Ultra-low-light-level digital still camera for autonomous underwater vehicle , 2019, Optical Engineering.

[46]  S. Pellegrini,et al.  A SPAD-Based QVGA Image Sensor for Single-Photon Counting and Quanta Imaging , 2016, IEEE Transactions on Electron Devices.

[47]  Masaru Ogawa,et al.  A 0.18-$\mu$ m CMOS SoC for a 100-m-Range 10-Frame/s 200 $\,\times\,$96-Pixel Time-of-Flight Depth Sensor , 2014, IEEE Journal of Solid-State Circuits.

[48]  E. Charbon,et al.  A Time-Gated 128x128 CMOS SPAD Array for on-Chip Fluorescence Detection , 2011 .

[49]  Edoardo Charbon,et al.  A 128x128 Single-Photon Imager with on-Chip Column-Level 97ps 10bit Time-to-Digital-Converter Array , 2008, ISSCC 2008.