Non-line-of-sight 3D imaging with a single-pixel camera

Real time, high resolution 3D reconstruction of scenes hidden from the direct field of view is a challenging field of research with applications in real-life situations related e.g. to surveillance, self-driving cars and rescue missions. Most current techniques recover the 3D structure of a non-lineof-sight (NLOS) static scene by detecting the return signal from the hidden object on a scattering observation area. Here, we demonstrate the full colour retrieval of the 3D shape of a hidden scene by coupling back-projection imaging algorithms with the high-resolution time-of-flight information provided by a single-pixel camera. By using a high efficiency Single-Photon Avalanche Diode (SPAD) detector, this technique provides the advantage of imaging with no mechanical scanning parts, with acquisition times down to sub-seconds.

[1]  Andreas Velten,et al.  Error Backprojection Algorithms for Non-Line-of-Sight Imaging , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Vivek K Goyal,et al.  Computational periscopy with an ordinary digital camera , 2019, Nature.

[3]  Miles J. Padgett,et al.  Principles and prospects for single-pixel imaging , 2018, Nature Photonics.

[4]  Xiping Xu,et al.  Imaging of hidden object using passive mode single pixel imaging with compressive sensing , 2018, Laser Physics Letters.

[5]  Vivek K Goyal,et al.  Quantum-inspired computational imaging , 2018, Science.

[6]  Daniele Faccio,et al.  A trillion frames per second: the techniques and applications of light-in-flight photography , 2018, Reports on progress in physics. Physical Society.

[7]  Siqi Zhang,et al.  Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition. , 2018, Optics express.

[8]  Genevieve Gariepy,et al.  Enhancing the recovery of a temporal sequence of images using joint deconvolution , 2018, Scientific Reports.

[9]  Gordon Wetzstein,et al.  Confocal non-line-of-sight imaging based on the light-cone transform , 2018, Nature.

[10]  A. Tosi,et al.  Single-Photon Avalanche Diodes in a 0.16 μm BCD Technology With Sharp Timing Response and Red-Enhanced Sensitivity , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[11]  Daniel Buschek,et al.  Neural network identification of people hidden from view with a single-pixel, single-photon detector , 2017, Scientific Reports.

[12]  Aongus McCarthy,et al.  Comparative study of sampling strategies for sparse photon multispectral lidar imaging: towards mosaic filter arrays , 2017 .

[13]  Ashok Veeraraghavan,et al.  Reconstructing rooms using photon echoes: A plane based model and reconstruction algorithm for looking around the corner , 2017, 2017 IEEE International Conference on Computational Photography (ICCP).

[14]  Diego Gutierrez,et al.  Fast back-projection for non-line of sight reconstruction , 2017, SIGGRAPH Posters.

[15]  Jonathan Leach,et al.  Non-line-of-sight tracking of people at long range , 2017, Optics express.

[16]  Ramesh Raskar,et al.  Lensless Imaging With Compressive Ultrafast Sensing , 2016, IEEE Transactions on Computational Imaging.

[17]  Miles J. Padgett,et al.  Real-time 3D video utilizing a compressed sensing time-of-flight single-pixel camera , 2016, NanoScience + Engineering.

[18]  Gerald Buller,et al.  Efficient Range Estimation and Material Quantification from Multispectral Lidar Waveforms , 2016, 2016 Sensor Signal Processing for Defence (SSPD).

[19]  Jaime Martín,et al.  Tracking objects outside the line of sight using 2D intensity images , 2016, Scientific Reports.

[20]  Graham M. Gibson,et al.  Single-pixel three-dimensional imaging with time-based depth resolution , 2016, Nature Communications.

[21]  Robert Henderson,et al.  Detection and tracking of moving objects hidden from view , 2015, Nature Photonics.

[22]  K. Eliceiri,et al.  Non-line-of-sight imaging using a time-gated single photon avalanche diode. , 2015, Optics express.

[23]  Kevin J. Mitchell,et al.  Single-pixel infrared and visible microscope , 2014 .

[24]  Vicente Durán,et al.  Image transmission through dynamic scattering media by single-pixel photodetection. , 2014, Optics express.

[25]  M. Fink,et al.  Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations , 2014, Nature Photonics.

[26]  O. Katz,et al.  Looking around corners and through thin turbid layers in real time with scattered incoherent light , 2012, Nature Photonics.

[27]  Ramesh Raskar,et al.  Looking Around the Corner using Ultrafast Transient Imaging , 2011, International Journal of Computer Vision.

[28]  Brent Schwarz,et al.  LIDAR: Mapping the world in 3D , 2010 .

[29]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[30]  Stefan Nilsson,et al.  Radar detection of moving objects around corners , 2009, Defense + Commercial Sensing.

[31]  Wai Lam Chan,et al.  A single-pixel terahertz imaging system based on compressed sensing , 2008 .

[32]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[33]  R. A. Elliot,et al.  Optical remote sensing of the atmosphere. , 1985, Applied optics.

[34]  Un,et al.  Real-time imaging of methane gas leaks using a single-pixel camera , 2017 .

[35]  Avinash C. Kak,et al.  3. Algorithms for Reconstruction with Nondiffracting Sources , 2001 .