A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging

Conventional LIDAR systems require hundreds or thousands of photon detections per pixel to form accurate depth and reflectivity images. Recent photon-efficient computational imaging methods are remarkably effective with only 1.0 to 3.0 detected photons per pixel, but they are not demonstrated at signal-to-background ratio (SBR) below 1.0 because their imaging accuracies degrade significantly in the presence of high background noise. We introduce a new approach to depth and reflectivity estimation that emphasizes the unmixing of contributions from signal and noise sources. At each pixel in an image, short-duration range gates are adaptively determined and applied to remove detections likely to be due to noise. For pixels with too few detections to perform this censoring accurately, data are combined from neighboring pixels to improve depth estimates, where the neighborhood formation is also adaptive to scene content. Algorithm performance is demonstrated on experimental data at varying levels of noise. Results show improved performance of both reflectivity and depth estimates over state-of-the-art methods, especially at low SBR. In particular, accurate imaging is demonstrated with SBR as low as 0.04. This validation of a photon-efficient, noise-tolerant method demonstrates the viability of rapid, long-range, and low-power LIDAR imaging.

[1]  Vivek K. Goyal,et al.  Photon-Efficient Computational 3-D and Reflectivity Imaging With Single-Photon Detectors , 2014, IEEE Transactions on Computational Imaging.

[2]  Wende Zhang,et al.  LIDAR-based road and road-edge detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Donald L. Snyder,et al.  Random Point Processes in Time and Space , 1991 .

[5]  Lionel Moisan,et al.  Total variation denoising using posterior expectation , 2008, 2008 16th European Signal Processing Conference.

[6]  Vivek K Goyal,et al.  First-Photon Imaging , 2014, Science.

[7]  Ivana Tosic,et al.  Learning Joint Intensity-Depth Sparse Representations , 2012, IEEE Transactions on Image Processing.

[8]  N. Sergent,et al.  Photon counting imaging with an electron-bombarded CCD: towards wide-field time-correlated single photon counting (TCSPC) , 2015 .

[9]  David Harding,et al.  The Need for a National Lidar Dataset , 2008 .

[10]  G. Buller,et al.  Ranging and Three-Dimensional Imaging Using Time-Correlated Single-Photon Counting and Point-by-Point Acquisition , 2007, IEEE Journal of Selected Topics in Quantum Electronics.

[11]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Andrew M. Wallace,et al.  Detecting and characterising returns in a pulsed ladar system , 2006 .

[13]  Israel Bar-David,et al.  Communication under the Poisson regime , 1969, IEEE Trans. Inf. Theory.

[14]  Michael Wahl,et al.  Time-Correlated Single Photon Counting , 2009 .

[15]  Alfred A. Rizzi,et al.  Autonomous navigation for BigDog , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Vivek K Goyal,et al.  Computational multi-depth single-photon imaging. , 2016, Optics express.

[18]  S. Popescu Estimating biomass of individual pine trees using airborne lidar , 2007 .

[19]  Michael J. Olsen,et al.  Superpixel Clustering and Planar Fit Segmentation of 3D LIDAR Point Clouds , 2013, 2013 Fourth International Conference on Computing for Geospatial Research and Application.

[20]  Sing Bing Kang,et al.  Stereo for Image-Based Rendering using Image Over-Segmentation , 2007, International Journal of Computer Vision.

[21]  Bruce E. Moision,et al.  Maximum likelihood time-of-arrival estimation of optical pulses via photon-counting photodetectors , 2009, 2009 IEEE International Symposium on Information Theory.

[22]  Vivek K. Goyal,et al.  Mime: compact, low power 3D gesture sensing for interaction with head mounted displays , 2013, UIST.

[23]  Aongus McCarthy,et al.  Lidar Waveform-Based Analysis of Depth Images Constructed Using Sparse Single-Photon Data , 2015, IEEE Transactions on Image Processing.

[24]  Diego Gutierrez,et al.  Improving Depth Estimation Using Superpixels , 2014, CEIG.

[25]  R. Collins,et al.  Long-range time-of-flight scanning sensor based on high-speed time-correlated single-photon counting. , 2009, Applied optics.

[26]  Vivek K Goyal,et al.  Photon-efficient imaging with a single-photon camera , 2016, Nature Communications.

[27]  Luc Van Gool,et al.  Depth SEEDS: Recovering incomplete depth data using superpixels , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[28]  G. Buller,et al.  Laser-based distance measurement using picosecond resolution time-correlated single-photon counting , 2000 .

[29]  M. Amann,et al.  Laser ranging: a critical review of usual techniques for distance measurement , 2001 .

[30]  Nathan Seldomridge,et al.  Polarization lidar measurements of honey bees in flight for locating land mines. , 2005, Optics express.