Bayesian 3D Reconstruction of Complex Scenes from Single-Photon Lidar Data

Light detection and ranging (Lidar) data can be used to capture the depth and intensity profile of a 3D scene. This modality relies on constructing, for each pixel, a histogram of time delays between emitted light pulses and detected photon arrivals. In a general setting, more than one surface can be observed in a single pixel. The problem of estimating the number of surfaces, their reflectivity, and position becomes very challenging in the low-photon regime (which equates to short acquisition times) or relatively high background levels (i.e., strong ambient illumination). This paper presents a new approach to 3D reconstruction using single-photon, single-wavelength Lidar data, which is capable of identifying multiple surfaces in each pixel. Adopting a Bayesian approach, the 3D structure to be recovered is modelled as a marked point process, and reversible jump Markov chain Monte Carlo (RJ-MCMC) moves are proposed to sample the posterior distribution of interest. In order to promote spatial correlation between points belonging to the same surface, we propose a prior that combines an area interaction process and a Strauss process. New RJ-MCMC dilation and erosion updates are presented to achieve an efficient exploration of the configuration space. To further reduce the computational load, we adopt a multiresolution approach, processing the data from a coarse to the finest scale. The experiments performed with synthetic and real data show that the algorithm obtains better reconstructions than other recently published optimization algorithms for lower execution times.

[1]  Aongus McCarthy,et al.  Robust Bayesian Target Detection Algorithm for Depth Imaging From Sparse Single-Photon Data , 2016, IEEE Transactions on Computational Imaging.

[2]  Aongus McCarthy,et al.  Lidar Waveform-Based Analysis of Depth Images Constructed Using Sparse Single-Photon Data , 2015, IEEE Transactions on Image Processing.

[3]  Aongus McCarthy,et al.  Restoration of intensity and depth images constructed using sparse single-photon data , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[4]  Alfred Hero,et al.  Robust Spectral Unmixing of Sparse Multispectral Lidar Waveforms Using Gamma Markov Random Fields , 2016, IEEE Transactions on Computational Imaging.

[5]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[6]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[7]  J. M. Hammersley,et al.  Markov fields on finite graphs and lattices , 1971 .

[8]  Horst Bischof,et al.  Image Guided Depth Upsampling Using Anisotropic Total Generalized Variation , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ximing Ren,et al.  Design and Evaluation of Multispectral LiDAR for the Recovery of Arboreal Parameters , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  David B. Dunson,et al.  Beta-Negative Binomial Process and Poisson Factor Analysis , 2011, AISTATS.

[12]  Aongus McCarthy,et al.  Long-range depth profiling of camouflaged targets using single-photon detection , 2017 .

[13]  Brent Schwarz,et al.  LIDAR: Mapping the world in 3D , 2010 .

[14]  Ali Taylan Cemgil,et al.  Gamma Markov Random Fields for Audio Source Modeling , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Frédéric Bretar,et al.  Full-waveform topographic lidar : State-of-the-art , 2009 .

[16]  Vivek K. Goyal,et al.  Photon-Efficient Computational 3-D and Reflectivity Imaging With Single-Photon Detectors , 2014, IEEE Transactions on Computational Imaging.

[17]  Zoubin Ghahramani,et al.  MCMC for Doubly-intractable Distributions , 2006, UAI.

[18]  Uwe Soergel,et al.  A Marked Point Process for Modeling Lidar Waveforms , 2010, IEEE Transactions on Image Processing.

[19]  Vivek K Goyal,et al.  First-Photon Imaging , 2014, Science.

[20]  van Marie-Colette Lieshout,et al.  Markov Point Processes and Their Applications , 2000 .

[21]  J. Suomalainen,et al.  Full waveform hyperspectral LiDAR for terrestrial laser scanning. , 2012, Optics express.

[22]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[23]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[24]  Donald L. Snyder,et al.  Random Point Processes in Time and Space , 1991 .

[25]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[26]  Rebecca Willett,et al.  This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms—Theory and Practice , 2010, IEEE Transactions on Image Processing.

[27]  A. Baddeley,et al.  Area-interaction point processes , 1993 .

[28]  Vivek K. Goyal,et al.  A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging , 2016, IEEE Transactions on Computational Imaging.

[29]  P. Lancaster,et al.  Surfaces generated by moving least squares methods , 1981 .

[30]  Andrew M. Wallace,et al.  Bayesian Analysis of Lidar Signals with Multiple Returns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[32]  R. Collins,et al.  Long-range time-of-flight scanning sensor based on high-speed time-correlated single-photon counting. , 2009, Applied optics.

[33]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[34]  T. Ogawa,et al.  Lane Recognition Using On-vehicle LIDAR , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[35]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[36]  Alessandro Foi,et al.  Variance Stabilization for Noisy+Estimate Combination in Iterative Poisson Denoising , 2016, IEEE Signal Processing Letters.

[37]  Aongus McCarthy,et al.  Restoration of multilayered single-photon 3D Lidar images , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[38]  Aongus McCarthy,et al.  Underwater depth imaging using time-correlated single photon counting , 2015, Sensing Technologies + Applications.

[39]  Andrew M. Wallace,et al.  Multilayered 3D LiDAR Image Construction Using Spatial Models in a Bayesian Framework , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Jianfeng Sun,et al.  Research of underwater target detection using a Slit Streak Tube Imaging Lidar , 2011, 2011 Academic International Symposium on Optoelectronics and Microelectronics Technology.

[41]  Steve McLaughlin,et al.  Unsupervised restoration of subsampled images constructed from geometric and binomial data , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[42]  R. Waagepetersen,et al.  Modern Statistics for Spatial Point Processes * , 2007 .

[43]  Guillermo Sapiro,et al.  Non-Parametric Bayesian Dictionary Learning for Sparse Image Representations , 2009, NIPS.

[44]  Vivek K Goyal,et al.  Computational multi-depth single-photon imaging. , 2016, Optics express.

[45]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[46]  Aongus McCarthy,et al.  Object Depth Profile and Reflectivity Restoration From Sparse Single-Photon Data Acquired in Underwater Environments , 2016, IEEE Transactions on Computational Imaging.

[47]  Nick Whiteley,et al.  Maximum marginal likelihood estimation of the granularity coefficient of a Potts-Markov random field within an MCMC algorithm , 2014, 2014 IEEE Workshop on Statistical Signal Processing (SSP).

[48]  Steve McLaughlin,et al.  A Bayesian Approach to Denoising of Single-Photon Binary Images , 2016, IEEE Transactions on Computational Imaging.

[49]  Steve McLaughlin,et al.  Robust Markov Random Field outlier detection and removal in subsampled images , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[50]  M. Nilsson Estimation of tree heights and stand volume using an airborne lidar system , 1996 .