EM-based approach to 3D reconstruction from single-waveform multispectral Lidar data

In this paper, we present a novel Bayesian approach for estimating spectral and range profiles from single-photon Lidar waveforms associated with single surfaces in the photon-limited regime. In contrast to classical multispectral Lidar signals, we consider a single Lidar waveform per pixel, whereby a single detector is used to acquire information simultaneously at multiple wavelengths. A new observation model based on a mixture of distributions is developed. It relates the unknown parameters of interest to the observed waveforms containing information from multiple wavelengths. Adopting a Bayesian approach, several prior models are investigated and a stochastic Expectation-Maximization algorithm is proposed to estimate the spectral and depth profiles. The reconstruction performance and computational complexity of our approach are assessed, for different prior models, through a series of experiments using synthetic and real data under different observation scenarios. The results obtained demonstrate a significant speed-up without significant degradation of the reconstruction performance when compared to existing methods in the photon-starved regime.

[1]  Alfred Hero,et al.  Robust Spectral Unmixing of Sparse Multispectral Lidar Waveforms Using Gamma Markov Random Fields , 2016, IEEE Transactions on Computational Imaging.

[2]  Peter J. Basser,et al.  White matter microstructure from nonparametric axon diameter distribution mapping , 2016, NeuroImage.

[3]  Steve McLaughlin,et al.  Spectral Unmixing of Multispectral Lidar Signals , 2015, IEEE Transactions on Signal Processing.

[4]  Ximing Ren,et al.  Design and Evaluation of Multispectral LiDAR for the Recovery of Arboreal Parameters , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  G. Celeux,et al.  Stochastic versions of the em algorithm: an experimental study in the mixture case , 1996 .

[7]  Gersende Fort,et al.  Combining Monte Carlo and Mean-Field-Like Methods for Inference in Hidden Markov Random Fields , 2007, IEEE Transactions on Image Processing.

[8]  E. Bratsolis,et al.  Building block extraction and classification by means of Markov random fields using aerial imagery and LiDAR data , 2016, Remote Sensing.

[9]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[10]  Vivek K. Goyal,et al.  A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging , 2016, IEEE Transactions on Computational Imaging.

[11]  Jean-Yves Tourneret,et al.  Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers , 2019, Nature Communications.

[12]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[13]  Aongus McCarthy,et al.  Robust Restoration of Sparse Multidimensional Single-Photon LiDAR Images , 2020, IEEE Transactions on Computational Imaging.

[14]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[15]  Ximing Ren,et al.  Wavelength-time coding for multispectral 3D imaging using single-photon LiDAR. , 2018, Optics express.

[16]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[17]  Andrew M. Wallace,et al.  Recovery of Forest Canopy Parameters by Inversion of Multispectral LiDAR Data , 2012, Remote. Sens..

[18]  Jean-Yves Tourneret,et al.  Bayesian 3D Reconstruction of Subsampled Multispectral Single-Photon Lidar Signals , 2019, IEEE Transactions on Computational Imaging.

[19]  Alessandro Foi,et al.  Variance Stabilization for Noisy+Estimate Combination in Iterative Poisson Denoising , 2016, IEEE Signal Processing Letters.

[20]  Yoann Altmann,et al.  3D Reconstruction Using Single-photon Lidar Data Exploiting the Widths of the Returns , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Andrew M. Wallace,et al.  Discriminating Underwater LiDAR Target Signatures Using Sparse Multi-Spectral Depth Codes , 2016, 2016 Sensor Signal Processing for Defence (SSPD).

[22]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[23]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[24]  Andrew M. Wallace,et al.  Full Waveform Analysis for Long-Range 3D Imaging Laser Radar , 2010, EURASIP J. Adv. Signal Process..

[25]  Stephen McLaughlin,et al.  Fast Online 3D Reconstruction of Dynamic Scenes From Individual Single-Photon Detection Events , 2020, IEEE Transactions on Image Processing.

[26]  Gong Wei,et al.  Multi-wavelength canopy LiDAR for remote sensing of vegetation: Design and system performance , 2012 .

[27]  Behnaz Bigdeli,et al.  A decision fusion method based on multiple support vector machine system for fusion of hyperspectral and LIDAR data , 2014 .

[28]  Aongus McCarthy,et al.  Comparative study of sampling strategies for sparse photon multispectral lidar imaging: towards mosaic filter arrays , 2017 .

[29]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[30]  Aongus McCarthy,et al.  Lidar Waveform-Based Analysis of Depth Images Constructed Using Sparse Single-Photon Data , 2015, IEEE Transactions on Image Processing.

[31]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[32]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[33]  J. Hicke,et al.  Estimating aboveground carbon stocks of a forest affected by mountain pine beetle in Idaho using lidar and multispectral imagery , 2012 .

[34]  M. Amann,et al.  Laser ranging: a critical review of usual techniques for distance measurement , 2001 .

[35]  Xin Wang,et al.  Laplacian Operator-Based Edge Detectors , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Cristiano Premebida,et al.  Pedestrian detection combining RGB and dense LIDAR data , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[38]  R. Valbuena,et al.  Fusion of airborne LiDAR and multispectral sensors reveals synergic capabilities in forest structure characterization , 2016 .

[39]  Achuta Kadambi,et al.  Coded aperture compressive 3-D LIDAR , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Steve McLaughlin,et al.  Range Estimation from Single-Photon Lidar Data Using a Stochastic Em Approach , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[41]  Aongus McCarthy,et al.  Bayesian restoration of reflectivity and range profiles from subsampled single-photon multispectral Lidar data , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[42]  E. Charbon,et al.  A Single-Photon Avalanche Diode Array for Fluorescence Lifetime Imaging Microscopy , 2008, IEEE Journal of Solid-State Circuits.

[43]  Bo Zhu,et al.  Investigating the Potential of Using the Spatial and Spectral Information of Multispectral LiDAR for Object Classification , 2015, Sensors.

[44]  Gilles Celeux,et al.  EM procedures using mean field-like approximations for Markov model-based image segmentation , 2003, Pattern Recognit..