Restoration of Multilayered Single-Photon 3D Lidar Images

This paper proposes a new algorithm to restore 3D single-photon Lidar images obtained under challenging realistic scenarios which include imaging multilayered targets such as semi-transparent surfaces or imaging through obscurants such as scattering media (e.g., water, fog). The Data restoration and exploitation is achieved by minimising an appropriate cost-function accounting for the data Poisson statistics and the available prior knowledge regarding the depth and reflectivity estimates. The proposed algorithm takes into account (i) the non-local spatial correlations between pixels, by using a convex non-local total variation (TV) regularizer, and (ii) the clustered nature of the returned photons, by using a collaborative sparse prior. The resulting minimization problem is solved using the alternating direction method of multipliers (ADMM) that offers good convergence properties. The algorithm is validated using both synthetic and real data which show the benefit of the proposed strategy in the sparse regime due to a fast acquisition or in presence of a high background due to obscurants.

[1]  Vivek K. Goyal,et al.  Computational single-photon depth imaging without transverse regularization , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[2]  Alberto Tosi,et al.  Kilometer-range depth imaging using an InGaAs/InP single-photon avalanche diode detector operating at a wavelength of 1550 nm , 2013 .

[3]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[4]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[5]  Angshul Majumdar,et al.  Hyperspectral Unmixing in the Presence of Mixed Noise Using Joint-Sparsity and Total Variation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  I. M. Otivation.  Playing with Duality: An Overview of Recent Primal-Dual Approaches for Solving Large-Scale Optimization Problems , 2018 .

[7]  Aongus McCarthy,et al.  Restoration of multilayered single-photon 3D Lidar images , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[8]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[9]  P. L. Combettes,et al.  A proximal decomposition method for solving convex variational inverse problems , 2008, 0807.2617.

[10]  Andrew M. Wallace,et al.  Full Waveform Analysis for Long-Range 3D Imaging Laser Radar , 2010, EURASIP J. Adv. Signal Process..

[11]  Hing Cheung So,et al.  Outlier-Robust Matrix Completion via $\ell _p$ -Minimization , 2018, IEEE Transactions on Signal Processing.

[12]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[13]  G. Buller,et al.  Ranging and Three-Dimensional Imaging Using Time-Correlated Single-Photon Counting and Point-by-Point Acquisition , 2007, IEEE Journal of Selected Topics in Quantum Electronics.

[14]  Aongus McCarthy,et al.  Long-range depth profiling of camouflaged targets using single-photon detection , 2017 .

[15]  Aongus McCarthy,et al.  Restoration of intensity and depth images constructed using sparse single-photon data , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[16]  Andrew M. Wallace,et al.  Multilayered 3D LiDAR Image Construction Using Spatial Models in a Bayesian Framework , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Vivek K Goyal,et al.  Computational multi-depth single-photon imaging. , 2016, Optics express.

[18]  José M. Bioucas-Dias,et al.  Fast Hyperspectral Unmixing in Presence of Nonlinearity or Mismodeling Effects , 2016, IEEE Transactions on Computational Imaging.

[19]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[20]  M. Amann,et al.  Laser ranging: a critical review of usual techniques for distance measurement , 2001 .

[21]  Vivek K. Goyal,et al.  A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging , 2016, IEEE Transactions on Computational Imaging.

[22]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[23]  Rebecca Willett,et al.  Poisson Noise Reduction with Non-local PCA , 2012, Journal of Mathematical Imaging and Vision.

[24]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[25]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[26]  Andrew M. Wallace,et al.  Bayesian Analysis of Lidar Signals with Multiple Returns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Antonio J. Plaza,et al.  Collaborative Sparse Regression for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Abderrahim Halimi,et al.  Single-photon three-dimensional imaging at up to 10 kilometers range. , 2017, Optics express.

[30]  Konrad Schindler,et al.  Super-Resolution of Multispectral Multiresolution Images from a Single Sensor , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Yonina C. Eldar,et al.  C-HiLasso: A Collaborative Hierarchical Sparse Modeling Framework , 2010, IEEE Transactions on Signal Processing.

[32]  Aongus McCarthy,et al.  Lidar Waveform-Based Analysis of Depth Images Constructed Using Sparse Single-Photon Data , 2015, IEEE Transactions on Image Processing.

[33]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[34]  Ximing Ren,et al.  High-resolution depth profiling using a range-gated CMOS SPAD quanta image sensor. , 2018, Optics express.

[35]  Di Guo,et al.  Hankel Matrix Nuclear Norm Regularized Tensor Completion for $N$-dimensional Exponential Signals , 2016, IEEE Transactions on Signal Processing.

[36]  R. Collins,et al.  Long-range time-of-flight scanning sensor based on high-speed time-correlated single-photon counting. , 2009, Applied optics.

[37]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[38]  Aongus McCarthy,et al.  Object Depth Profile and Reflectivity Restoration From Sparse Single-Photon Data Acquired in Underwater Environments , 2016, IEEE Transactions on Computational Imaging.