Understanding and Ameliorating Mixed Pixels and Multipath Interference in AMCW Lidar

Amplitude modulated continuous wave (AMCW) lidar systems suffer from significant systematic errors due to mixed pixels and multipath interference. Commercial systems can achieve centimetre precision, however accuracy is typically an order of magnitude worse limiting practical use of these devices. In this chapter the authors address AMCW measurement formation and the causes of mixed pixels and multipath interference. A comprehensive review of the literature is given, from the first reports of mixed pixels in point-scanning AMCW systems, through to the gamut of research over the past two decades into mixed pixels and multipath interference. An overview of a variety of detection and mitigation techniques, including deconvolution based intra-camera scattering reduction, modelling of intra-scene scattering, correlation waveform deconvolution techniques/multifrequency sampling and standard removal approaches, all of which can be applied to range-data from standard commercial cameras is presented. The chapter concludes with comments on future work for better detection and correction of systematic errors in full-field AMCW lidar.

[1]  C. W. Trussell,et al.  Multiple-return laser radar for three-dimensional imaging through obscurations. , 2002, Applied optics.

[2]  Mark L. G. Althouse,et al.  Least squares subspace projection approach to mixed pixel classification for hyperspectral images , 1998, IEEE Trans. Geosci. Remote. Sens..

[3]  Burcu Akinci,et al.  A Comparative Analysis of Depth-Discontinuity and Mixed-Pixel Detection Algorithms , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[4]  Michael J. Cree,et al.  Extending AMCW Lidar Depth-of-Field Using a Coded Aperture , 2010, ACCV.

[5]  Jens T. Thielemann,et al.  Modelling and compensating measurement errors caused by scattering in time-of-flight cameras , 2008, Optical Engineering + Applications.

[6]  Burcu Akinci,et al.  Quantification of edge loss of laser scanned data at spatial discontinuities , 2009 .

[7]  D. Falie.  3D image correction for time of flight (ToF) cameras , 2009, International Conference on Optical Instruments and Technology.

[8]  S. Levy,et al.  Reconstruction of a sparse spike train from a portion of its spectrum and application to high-resolution deconvolution , 1981 .

[9]  Martial Hebert,et al.  Analysis and Removal of Artifacts in 3-D LADAR Data , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  Martial Hebert,et al.  3D measurements from imaging laser radars: how good are they? , 1992, Image Vis. Comput..

[11]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[12]  D. Falie,et al.  Improvements of the 3D images captured with Time-of-Flight cameras , 2009, ArXiv.

[13]  Michael J. Cree,et al.  Understanding and Ameliorating Non-Linear Phase and Amplitude Responses in AMCW Lidar , 2011, Remote. Sens..

[14]  Andreas Kolb,et al.  Calibration of the intensity-related distance error of the PMD TOF-camera , 2007, SPIE Optics East.

[15]  D. Falie,et al.  Three-dimensional image corrections for time-of-flight cameras , 2011 .

[16]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[17]  In So Kweon,et al.  Experimental Characterization of the Perceptron Laser Rangefinder , 1991 .

[18]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[19]  Mehrdad Soumekh,et al.  Synthetic Aperture Radar Signal Processing with MATLAB Algorithms , 1999 .

[20]  M. Cree,et al.  Achieving sub-millimetre precision with a solid-state full-field heterodyning range imaging camera , 2007 .

[21]  J. Bryan Blair,et al.  Decomposition of laser altimeter waveforms , 2000, IEEE Trans. Geosci. Remote. Sens..

[22]  L. Landweber.  An iteration formula for Fredholm integral equations of the first kind , 1951 .

[23]  Penny Probert Smith,et al.  The Interpretation of Phase and Intensity Data from AMCW Light Detection Sensors for Reliable Ranging , 1996, Int. J. Robotics Res..

[24]  Stefan Fuchs,et al.  Multipath Interference Compensation in Time-of-Flight Camera Images , 2010, 2010 20th International Conference on Pattern Recognition.

[25]  Meng-Dawn Cheng,et al.  Intensity-modulated, stepped frequency cw lidar for distributed aerosol and hard target measurements. , 2005, Applied optics.

[26]  Kevin George Harding,et al.  Two- and Three-Dimensional Methods for Inspection and Metrology VI , 2008 .

[27]  L. Lucy.  An iterative technique for the rectification of observed distributions , 1974 .