Lidar guided stereo simultaneous localization and mapping (SLAM) for UAV outdoor 3-D scene reconstruction

Lidars can be extremely useful tools for measuring outdoor geometry. However while lidar measurements are championed for their high accuracy their point clouds are individually rather sparse and lack colour information. In this work the sparse nature of lidar point clouds is addressed by merging multiple lidar scans into a single large point cloud. This is done by restricting the lidar motion to a single axis of translation and then using interpolation and iterative refinement to acquire a denser model by combining co-registered sets of point clouds. This newly constructed model is then used to guide a basic stereo SLAM (simultaneous localization and mapping) algorithm in order to produce a final dense coloured point cloud that preserves the accuracy of the original lidar measurements. Our experiments were performed at various locations using a 16 channel “Puck” Velodyne lidar and a stereo acquisition system consisting of a DJI Phantom quadcopter and a synchronized pair of GoPro HERO 3+ black edition cameras. Results of these experiments demonstrate that the produced reconstructions are both ascetically sound and quantitatively consistent with a set of individual measurements taken around the scene.

[1]  L. Monika Moskal,et al.  Fusion of LiDAR and imagery for estimating forest canopy fuels , 2010 .

[2]  P. Protzel,et al.  Using the Unscented Kalman Filter in Mono-SLAM with Inverse Depth Parametrization for Autonomous Airship Control , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[3]  Przemysław Tymków,et al.  UAV-BASED AUTOMATIC TREE GROWTH MEASUREMENT FOR BIOMASS ESTIMATION , 2016 .

[4]  Miguel A. Olivares-Méndez,et al.  Visual 3-D SLAM from UAVs , 2009, J. Intell. Robotic Syst..

[5]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[7]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[8]  Jochen Teizer,et al.  Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system , 2014 .

[9]  Georgy L. Gimel'farb,et al.  Symmetric dynamic programming stereo using block matching guidance , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[12]  John Trinder,et al.  Using the Dempster-Shafer method for the fusion of LIDAR data and multi-spectral images for building detection , 2005, Inf. Fusion.

[13]  T. Schenk FUSION OF LIDAR DATA AND AERIAL IMAGERY FOR A MORE COMPLETE SURFACE DESCRIPTION , 2002 .

[14]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[15]  C. Glennie,et al.  CALIBRATION AND STABILITY ANALYSIS OF THE VLP-16 LASER SCANNER , 2016 .

[16]  Edwin Olson,et al.  Structure tensors for general purpose LIDAR feature extraction , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Claus Brenner,et al.  Extraction of buildings and trees in urban environments , 1999 .

[19]  Wei Li,et al.  A practical comparison between Zhang's and Tsai's calibration approaches , 2014, IVCNZ '14.

[20]  Fabio Remondino,et al.  Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation , 2010 .

[21]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[22]  Christopher Zach,et al.  Robust Bundle Adjustment Revisited , 2014, ECCV.

[23]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  J. H. Wilkinson The algebraic eigenvalue problem , 1966 .

[25]  Pushmeet Kohli,et al.  MobileFusion: Real-Time Volumetric Surface Reconstruction and Dense Tracking on Mobile Phones , 2015, IEEE Transactions on Visualization and Computer Graphics.

[26]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Georgy L. Gimel'farb,et al.  Accurate 3D Modelling by Fusion of Potentially Reliable Active Range and Passive Stereo Data , 2009, CAIP.

[28]  Pascal Fua,et al.  Efficient large-scale multi-view stereo for ultra high-resolution image sets , 2011, Machine Vision and Applications.

[29]  Marco Dubbini,et al.  Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images , 2015, Remote. Sens..

[30]  Georgy L. Gimel'farb,et al.  Probabilistic regularisation and symmetry in binocular dynamic programming stereo , 2002, Pattern Recognit. Lett..