Mission-time 3D reconstruction with quality estimation

Accurate and detailed 3-dimensional (3D) models of the underwater environment are becoming increasingly important in modern marine surveys, since they convey immense information that can be easily interpreted. Techniques such as bundle adjustment (BA) and structure from motion (SfM), which jointly estimate sparse 3D points of the scene and camera poses, have gained popularity in underwater mapping applications. However, for large-area surveys these methods are computationally expensive and not intended for online application. This paper proposes an SfM pipeline based on solving the BA problem in an incremental and efficient way. Furthermore, the new system can provide not only the solution of the optimization (camera trajectory along time and the 3D points of the environment), but also the estimate of the uncertainty associated with the 3D reconstruction. This system is able to produce results in mission-time, i.e. while the robot is in the water or very shortly afterwards. Such quick availability is of great importance during survey operations as it allows data quality assessment in-situ, and eventual replanning of missions in case of need.

[1]  N. Gracias,et al.  Detection of interest points in turbid underwater images , 2011, OCEANS 2011 IEEE - Spain.

[2]  Hauke Strasdat,et al.  Scale Drift-Aware Large Scale Monocular SLAM , 2010, Robotics: Science and Systems.

[3]  Alberto Quattrini Li,et al.  Vision-based shipwreck mapping: On evaluating features quality and open source state estimation packages , 2016, OCEANS 2016 MTS/IEEE Monterey.

[4]  Robert Mahony,et al.  The effect of different parameterisations in incremental structure from motion , 2015, ICRA 2015.

[5]  Hauke Strasdat,et al.  Local accuracy and global consistency for efficient SLAM , 2012 .

[6]  Frank Dellaert,et al.  3D reconstruction of underwater structures , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  M. Carreras,et al.  Mapping the Moon: Using a lightweight AUV to survey the site of the 17th century ship ‘La Lune’ , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[9]  Stefan B. Williams,et al.  Generation and visualization of large‐scale three‐dimensional reconstructions from underwater robotic surveys , 2010, J. Field Robotics.

[10]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[11]  Frank Dellaert,et al.  Incremental Light Bundle Adjustment , 2012, BMVC.

[12]  Hanumant Singh,et al.  Visually Mapping the RMS Titanic: Conservative Covariance Estimates for SLAM Information Filters , 2006, Int. J. Robotics Res..

[13]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Viorela Ila,et al.  Fast sparse matrix multiplication on GPU , 2015, SpringSim.

[15]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[16]  Hanqing Lu,et al.  Fast and Accurate Image Matching with Cascade Hashing for 3D Reconstruction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization and Mapping with Sparse Extended Information Filters , 2004, Int. J. Robotics Res..

[20]  Lionel Moisan,et al.  Automatic Homographic Registration of a Pair of Images, with A Contrario Elimination of Outliers , 2012, Image Process. Line.

[21]  Eduard Vidal,et al.  Autonomous Underwater Navigation and Optical Mapping in Unknown Natural Environments , 2016, Sensors.

[22]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[23]  Viorela Ila,et al.  SLAM++ 1 -A highly efficient and temporally scalable incremental SLAM framework , 2017, Int. J. Robotics Res..

[24]  Pavel Zemcík,et al.  Incremental Block Cholesky Factorization for Nonlinear Least Squares in Robotics , 2013, Robotics: Science and Systems.

[25]  Pavel Zemcík,et al.  Efficient implementation for block matrix operations for nonlinear least squares problems in robotic applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[26]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[27]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[28]  Viorela Ila,et al.  3D reconstruction quality analysis and its acceleration on GPU clusters , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[29]  Pavel Zemcík,et al.  Fast covariance recovery in incremental nonlinear least square solvers , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Frank Dellaert,et al.  Covariance recovery from a square root information matrix for data association , 2009, Robotics Auton. Syst..

[31]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[32]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.