A Robust Pavement Mapping System Based on Normal-Constrained Stereo Visual Odometry

Pavement condition is crucial for civil infrastructure maintenance. This task usually requires efficient road damage localization, which can be accomplished by the visual odometry system embedded in unmanned aerial vehicles (UAVs), However, the state-of-the-art visual odometry and mapping methods suffer from large drift under the degeneration of the scene structure. To alleviate this issue, we integrate normal constraints into the visual odometry process, which greatly helps to avoid large drift. By parameterizing the normal vector on the tangential plane, the normal factors are coupled with traditional reprojection factors in the pose optimization procedure. The experimental results demonstrate the effectiveness of the proposed system. The overall absolute trajectory error is improved by approximately 20%, which indicates that the estimated trajectory is much more accurate than that obtained using other state-of-the-art methods.

[1]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Igor Cvisic SOFT-SLAM : Computationally Efficient Stereo Visual SLAM for Autonomous UAVs , 2017 .

[3]  Rui Fan Real-time computer stereo vision for automotive applications , 2018 .

[4]  Roland Siegwart,et al.  Keyframe-Based Visual-Inertial SLAM using Nonlinear Optimization , 2013, Robotics: Science and Systems.

[5]  Vijay Kumar,et al.  Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight , 2017, IEEE Robotics and Automation Letters.

[6]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[7]  C Zhang,et al.  A UAV-based photogrammetric mapping system for road condition assessment , 2008 .

[8]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[9]  Daniel Cremers,et al.  Direct Sparse Odometry , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shaojie Shen,et al.  VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator , 2017, IEEE Transactions on Robotics.

[11]  Ioannis Pitas,et al.  Key Ingredients of Self-Driving Cars , 2019, ArXiv.

[12]  Roland Siegwart,et al.  Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium , 2013, J. Field Robotics.

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  Roland Siegwart,et al.  Robust visual inertial odometry using a direct EKF-based approach , 2015, IROS 2015.

[15]  Ming Liu,et al.  Real-Time, Environmentally-Robust 3D LiDAR Localization , 2019, 2019 IEEE International Conference on Imaging Systems and Techniques (IST).

[16]  Ioannis Pitas,et al.  Pothole Detection Based on Disparity Transformation and Road Surface Modeling , 2020, IEEE Transactions on Image Processing.

[17]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[19]  Ming Liu,et al.  Road Damage Detection Based on Unsupervised Disparity Map Segmentation , 2019, IEEE Transactions on Intelligent Transportation Systems.

[20]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[21]  Ivan Markovic,et al.  SOFT‐SLAM: Computationally efficient stereo visual simultaneous localization and mapping for autonomous unmanned aerial vehicles , 2018, J. Field Robotics.

[22]  Frank Dellaert,et al.  On-Manifold Preintegration for Real-Time Visual--Inertial Odometry , 2015, IEEE Transactions on Robotics.

[23]  Ming Liu,et al.  Low-Cost GPS-Aided LiDAR State Estimation and Map Building , 2019, 2019 IEEE International Conference on Imaging Systems and Techniques (IST).

[24]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[25]  Naim Dahnoun,et al.  Road Surface 3D Reconstruction Based on Dense Subpixel Disparity Map Estimation , 2018, IEEE Transactions on Image Processing.

[26]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[27]  J S Miller,et al.  DISTRESS IDENTIFICATION MANUAL FOR THE LONG-TERM PAVEMENT PERFORMANCE PROGRAM (FOURTH REVISED EDITION) , 2003 .

[28]  Taehyeong Kim,et al.  Review and Analysis of Pothole Detection Methods , 2014 .

[29]  Naim Dahnoun,et al.  A Novel Disparity Transformation Algorithm for Road Segmentation , 2018, Inf. Process. Lett..

[30]  Ioannis Pitas,et al.  A Robust Roll Angle Estimation Algorithm Based on Gradient Descent , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[31]  Shaojie Shen,et al.  Real-Time Dense Stereo Embedded in a UAV for Road Inspection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).